2024-09-10T16:16:26.849 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-10T16:16:26.869 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T16:16:26.951 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310 branch: wip-bharath7-testing-2024-09-10-1409 description: rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-zlib} rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} email: skanta@redhat.com first_in_suite: false job_id: '7899310' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-bharath7-testing-2024-09-10-1409 ceph: conf: client: debug monc: 20 debug ms: 1 global: mon client directed command retry: 5 mon election default strategy: 3 ms bind msgr2: false ms inject socket failures: 5000 ms type: async mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon min osdmap epochs: 25 mon osdmap full prune interval: 2 mon osdmap full prune min: 15 mon osdmap full prune txsize: 2 mon scrub inject crc mismatch: 0.01 mon scrub inject missing keys: 0.05 mon scrub interval: 300 paxos min: 10 paxos service trim min: 5 paxos trim min: 10 osd: bluestore block size: 96636764160 bluestore compression algorithm: zlib bluestore compression mode: aggressive bluestore fsck on mount: true bluestore write v2: true bluestore zero block detection: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd debug verify cached snaps: true osd debug verify missing on start: true osd failsafe full ratio: 0.95 osd mclock override recovery settings: true osd mclock profile: high_recovery_ops osd objectstore: bluestore osd op queue: debug_random osd op queue cut off: debug_random flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - ScrubResult - scrub mismatch - overall HEALTH_ - \(MGR_DOWN\) - \(PG_AVAILABILITY\) - \(SLOW_OPS\) - slow request - \(OSD_SLOW_PING_TIME - overall HEALTH_ - \(MON_DOWN\) - \(POOL_APP_NOT_ENABLED\) - slow request - overall HEALTH_ mon_bind_msgr2: false sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-bharath7-testing-2024-09-10-1409 sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 owner: scheduled_skanta@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mon.d - mon.e - osd.0 - osd.1 - osd.2 - - mon.f - mon.g - mon.h - mon.i - mgr.x - osd.3 - osd.4 - osd.5 - client.0 seed: 5245 sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-bharath7-testing-2024-09-10-1409 suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMauob6BlDSyINEYhVySazDYQ2QoC6yY6xyn+GfvhclcyiIoJxQLvHj4Y6wvVNZaNtE3PpxPTanme72z+VzppzE= smithi189.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBcpN9Igm3L5PHANPgkZddyioMzvv3jTMXqVEBRJHqKgZkg1+biVpdjAIO0mhxFBPWmOB+uvWjLwjHpoxiy2bCo= tasks: - install: null - ceph: null - mon_thrash: revive_delay: 90 thrash_delay: 1 thrash_many: true - exec: client.0: - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel - ceph_test_rados_delete_pools_parallel teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-10_15:30:27 tube: smithi user: skanta verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-10T16:16:26.951 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa; will attempt to use it 2024-09-10T16:16:26.952 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa/tasks 2024-09-10T16:16:26.952 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-10T16:16:26.954 INFO:teuthology.task.internal:Checking packages... 2024-09-10T16:16:26.976 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46' 2024-09-10T16:16:26.977 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-10T16:16:26.977 INFO:teuthology.packaging:ref: None 2024-09-10T16:16:26.977 INFO:teuthology.packaging:tag: None 2024-09-10T16:16:26.977 INFO:teuthology.packaging:branch: wip-bharath7-testing-2024-09-10-1409 2024-09-10T16:16:26.977 INFO:teuthology.packaging:sha1: bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T16:16:26.977 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-bharath7-testing-2024-09-10-1409 2024-09-10T16:16:27.120 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4858-gbad1f558-1jammy 2024-09-10T16:16:27.122 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-10T16:16:27.128 INFO:teuthology.task.internal:no buildpackages task found 2024-09-10T16:16:27.128 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-10T16:16:27.156 INFO:teuthology.task.internal:Saving configuration 2024-09-10T16:16:27.173 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-10T16:16:27.227 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-10T16:16:27.252 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 16:10:34.686009', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIG/i3IhSmQqOzO/LPZ0VWIQFNmBGfP0IzBokE6Qjgark'} 2024-09-10T16:16:27.274 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi189.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-10 16:10:34.687773', 'locked_by': 'scheduled_skanta@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOcX7Q7yx0UK0tr/6kSllldn472pKM0I1zkNsAUOhxzD'} 2024-09-10T16:16:27.274 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-10T16:16:27.280 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'] 2024-09-10T16:16:27.280 INFO:teuthology.task.internal:roles: ubuntu@smithi189.front.sepia.ceph.com - ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0'] 2024-09-10T16:16:27.281 INFO:teuthology.run_tasks:Running task console_log... 2024-09-10T16:16:27.341 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7faf53327be0>, signals=[15]) 2024-09-10T16:16:27.341 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-10T16:16:27.347 INFO:teuthology.task.internal:Opening connections... 2024-09-10T16:16:27.347 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T16:16:27.349 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T16:16:27.434 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T16:16:27.435 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T16:16:27.515 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-10T16:16:27.522 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-10T16:16:27.527 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-10T16:16:27.527 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-10T16:16:27.577 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T16:16:27.577 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="Ubuntu" 2024-09-10T16:16:27.577 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="22.04" 2024-09-10T16:16:27.577 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T16:16:27.577 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_CODENAME=jammy 2024-09-10T16:16:27.577 INFO:teuthology.orchestra.run.smithi081.stdout:ID=ubuntu 2024-09-10T16:16:27.577 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE=debian 2024-09-10T16:16:27.578 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T16:16:27.578 INFO:teuthology.orchestra.run.smithi081.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T16:16:27.578 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T16:16:27.578 INFO:teuthology.orchestra.run.smithi081.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T16:16:27.578 INFO:teuthology.orchestra.run.smithi081.stdout:UBUNTU_CODENAME=jammy 2024-09-10T16:16:27.578 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-10T16:16:27.598 DEBUG:teuthology.orchestra.run.smithi189:> uname -m 2024-09-10T16:16:27.603 INFO:teuthology.orchestra.run.smithi189.stdout:x86_64 2024-09-10T16:16:27.603 DEBUG:teuthology.orchestra.run.smithi189:> cat /etc/os-release 2024-09-10T16:16:27.648 INFO:teuthology.orchestra.run.smithi189.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-10T16:16:27.649 INFO:teuthology.orchestra.run.smithi189.stdout:NAME="Ubuntu" 2024-09-10T16:16:27.649 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_ID="22.04" 2024-09-10T16:16:27.649 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-10T16:16:27.649 INFO:teuthology.orchestra.run.smithi189.stdout:VERSION_CODENAME=jammy 2024-09-10T16:16:27.649 INFO:teuthology.orchestra.run.smithi189.stdout:ID=ubuntu 2024-09-10T16:16:27.649 INFO:teuthology.orchestra.run.smithi189.stdout:ID_LIKE=debian 2024-09-10T16:16:27.649 INFO:teuthology.orchestra.run.smithi189.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-10T16:16:27.649 INFO:teuthology.orchestra.run.smithi189.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-10T16:16:27.649 INFO:teuthology.orchestra.run.smithi189.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-10T16:16:27.649 INFO:teuthology.orchestra.run.smithi189.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-10T16:16:27.650 INFO:teuthology.orchestra.run.smithi189.stdout:UBUNTU_CODENAME=jammy 2024-09-10T16:16:27.650 INFO:teuthology.lock.ops:Updating smithi189.front.sepia.ceph.com on lock server 2024-09-10T16:16:27.673 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-10T16:16:27.681 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-10T16:16:27.715 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-10T16:16:27.716 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-10T16:16:27.718 DEBUG:teuthology.orchestra.run.smithi189:> test '!' -e /home/ubuntu/cephtest 2024-09-10T16:16:27.722 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-10T16:16:27.728 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-10T16:16:27.728 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-10T16:16:27.765 DEBUG:teuthology.orchestra.run.smithi189:> test -z $(ls -A /var/lib/ceph) 2024-09-10T16:16:27.778 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-10T16:16:27.831 INFO:teuthology.run_tasks:Running task kernel... 2024-09-10T16:16:27.845 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-10T16:16:27.845 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.f': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-10T16:16:27.846 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T16:16:27.847 DEBUG:teuthology.orchestra.run.smithi189:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-10T16:16:27.851 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T16:16:27.851 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-10T16:16:27.852 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T16:16:27.852 DEBUG:teuthology.orchestra.run.smithi189:> uname -r 2024-09-10T16:16:27.900 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-56-generic 2024-09-10T16:16:27.900 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.15.0-56-generic 2024-09-10T16:16:27.900 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2024-09-10T16:16:27.902 INFO:teuthology.orchestra.run.smithi189.stdout:5.15.0-56-generic 2024-09-10T16:16:27.902 INFO:teuthology.task.kernel:Running kernel on smithi189: 5.15.0-56-generic 2024-09-10T16:16:27.902 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get clean 2024-09-10T16:16:28.019 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get update 2024-09-10T16:16:28.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-09-10T16:16:28.156 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T16:16:28.186 INFO:teuthology.orchestra.run.smithi189.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T16:16:28.204 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T16:16:28.214 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-10T16:16:28.254 INFO:teuthology.orchestra.run.smithi189.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T16:16:28.269 INFO:teuthology.orchestra.run.smithi189.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T16:16:28.278 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-10T16:16:28.315 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-10T16:16:28.375 INFO:teuthology.orchestra.run.smithi189.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T16:16:28.438 INFO:teuthology.orchestra.run.smithi189.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T16:16:28.450 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-10T16:16:28.472 INFO:teuthology.orchestra.run.smithi189.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T16:16:28.475 INFO:teuthology.orchestra.run.smithi189.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T16:16:28.475 INFO:teuthology.orchestra.run.smithi189.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T16:16:28.476 INFO:teuthology.orchestra.run.smithi189.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T16:16:28.498 INFO:teuthology.orchestra.run.smithi189.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T16:16:28.501 INFO:teuthology.orchestra.run.smithi189.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T16:16:28.501 INFO:teuthology.orchestra.run.smithi189.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-10T16:16:28.507 INFO:teuthology.orchestra.run.smithi189.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,122 kB] 2024-09-10T16:16:28.516 INFO:teuthology.orchestra.run.smithi189.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T16:16:28.518 INFO:teuthology.orchestra.run.smithi189.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-10T16:16:28.518 INFO:teuthology.orchestra.run.smithi189.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T16:16:28.548 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-10T16:16:28.549 INFO:teuthology.orchestra.run.smithi189.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T16:16:28.550 INFO:teuthology.orchestra.run.smithi189.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T16:16:28.550 INFO:teuthology.orchestra.run.smithi189.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T16:16:28.550 INFO:teuthology.orchestra.run.smithi189.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T16:16:28.551 INFO:teuthology.orchestra.run.smithi189.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T16:16:28.551 INFO:teuthology.orchestra.run.smithi189.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T16:16:28.551 INFO:teuthology.orchestra.run.smithi189.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T16:16:28.553 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-10T16:16:28.555 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-10T16:16:28.555 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-10T16:16:28.556 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-10T16:16:28.567 INFO:teuthology.orchestra.run.smithi189.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T16:16:28.567 INFO:teuthology.orchestra.run.smithi189.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T16:16:28.574 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-10T16:16:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-10T16:16:28.577 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-10T16:16:28.582 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,122 kB] 2024-09-10T16:16:28.584 INFO:teuthology.orchestra.run.smithi189.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T16:16:28.584 INFO:teuthology.orchestra.run.smithi189.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T16:16:28.589 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-10T16:16:28.590 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-10T16:16:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-10T16:16:28.591 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-10T16:16:28.618 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-10T16:16:28.618 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-10T16:16:28.618 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-10T16:16:28.618 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-10T16:16:28.619 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-10T16:16:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-10T16:16:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-10T16:16:28.624 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-10T16:16:28.641 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-10T16:16:28.641 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-10T16:16:28.717 INFO:teuthology.orchestra.run.smithi189.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T16:16:28.770 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T16:16:29.054 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-10T16:16:29.136 INFO:teuthology.orchestra.run.smithi189.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-10T16:16:29.152 INFO:teuthology.orchestra.run.smithi189.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T16:16:29.161 INFO:teuthology.orchestra.run.smithi189.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T16:16:29.161 INFO:teuthology.orchestra.run.smithi189.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T16:16:29.162 INFO:teuthology.orchestra.run.smithi189.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T16:16:29.226 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-10T16:16:29.239 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-10T16:16:29.240 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-10T16:16:29.258 INFO:teuthology.orchestra.run.smithi189.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T16:16:29.269 INFO:teuthology.orchestra.run.smithi189.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T16:16:29.270 INFO:teuthology.orchestra.run.smithi189.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T16:16:29.286 INFO:teuthology.orchestra.run.smithi189.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T16:16:29.312 INFO:teuthology.orchestra.run.smithi189.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T16:16:29.318 INFO:teuthology.orchestra.run.smithi189.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T16:16:29.318 INFO:teuthology.orchestra.run.smithi189.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T16:16:29.318 INFO:teuthology.orchestra.run.smithi189.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T16:16:29.319 INFO:teuthology.orchestra.run.smithi189.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T16:16:29.324 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-10T16:16:29.325 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-10T16:16:29.334 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-10T16:16:29.334 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-10T16:16:29.347 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-10T16:16:29.387 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-10T16:16:29.390 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-10T16:16:29.390 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-10T16:16:29.392 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-10T16:16:29.398 INFO:teuthology.orchestra.run.smithi189.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T16:16:29.472 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-10T16:16:29.473 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-10T16:16:34.820 INFO:teuthology.orchestra.run.smithi189.stdout:Fetched 15.8 MB in 2s (7,609 kB/s) 2024-09-10T16:16:34.863 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 15.8 MB in 2s (7,428 kB/s) 2024-09-10T16:16:36.327 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-09-10T16:16:36.346 DEBUG:teuthology.orchestra.run.smithi189:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T16:16:36.360 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-10T16:16:36.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T16:16:36.409 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-09-10T16:16:36.436 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-10T16:16:36.620 INFO:teuthology.orchestra.run.smithi189.stdout:Building dependency tree... 2024-09-10T16:16:36.620 INFO:teuthology.orchestra.run.smithi189.stdout:Reading state information... 2024-09-10T16:16:36.623 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-10T16:16:36.623 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-10T16:16:36.789 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T16:16:36.789 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T16:16:36.789 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T16:16:36.790 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T16:16:36.790 INFO:teuthology.orchestra.run.smithi081.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T16:16:36.790 INFO:teuthology.orchestra.run.smithi081.stdout: python2.7-minimal 2024-09-10T16:16:36.790 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T16:16:36.791 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-09-10T16:16:36.791 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T16:16:36.791 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T16:16:36.792 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T16:16:36.793 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-09-10T16:16:36.793 INFO:teuthology.orchestra.run.smithi081.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T16:16:36.793 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2024-09-10T16:16:36.793 INFO:teuthology.orchestra.run.smithi081.stdout: thermald 2024-09-10T16:16:36.797 INFO:teuthology.orchestra.run.smithi189.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T16:16:36.797 INFO:teuthology.orchestra.run.smithi189.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T16:16:36.797 INFO:teuthology.orchestra.run.smithi189.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T16:16:36.797 INFO:teuthology.orchestra.run.smithi189.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T16:16:36.797 INFO:teuthology.orchestra.run.smithi189.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-10T16:16:36.797 INFO:teuthology.orchestra.run.smithi189.stdout: python2.7-minimal 2024-09-10T16:16:36.797 INFO:teuthology.orchestra.run.smithi189.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T16:16:36.798 INFO:teuthology.orchestra.run.smithi189.stdout:The following additional packages will be installed: 2024-09-10T16:16:36.798 INFO:teuthology.orchestra.run.smithi189.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T16:16:36.798 INFO:teuthology.orchestra.run.smithi189.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-10T16:16:36.799 INFO:teuthology.orchestra.run.smithi189.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-10T16:16:36.800 INFO:teuthology.orchestra.run.smithi189.stdout:Suggested packages: 2024-09-10T16:16:36.800 INFO:teuthology.orchestra.run.smithi189.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-10T16:16:36.800 INFO:teuthology.orchestra.run.smithi189.stdout:Recommended packages: 2024-09-10T16:16:36.801 INFO:teuthology.orchestra.run.smithi189.stdout: thermald 2024-09-10T16:16:36.843 INFO:teuthology.orchestra.run.smithi189.stdout:The following NEW packages will be installed: 2024-09-10T16:16:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T16:16:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T16:16:36.843 INFO:teuthology.orchestra.run.smithi189.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T16:16:36.844 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-09-10T16:16:36.844 INFO:teuthology.orchestra.run.smithi081.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-10T16:16:36.844 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-10T16:16:36.845 INFO:teuthology.orchestra.run.smithi081.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-10T16:16:36.845 INFO:teuthology.orchestra.run.smithi189.stdout:The following packages will be upgraded: 2024-09-10T16:16:36.845 INFO:teuthology.orchestra.run.smithi189.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T16:16:36.846 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages will be upgraded: 2024-09-10T16:16:36.846 INFO:teuthology.orchestra.run.smithi081.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-10T16:16:36.914 INFO:teuthology.orchestra.run.smithi081.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T16:16:36.915 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 113 MB of archives. 2024-09-10T16:16:36.915 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T16:16:36.915 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T16:16:36.915 INFO:teuthology.orchestra.run.smithi189.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T16:16:36.915 INFO:teuthology.orchestra.run.smithi189.stdout:Need to get 113 MB of archives. 2024-09-10T16:16:36.915 INFO:teuthology.orchestra.run.smithi189.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-10T16:16:36.915 INFO:teuthology.orchestra.run.smithi189.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-10T16:16:37.353 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T16:16:37.367 INFO:teuthology.orchestra.run.smithi189.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-10T16:16:37.452 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T16:16:37.459 INFO:teuthology.orchestra.run.smithi189.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-10T16:16:38.224 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T16:16:38.224 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T16:16:38.224 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T16:16:38.265 INFO:teuthology.orchestra.run.smithi189.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-10T16:16:38.265 INFO:teuthology.orchestra.run.smithi189.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-10T16:16:38.265 INFO:teuthology.orchestra.run.smithi189.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-10T16:16:38.342 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T16:16:38.384 INFO:teuthology.orchestra.run.smithi189.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-10T16:16:38.406 INFO:teuthology.orchestra.run.smithi189.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T16:16:38.439 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-10T16:16:38.789 INFO:teuthology.orchestra.run.smithi189.stdout:Fetched 113 MB in 2s (72.9 MB/s) 2024-09-10T16:16:38.833 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 113 MB in 2s (71.5 MB/s) 2024-09-10T16:16:38.973 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T16:16:39.014 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-10T16:16:40.961 INFO:teuthology.orchestra.run.smithi189.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T16:16:40.966 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T16:16:41.054 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:16:41.130 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-10T16:16:41.134 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T16:16:41.337 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:16:43.322 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T16:16:43.343 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T16:16:43.425 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:16:43.664 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-10T16:16:43.685 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T16:16:43.768 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:16:43.925 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T16:16:43.945 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T16:16:43.983 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:16:44.250 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-10T16:16:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T16:16:44.300 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:16:51.018 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T16:16:51.121 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T16:16:51.378 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T16:16:51.462 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T16:16:51.513 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T16:16:51.591 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T16:16:51.820 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T16:16:51.902 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T16:16:51.913 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T16:16:51.941 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T16:16:51.952 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T16:16:52.278 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-10T16:16:52.300 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-10T16:16:52.353 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T16:16:57.905 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T16:16:57.942 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T16:16:57.980 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:16:58.511 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-10T16:16:58.547 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-10T16:16:58.710 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:17:00.686 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T16:17:00.785 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T16:17:01.143 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T16:17:01.264 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:17:01.390 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T16:17:01.481 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-10T16:17:01.502 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:17:01.615 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-10T16:17:01.974 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-10T16:17:02.095 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:17:02.221 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-10T16:17:02.350 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:17:02.809 INFO:teuthology.orchestra.run.smithi189.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T16:17:02.809 INFO:teuthology.orchestra.run.smithi189.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T16:17:02.809 INFO:teuthology.orchestra.run.smithi189.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T16:17:02.810 INFO:teuthology.orchestra.run.smithi189.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T16:17:02.978 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:17:03.678 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-10T16:17:03.678 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-10T16:17:03.678 INFO:teuthology.orchestra.run.smithi081.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-10T16:17:03.679 INFO:teuthology.orchestra.run.smithi081.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-10T16:17:04.760 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:17:04.796 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:17:06.145 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:17:06.206 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T16:17:06.341 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T16:17:06.458 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:17:06.513 INFO:teuthology.orchestra.run.smithi189.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T16:17:06.513 INFO:teuthology.orchestra.run.smithi189.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T16:17:07.522 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-10T16:17:07.647 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-10T16:17:07.774 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-10T16:17:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-10T16:17:07.842 INFO:teuthology.orchestra.run.smithi081.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-10T16:17:20.587 INFO:teuthology.orchestra.run.smithi189.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T16:17:20.587 INFO:teuthology.orchestra.run.smithi189.stdout:Sourcing file `/etc/default/grub' 2024-09-10T16:17:20.605 INFO:teuthology.orchestra.run.smithi189.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T16:17:20.628 INFO:teuthology.orchestra.run.smithi189.stdout:Generating grub configuration file ... 2024-09-10T16:17:20.881 INFO:teuthology.orchestra.run.smithi189.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T16:17:20.903 INFO:teuthology.orchestra.run.smithi189.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T16:17:21.164 INFO:teuthology.orchestra.run.smithi189.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T16:17:21.169 INFO:teuthology.orchestra.run.smithi189.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T16:17:21.233 INFO:teuthology.orchestra.run.smithi189.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T16:17:21.239 INFO:teuthology.orchestra.run.smithi189.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T16:17:21.412 INFO:teuthology.orchestra.run.smithi189.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T16:17:21.412 INFO:teuthology.orchestra.run.smithi189.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T16:17:21.412 INFO:teuthology.orchestra.run.smithi189.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T16:17:21.451 INFO:teuthology.orchestra.run.smithi189.stdout:done 2024-09-10T16:17:21.646 INFO:teuthology.orchestra.run.smithi081.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-10T16:17:21.646 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub' 2024-09-10T16:17:21.669 INFO:teuthology.orchestra.run.smithi081.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T16:17:21.682 INFO:teuthology.orchestra.run.smithi081.stdout:Generating grub configuration file ... 2024-09-10T16:17:21.964 DEBUG:teuthology.orchestra.run.smithi189:> dpkg -s linux-image-generic 2024-09-10T16:17:21.987 INFO:teuthology.orchestra.run.smithi189.stdout:Package: linux-image-generic 2024-09-10T16:17:21.987 INFO:teuthology.orchestra.run.smithi189.stdout:Status: install ok installed 2024-09-10T16:17:21.987 INFO:teuthology.orchestra.run.smithi189.stdout:Priority: optional 2024-09-10T16:17:21.987 INFO:teuthology.orchestra.run.smithi189.stdout:Section: kernel 2024-09-10T16:17:21.988 INFO:teuthology.orchestra.run.smithi189.stdout:Installed-Size: 21 2024-09-10T16:17:21.988 INFO:teuthology.orchestra.run.smithi189.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T16:17:21.988 INFO:teuthology.orchestra.run.smithi189.stdout:Architecture: amd64 2024-09-10T16:17:21.988 INFO:teuthology.orchestra.run.smithi189.stdout:Source: linux-meta 2024-09-10T16:17:21.988 INFO:teuthology.orchestra.run.smithi189.stdout:Version: 5.15.0.119.119 2024-09-10T16:17:21.988 INFO:teuthology.orchestra.run.smithi189.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T16:17:21.988 INFO:teuthology.orchestra.run.smithi189.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T16:17:21.988 INFO:teuthology.orchestra.run.smithi189.stdout:Recommends: thermald 2024-09-10T16:17:21.988 INFO:teuthology.orchestra.run.smithi189.stdout:Description: Generic Linux kernel image 2024-09-10T16:17:21.988 INFO:teuthology.orchestra.run.smithi189.stdout: This package will always depend on the latest generic kernel image 2024-09-10T16:17:21.988 INFO:teuthology.orchestra.run.smithi189.stdout: available. 2024-09-10T16:17:21.989 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T16:17:21.989 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T16:17:21.989 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T16:17:21.989 INFO:teuthology.task.kernel:Installing distro kernel on mon.f... 2024-09-10T16:17:21.989 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi189.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T16:17:21.989 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get clean 2024-09-10T16:17:22.033 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T16:17:22.047 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T16:17:22.214 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get update 2024-09-10T16:17:22.418 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T16:17:22.423 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T16:17:22.460 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T16:17:22.460 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T16:17:22.494 INFO:teuthology.orchestra.run.smithi081.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T16:17:22.499 INFO:teuthology.orchestra.run.smithi081.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T16:17:22.531 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T16:17:22.613 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T16:17:22.681 INFO:teuthology.orchestra.run.smithi081.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T16:17:22.682 INFO:teuthology.orchestra.run.smithi081.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T16:17:22.682 INFO:teuthology.orchestra.run.smithi081.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T16:17:22.730 INFO:teuthology.orchestra.run.smithi081.stdout:done 2024-09-10T16:17:23.198 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2024-09-10T16:17:23.215 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2024-09-10T16:17:23.215 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2024-09-10T16:17:23.215 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2024-09-10T16:17:23.215 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2024-09-10T16:17:23.215 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 21 2024-09-10T16:17:23.215 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T16:17:23.215 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2024-09-10T16:17:23.215 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2024-09-10T16:17:23.216 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.119.119 2024-09-10T16:17:23.216 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T16:17:23.216 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T16:17:23.216 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2024-09-10T16:17:23.216 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2024-09-10T16:17:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2024-09-10T16:17:23.216 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2024-09-10T16:17:23.216 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-10T16:17:23.216 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-10T16:17:23.216 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-10T16:17:23.216 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-10T16:17:23.217 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-09-10T16:17:23.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get clean 2024-09-10T16:17:23.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-09-10T16:17:23.631 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T16:17:23.631 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T16:17:23.690 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T16:17:23.772 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T16:17:23.909 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-09-10T16:17:23.928 DEBUG:teuthology.orchestra.run.smithi189:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T16:17:23.993 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-09-10T16:17:24.211 INFO:teuthology.orchestra.run.smithi189.stdout:Building dependency tree... 2024-09-10T16:17:24.211 INFO:teuthology.orchestra.run.smithi189.stdout:Reading state information... 2024-09-10T16:17:24.411 INFO:teuthology.orchestra.run.smithi189.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T16:17:24.411 INFO:teuthology.orchestra.run.smithi189.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T16:17:24.411 INFO:teuthology.orchestra.run.smithi189.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T16:17:24.411 INFO:teuthology.orchestra.run.smithi189.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T16:17:24.411 INFO:teuthology.orchestra.run.smithi189.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T16:17:24.411 INFO:teuthology.orchestra.run.smithi189.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T16:17:24.412 INFO:teuthology.orchestra.run.smithi189.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T16:17:24.412 INFO:teuthology.orchestra.run.smithi189.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T16:17:24.457 INFO:teuthology.orchestra.run.smithi189.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T16:17:24.457 DEBUG:teuthology.orchestra.run.smithi189:> dpkg -s linux-image-generic 2024-09-10T16:17:24.472 INFO:teuthology.orchestra.run.smithi189.stdout:Package: linux-image-generic 2024-09-10T16:17:24.472 INFO:teuthology.orchestra.run.smithi189.stdout:Status: install ok installed 2024-09-10T16:17:24.473 INFO:teuthology.orchestra.run.smithi189.stdout:Priority: optional 2024-09-10T16:17:24.473 INFO:teuthology.orchestra.run.smithi189.stdout:Section: kernel 2024-09-10T16:17:24.473 INFO:teuthology.orchestra.run.smithi189.stdout:Installed-Size: 21 2024-09-10T16:17:24.473 INFO:teuthology.orchestra.run.smithi189.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T16:17:24.473 INFO:teuthology.orchestra.run.smithi189.stdout:Architecture: amd64 2024-09-10T16:17:24.473 INFO:teuthology.orchestra.run.smithi189.stdout:Source: linux-meta 2024-09-10T16:17:24.473 INFO:teuthology.orchestra.run.smithi189.stdout:Version: 5.15.0.119.119 2024-09-10T16:17:24.473 INFO:teuthology.orchestra.run.smithi189.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T16:17:24.473 INFO:teuthology.orchestra.run.smithi189.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T16:17:24.474 INFO:teuthology.orchestra.run.smithi189.stdout:Recommends: thermald 2024-09-10T16:17:24.474 INFO:teuthology.orchestra.run.smithi189.stdout:Description: Generic Linux kernel image 2024-09-10T16:17:24.474 INFO:teuthology.orchestra.run.smithi189.stdout: This package will always depend on the latest generic kernel image 2024-09-10T16:17:24.474 INFO:teuthology.orchestra.run.smithi189.stdout: available. 2024-09-10T16:17:24.474 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-09-10T16:17:24.520 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.DhtuuZ0zaJ 2024-09-10T16:17:24.520 DEBUG:teuthology.orchestra.run.smithi189:> sudo cp /boot/grub/grub.cfg /tmp/tmp.DhtuuZ0zaJ 2024-09-10T16:17:24.575 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.DhtuuZ0zaJ 2024-09-10T16:17:24.684 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.DhtuuZ0zaJ is 10KB 2024-09-10T16:17:24.696 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.DhtuuZ0zaJ 2024-09-10T16:17:24.702 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T16:17:24.756 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:17:24.756 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T16:17:24.756 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T16:17:24.824 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T16:17:24.824 DEBUG:teuthology.orchestra.run.smithi189:> sudo update-grub 2024-09-10T16:17:25.114 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-10T16:17:25.133 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-10T16:17:25.199 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-10T16:17:25.408 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-10T16:17:25.409 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-10T16:17:25.596 INFO:teuthology.orchestra.run.smithi081.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-10T16:17:25.596 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T16:17:25.596 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T16:17:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T16:17:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T16:17:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T16:17:25.597 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T16:17:25.597 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T16:17:25.641 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-10T16:17:25.643 DEBUG:teuthology.orchestra.run.smithi081:> dpkg -s linux-image-generic 2024-09-10T16:17:25.658 INFO:teuthology.orchestra.run.smithi081.stdout:Package: linux-image-generic 2024-09-10T16:17:25.658 INFO:teuthology.orchestra.run.smithi081.stdout:Status: install ok installed 2024-09-10T16:17:25.659 INFO:teuthology.orchestra.run.smithi081.stdout:Priority: optional 2024-09-10T16:17:25.659 INFO:teuthology.orchestra.run.smithi081.stdout:Section: kernel 2024-09-10T16:17:25.659 INFO:teuthology.orchestra.run.smithi081.stdout:Installed-Size: 21 2024-09-10T16:17:25.659 INFO:teuthology.orchestra.run.smithi081.stdout:Maintainer: Ubuntu Kernel Team 2024-09-10T16:17:25.659 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: amd64 2024-09-10T16:17:25.659 INFO:teuthology.orchestra.run.smithi081.stdout:Source: linux-meta 2024-09-10T16:17:25.659 INFO:teuthology.orchestra.run.smithi081.stdout:Version: 5.15.0.119.119 2024-09-10T16:17:25.659 INFO:teuthology.orchestra.run.smithi081.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-10T16:17:25.659 INFO:teuthology.orchestra.run.smithi081.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-10T16:17:25.659 INFO:teuthology.orchestra.run.smithi081.stdout:Recommends: thermald 2024-09-10T16:17:25.659 INFO:teuthology.orchestra.run.smithi081.stdout:Description: Generic Linux kernel image 2024-09-10T16:17:25.659 INFO:teuthology.orchestra.run.smithi081.stdout: This package will always depend on the latest generic kernel image 2024-09-10T16:17:25.660 INFO:teuthology.orchestra.run.smithi081.stdout: available. 2024-09-10T16:17:25.660 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-10T16:17:25.706 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.88oxamnuzN 2024-09-10T16:17:25.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub/grub.cfg /tmp/tmp.88oxamnuzN 2024-09-10T16:17:25.794 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.88oxamnuzN 2024-09-10T16:17:25.921 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.88oxamnuzN is 10KB 2024-09-10T16:17:25.934 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.88oxamnuzN 2024-09-10T16:17:25.940 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-10T16:17:25.999 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:17:25.999 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-10T16:17:25.999 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-10T16:17:26.078 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-10T16:17:26.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo update-grub 2024-09-10T16:17:26.083 INFO:teuthology.orchestra.run.smithi189.stderr:Sourcing file `/etc/default/grub' 2024-09-10T16:17:26.084 INFO:teuthology.orchestra.run.smithi189.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T16:17:26.088 INFO:teuthology.orchestra.run.smithi189.stderr:Generating grub configuration file ... 2024-09-10T16:17:26.269 INFO:teuthology.orchestra.run.smithi189.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T16:17:26.276 INFO:teuthology.orchestra.run.smithi189.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T16:17:26.520 INFO:teuthology.orchestra.run.smithi189.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T16:17:26.525 INFO:teuthology.orchestra.run.smithi189.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T16:17:26.570 INFO:teuthology.orchestra.run.smithi189.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T16:17:26.575 INFO:teuthology.orchestra.run.smithi189.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T16:17:26.713 INFO:teuthology.orchestra.run.smithi189.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T16:17:26.713 INFO:teuthology.orchestra.run.smithi189.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T16:17:26.713 INFO:teuthology.orchestra.run.smithi189.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T16:17:26.735 INFO:teuthology.orchestra.run.smithi189.stderr:done 2024-09-10T16:17:26.737 DEBUG:teuthology.orchestra.run.smithi189:> sudo shutdown -r now 2024-09-10T16:17:27.388 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub' 2024-09-10T16:17:27.389 INFO:teuthology.orchestra.run.smithi081.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-10T16:17:27.392 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-10T16:17:27.569 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-10T16:17:27.575 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-10T16:17:27.863 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-10T16:17:27.868 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-10T16:17:27.909 INFO:teuthology.orchestra.run.smithi081.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-10T16:17:27.914 INFO:teuthology.orchestra.run.smithi081.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-10T16:17:28.048 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-10T16:17:28.048 INFO:teuthology.orchestra.run.smithi081.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-10T16:17:28.048 INFO:teuthology.orchestra.run.smithi081.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-10T16:17:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-10T16:17:28.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-10T16:17:56.769 INFO:teuthology.task.kernel:Checking client mon.f for new kernel version... 2024-09-10T16:17:56.770 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T16:17:56.771 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T16:17:58.082 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-10T16:17:58.082 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T16:17:58.083 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T16:18:15.229 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-09-10T16:18:16.513 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-10T16:18:24.237 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T16:18:24.238 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T16:18:25.515 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T16:18:25.516 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T16:18:27.293 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.189 2024-09-10T16:18:28.577 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-10T16:18:39.305 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T16:18:39.306 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T16:18:40.579 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T16:18:40.580 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T16:18:59.005 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-10T16:19:14.021 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T16:19:14.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T16:19:14.390 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-10T16:19:15.243 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T16:19:15.243 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-10T16:19:15.243 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-10T16:19:15.289 INFO:teuthology.orchestra.run.smithi081.stdout:5.15.0-119-generic 2024-09-10T16:19:15.289 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T16:19:15.289 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T16:19:15.289 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T16:19:16.290 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-10T16:19:16.290 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T16:19:16.428 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-09-10T16:19:16.452 DEBUG:teuthology.parallel:result is None 2024-09-10T16:19:39.309 DEBUG:teuthology.orchestra.remote:timed out 2024-09-10T16:19:54.310 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T16:19:54.312 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T16:19:54.684 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-10T16:19:55.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T16:19:55.228 INFO:teuthology.task.kernel:Checking kernel version of mon.f, want "5.15.0-119-generic"... 2024-09-10T16:19:55.229 DEBUG:teuthology.orchestra.run.smithi189:> uname -r 2024-09-10T16:19:55.277 INFO:teuthology.orchestra.run.smithi189.stdout:5.15.0-119-generic 2024-09-10T16:19:55.278 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-10T16:19:55.278 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-10T16:19:55.278 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-10T16:19:56.279 INFO:teuthology.task.kernel:Enabling kdb on mon.f... 2024-09-10T16:19:56.279 DEBUG:teuthology.orchestra.run.smithi189:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-10T16:19:56.361 INFO:teuthology.orchestra.run.smithi189.stdout:ttyS1 2024-09-10T16:19:56.391 DEBUG:teuthology.parallel:result is None 2024-09-10T16:19:56.392 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-10T16:19:56.399 INFO:teuthology.task.internal:Creating test directory... 2024-09-10T16:19:56.399 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T16:19:56.402 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-10T16:19:56.407 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-10T16:19:56.421 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-10T16:19:56.479 INFO:teuthology.task.internal:Creating archive directory... 2024-09-10T16:19:56.480 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T16:19:56.482 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-10T16:19:56.505 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-10T16:19:56.533 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-10T16:19:56.534 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T16:19:56.545 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-10T16:19:56.563 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T16:19:56.564 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T16:19:56.571 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T16:19:56.573 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-10T16:19:56.574 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-10T16:19:56.581 INFO:teuthology.task.internal:Configuring sudo... 2024-09-10T16:19:56.582 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T16:19:56.621 DEBUG:teuthology.orchestra.run.smithi189:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-10T16:19:56.634 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-10T16:19:56.646 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-10T16:19:56.646 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T16:19:56.677 DEBUG:teuthology.orchestra.run.smithi189:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-10T16:19:56.684 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T16:19:56.728 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T16:19:56.777 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:19:56.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T16:19:56.839 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-10T16:19:56.844 DEBUG:teuthology.orchestra.run.smithi189:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-10T16:19:56.893 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:19:56.894 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-10T16:19:56.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-10T16:19:56.959 DEBUG:teuthology.orchestra.run.smithi189:> sudo service rsyslog restart 2024-09-10T16:19:57.035 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-10T16:19:57.042 INFO:teuthology.task.internal:Starting timer... 2024-09-10T16:19:57.043 INFO:teuthology.run_tasks:Running task pcp... 2024-09-10T16:19:57.097 INFO:teuthology.run_tasks:Running task selinux... 2024-09-10T16:19:57.162 DEBUG:teuthology.task.selinux:Excluding smithi081: OS 'ubuntu' does not support SELinux 2024-09-10T16:19:57.162 DEBUG:teuthology.task.selinux:Excluding smithi189: OS 'ubuntu' does not support SELinux 2024-09-10T16:19:57.162 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-10T16:19:57.163 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-10T16:19:57.163 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-10T16:19:57.163 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-10T16:19:57.187 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-09-10T16:19:57.190 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-09-10T16:19:57.307 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-10T16:19:57.318 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-10T16:19:57.319 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi189.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-10T16:27:24.760 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi189.front.sepia.ceph.com')] 2024-09-10T16:27:24.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T16:27:24.763 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T16:27:24.860 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-10T16:27:24.941 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-10T16:27:24.941 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T16:27:24.942 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi189.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-10T16:27:25.022 DEBUG:teuthology.orchestra.run.smithi189:> true 2024-09-10T16:27:25.101 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi189.front.sepia.ceph.com' 2024-09-10T16:27:25.101 INFO:teuthology.run_tasks:Running task clock... 2024-09-10T16:27:25.113 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-10T16:27:25.114 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T16:27:25.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T16:27:25.117 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-10T16:27:25.117 DEBUG:teuthology.orchestra.run.smithi189:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T16:27:25.141 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T16:27:25.141 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: Command line: ntpd -gq 2024-09-10T16:27:25.141 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: ---------------------------------------------------- 2024-09-10T16:27:25.141 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T16:27:25.142 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T16:27:25.142 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: corporation. Support and training for ntp-4 are 2024-09-10T16:27:25.142 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: available at https://www.nwtime.org/support 2024-09-10T16:27:25.142 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: ---------------------------------------------------- 2024-09-10T16:27:25.143 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: proto: precision = 0.043 usec (-24) 2024-09-10T16:27:25.143 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: basedate set to 2022-02-04 2024-09-10T16:27:25.143 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: gps base set to 2022-02-06 (week 2196) 2024-09-10T16:27:25.143 INFO:teuthology.orchestra.run.smithi081.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T16:27:25.143 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T16:27:25.144 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T16:27:25.144 INFO:teuthology.orchestra.run.smithi081.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T16:27:25.144 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T16:27:25.145 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T16:27:25.145 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T16:27:25.145 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: Listen normally on 3 enp3s0f1 172.21.15.81:123 2024-09-10T16:27:25.145 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: Listen normally on 4 lo [::1]:123 2024-09-10T16:27:25.145 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d753%5]:123 2024-09-10T16:27:25.145 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:25 ntpd[18452]: Listening on routing socket on fd #22 for interface updates 2024-09-10T16:27:25.168 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-10T16:27:25.168 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: Command line: ntpd -gq 2024-09-10T16:27:25.168 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: ---------------------------------------------------- 2024-09-10T16:27:25.168 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: ntp-4 is maintained by Network Time Foundation, 2024-09-10T16:27:25.169 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-10T16:27:25.169 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: corporation. Support and training for ntp-4 are 2024-09-10T16:27:25.169 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: available at https://www.nwtime.org/support 2024-09-10T16:27:25.169 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: ---------------------------------------------------- 2024-09-10T16:27:25.170 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: proto: precision = 0.043 usec (-24) 2024-09-10T16:27:25.170 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: basedate set to 2022-02-04 2024-09-10T16:27:25.170 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: gps base set to 2022-02-06 (week 2196) 2024-09-10T16:27:25.170 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T16:27:25.170 INFO:teuthology.orchestra.run.smithi189.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-10T16:27:25.170 INFO:teuthology.orchestra.run.smithi189.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-10T16:27:25.172 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: restrict ::: KOD does nothing without LIMITED. 2024-09-10T16:27:25.172 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: Listen and drop on 0 v6wildcard [::]:123 2024-09-10T16:27:25.172 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-10T16:27:25.172 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: Listen normally on 2 lo 127.0.0.1:123 2024-09-10T16:27:25.172 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: Listen normally on 3 enp3s0f1 172.21.15.189:123 2024-09-10T16:27:25.172 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: Listen normally on 4 lo [::1]:123 2024-09-10T16:27:25.172 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6df1%5]:123 2024-09-10T16:27:25.172 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:25 ntpd[18485]: Listening on routing socket on fd #22 for interface updates 2024-09-10T16:27:26.142 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:26 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:26.142 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:26 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:26 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:26 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:26 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:26 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:26 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:26 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:26 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T16:27:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:26 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T16:27:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:26 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:26 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:26 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T16:27:26.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:26 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T16:27:26.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:26 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:26.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:26 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:26.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:26 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:26.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:26 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:26.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:26 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T16:27:26.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:26 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T16:27:28.142 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:28 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:28 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:28 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:28 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:28 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:28 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:28 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T16:27:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:28 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T16:27:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:28 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:28 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:28 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T16:27:28.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:28 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T16:27:28.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:28 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:28.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:28 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:28.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:28 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:28.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:28 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:28.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:28 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:28.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:28 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:28.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:28 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T16:27:28.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:28 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T16:27:30.146 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:30.146 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:30.146 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:30.146 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:30.147 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:30.147 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:30.147 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:30.147 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:30.147 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T16:27:30.147 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T16:27:30.147 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:30.147 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:30.147 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T16:27:30.147 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T16:27:30.147 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:30.147 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:30.147 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T16:27:30.147 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:30 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T16:27:30.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:30.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:30.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:30.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:30.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:30.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:30.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:30.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:30.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T16:27:30.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T16:27:30.171 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:30.171 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:30.171 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T16:27:30.171 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T16:27:30.171 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:30.171 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:30.171 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T16:27:30.171 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:30 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T16:27:32.142 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:32 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:32.142 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:32 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:32.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:32 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:32.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:32 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:32.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:32 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:32.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:32 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:32.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:32 ntpd[18452]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:32.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:32 ntpd[18452]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:32.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:32 ntpd[18452]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T16:27:32.143 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:32 ntpd[18452]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T16:27:32.143 INFO:teuthology.orchestra.run.smithi081.stdout:10 Sep 16:27:32 ntpd[18452]: ntpd: time slew -0.000083 s 2024-09-10T16:27:32.144 INFO:teuthology.orchestra.run.smithi081.stdout:ntpd: time slew -0.000083s 2024-09-10T16:27:32.144 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:32 ntpd[18452]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T16:27:32.144 INFO:teuthology.orchestra.run.smithi081.stderr:10 Sep 16:27:32 ntpd[18452]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T16:27:32.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:32.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:32 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:32.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:32.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:32 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:32.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:32.169 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:32 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:32.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-10T16:27:32.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:32 ntpd[18485]: can't open /var/log/ntpstats/rawstats.20240910: Permission denied 2024-09-10T16:27:32.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-10T16:27:32.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:32 ntpd[18485]: can't open /var/log/ntpstats/peerstats.20240910: Permission denied 2024-09-10T16:27:32.170 INFO:teuthology.orchestra.run.smithi189.stdout:10 Sep 16:27:32 ntpd[18485]: ntpd: time slew -0.000355 s 2024-09-10T16:27:32.170 INFO:teuthology.orchestra.run.smithi189.stdout:ntpd: time slew -0.000355s 2024-09-10T16:27:32.170 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:32 ntpd[18485]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-10T16:27:32.171 INFO:teuthology.orchestra.run.smithi189.stderr:10 Sep 16:27:32 ntpd[18485]: can't open /var/log/ntpstats/loopstats.20240910: Permission denied 2024-09-10T16:27:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T16:27:32.197 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2024-09-10T16:27:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T16:27:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T16:27:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T16:27:32.197 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T16:27:32.217 INFO:teuthology.orchestra.run.smithi189.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T16:27:32.217 INFO:teuthology.orchestra.run.smithi189.stdout:============================================================================== 2024-09-10T16:27:32.217 INFO:teuthology.orchestra.run.smithi189.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T16:27:32.217 INFO:teuthology.orchestra.run.smithi189.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T16:27:32.217 INFO:teuthology.orchestra.run.smithi189.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T16:27:32.217 INFO:teuthology.orchestra.run.smithi189.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T16:27:32.218 INFO:teuthology.run_tasks:Running task install... 2024-09-10T16:27:32.227 DEBUG:teuthology.task.install:project ceph 2024-09-10T16:27:32.227 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'}} 2024-09-10T16:27:32.227 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'} 2024-09-10T16:27:32.227 INFO:teuthology.task.install:Using flavor: default 2024-09-10T16:27:32.233 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-10T16:27:32.233 INFO:teuthology.task.install:extra packages: [] 2024-09-10T16:27:32.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-key list | grep Ceph 2024-09-10T16:27:32.234 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-key list | grep Ceph 2024-09-10T16:27:32.299 INFO:teuthology.orchestra.run.smithi081.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T16:27:32.319 INFO:teuthology.orchestra.run.smithi189.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-10T16:27:32.330 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T16:27:32.330 INFO:teuthology.orchestra.run.smithi081.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T16:27:32.330 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-10T16:27:32.331 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T16:27:32.345 INFO:teuthology.orchestra.run.smithi189.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-10T16:27:32.345 INFO:teuthology.orchestra.run.smithi189.stdout:uid [ unknown] Ceph.com (release key) 2024-09-10T16:27:32.345 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-10T16:27:32.345 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T16:27:32.482 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default/ 2024-09-10T16:27:32.482 INFO:teuthology.task.install.deb:Package version is 19.3.0-4858-gbad1f558-1jammy 2024-09-10T16:27:32.485 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default/ 2024-09-10T16:27:32.485 INFO:teuthology.task.install.deb:Package version is 19.3.0-4858-gbad1f558-1jammy 2024-09-10T16:27:32.591 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:27:32.591 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T16:27:32.599 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:27:32.599 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-10T16:27:32.605 DEBUG:teuthology.orchestra.run.smithi189:> sudo apt-get update 2024-09-10T16:27:32.613 DEBUG:teuthology.orchestra.run.smithi081:> sudo apt-get update 2024-09-10T16:27:32.783 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T16:27:32.824 INFO:teuthology.orchestra.run.smithi189.stdout:Ign:1 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T16:27:32.836 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:2 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy InRelease 2024-09-10T16:27:32.845 INFO:teuthology.orchestra.run.smithi189.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-10T16:27:32.860 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-10T16:27:32.868 INFO:teuthology.orchestra.run.smithi189.stdout:Ign:3 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T16:27:32.881 INFO:teuthology.orchestra.run.smithi081.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-10T16:27:32.890 INFO:teuthology.orchestra.run.smithi189.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-10T16:27:32.902 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-09-10T16:27:32.909 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:5 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T16:27:32.909 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:6 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-10T16:27:32.911 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-10T16:27:32.930 INFO:teuthology.orchestra.run.smithi189.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-09-10T16:27:32.932 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,407 B] 2024-09-10T16:27:32.973 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T16:27:32.989 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:8 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-10T16:27:33.055 INFO:teuthology.orchestra.run.smithi189.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T16:27:33.066 INFO:teuthology.orchestra.run.smithi081.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-10T16:27:33.214 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 29.3 kB in 0s (70.8 kB/s) 2024-09-10T16:27:33.263 INFO:teuthology.orchestra.run.smithi189.stdout:Fetched 29.3 kB in 0s (61.2 kB/s) 2024-09-10T16:27:34.219 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-10T16:27:34.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4858-gbad1f558-1jammy cephadm=19.3.0-4858-gbad1f558-1jammy ceph-mds=19.3.0-4858-gbad1f558-1jammy ceph-mgr=19.3.0-4858-gbad1f558-1jammy ceph-common=19.3.0-4858-gbad1f558-1jammy ceph-fuse=19.3.0-4858-gbad1f558-1jammy ceph-test=19.3.0-4858-gbad1f558-1jammy ceph-volume=19.3.0-4858-gbad1f558-1jammy radosgw=19.3.0-4858-gbad1f558-1jammy python3-rados=19.3.0-4858-gbad1f558-1jammy python3-rgw=19.3.0-4858-gbad1f558-1jammy python3-cephfs=19.3.0-4858-gbad1f558-1jammy python3-rbd=19.3.0-4858-gbad1f558-1jammy libcephfs2=19.3.0-4858-gbad1f558-1jammy libcephfs-dev=19.3.0-4858-gbad1f558-1jammy librados2=19.3.0-4858-gbad1f558-1jammy librbd1=19.3.0-4858-gbad1f558-1jammy rbd-fuse=19.3.0-4858-gbad1f558-1jammy 2024-09-10T16:27:34.275 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-09-10T16:27:34.291 DEBUG:teuthology.orchestra.run.smithi189:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4858-gbad1f558-1jammy cephadm=19.3.0-4858-gbad1f558-1jammy ceph-mds=19.3.0-4858-gbad1f558-1jammy ceph-mgr=19.3.0-4858-gbad1f558-1jammy ceph-common=19.3.0-4858-gbad1f558-1jammy ceph-fuse=19.3.0-4858-gbad1f558-1jammy ceph-test=19.3.0-4858-gbad1f558-1jammy ceph-volume=19.3.0-4858-gbad1f558-1jammy radosgw=19.3.0-4858-gbad1f558-1jammy python3-rados=19.3.0-4858-gbad1f558-1jammy python3-rgw=19.3.0-4858-gbad1f558-1jammy python3-cephfs=19.3.0-4858-gbad1f558-1jammy python3-rbd=19.3.0-4858-gbad1f558-1jammy libcephfs2=19.3.0-4858-gbad1f558-1jammy libcephfs-dev=19.3.0-4858-gbad1f558-1jammy librados2=19.3.0-4858-gbad1f558-1jammy librbd1=19.3.0-4858-gbad1f558-1jammy rbd-fuse=19.3.0-4858-gbad1f558-1jammy 2024-09-10T16:27:34.297 INFO:teuthology.orchestra.run.smithi081.stdout:Reading package lists... 2024-09-10T16:27:34.348 INFO:teuthology.orchestra.run.smithi189.stdout:Reading package lists... 2024-09-10T16:27:34.503 INFO:teuthology.orchestra.run.smithi081.stdout:Building dependency tree... 2024-09-10T16:27:34.503 INFO:teuthology.orchestra.run.smithi081.stdout:Reading state information... 2024-09-10T16:27:34.533 INFO:teuthology.orchestra.run.smithi189.stdout:Building dependency tree... 2024-09-10T16:27:34.534 INFO:teuthology.orchestra.run.smithi189.stdout:Reading state information... 2024-09-10T16:27:34.696 INFO:teuthology.orchestra.run.smithi081.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T16:27:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T16:27:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T16:27:34.696 INFO:teuthology.orchestra.run.smithi081.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T16:27:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T16:27:34.697 INFO:teuthology.orchestra.run.smithi081.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T16:27:34.697 INFO:teuthology.orchestra.run.smithi081.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T16:27:34.698 INFO:teuthology.orchestra.run.smithi081.stdout:The following additional packages will be installed: 2024-09-10T16:27:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T16:27:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T16:27:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-10T16:27:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-10T16:27:34.698 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-10T16:27:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-10T16:27:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-10T16:27:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-10T16:27:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-10T16:27:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-10T16:27:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-10T16:27:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-10T16:27:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-10T16:27:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-10T16:27:34.699 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-10T16:27:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-10T16:27:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-10T16:27:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-10T16:27:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T16:27:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T16:27:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T16:27:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T16:27:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-10T16:27:34.700 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet zip 2024-09-10T16:27:34.701 INFO:teuthology.orchestra.run.smithi081.stdout:Suggested packages: 2024-09-10T16:27:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T16:27:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T16:27:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T16:27:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T16:27:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T16:27:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T16:27:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T16:27:34.701 INFO:teuthology.orchestra.run.smithi081.stdout:Recommended packages: 2024-09-10T16:27:34.701 INFO:teuthology.orchestra.run.smithi081.stdout: btrfs-tools 2024-09-10T16:27:34.717 INFO:teuthology.orchestra.run.smithi189.stdout:The following packages were automatically installed and are no longer required: 2024-09-10T16:27:34.718 INFO:teuthology.orchestra.run.smithi189.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-10T16:27:34.718 INFO:teuthology.orchestra.run.smithi189.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-10T16:27:34.718 INFO:teuthology.orchestra.run.smithi189.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-10T16:27:34.718 INFO:teuthology.orchestra.run.smithi189.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-10T16:27:34.718 INFO:teuthology.orchestra.run.smithi189.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-10T16:27:34.718 INFO:teuthology.orchestra.run.smithi189.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-10T16:27:34.719 INFO:teuthology.orchestra.run.smithi189.stdout:The following additional packages will be installed: 2024-09-10T16:27:34.719 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-10T16:27:34.720 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-10T16:27:34.720 INFO:teuthology.orchestra.run.smithi189.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev libnbd0 liboath0 2024-09-10T16:27:34.720 INFO:teuthology.orchestra.run.smithi189.stdout: libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 2024-09-10T16:27:34.720 INFO:teuthology.orchestra.run.smithi189.stdout: libradosstriper1 librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph 2024-09-10T16:27:34.721 INFO:teuthology.orchestra.run.smithi189.stdout: libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli 2024-09-10T16:27:34.721 INFO:teuthology.orchestra.run.smithi189.stdout: pkg-config python-asyncssh-doc python-babel-localedata 2024-09-10T16:27:34.721 INFO:teuthology.orchestra.run.smithi189.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-09-10T16:27:34.721 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-certifi 2024-09-10T16:27:34.721 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cheroot python3-cherrypy3 python3-google-auth python3-idna 2024-09-10T16:27:34.721 INFO:teuthology.orchestra.run.smithi189.stdout: python3-iniconfig python3-jaraco.classes python3-jaraco.collections 2024-09-10T16:27:34.721 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco.functools python3-jaraco.text python3-jinja2 python3-joblib 2024-09-10T16:27:34.721 INFO:teuthology.orchestra.run.smithi189.stdout: python3-kubernetes python3-logutils python3-mako python3-markupsafe 2024-09-10T16:27:34.721 INFO:teuthology.orchestra.run.smithi189.stdout: python3-natsort python3-openssl python3-paste python3-pastedeploy 2024-09-10T16:27:34.721 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pastescript python3-pecan python3-pluggy python3-portend 2024-09-10T16:27:34.721 INFO:teuthology.orchestra.run.smithi189.stdout: python3-prettytable python3-psutil python3-py python3-pyasn1 2024-09-10T16:27:34.721 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pyasn1-modules python3-pygments python3-pyinotify python3-pytest 2024-09-10T16:27:34.722 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-routes 2024-09-10T16:27:34.722 INFO:teuthology.orchestra.run.smithi189.stdout: python3-rsa python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-10T16:27:34.722 INFO:teuthology.orchestra.run.smithi189.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-10T16:27:34.722 INFO:teuthology.orchestra.run.smithi189.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-10T16:27:34.722 INFO:teuthology.orchestra.run.smithi189.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-10T16:27:34.722 INFO:teuthology.orchestra.run.smithi189.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-10T16:27:34.722 INFO:teuthology.orchestra.run.smithi189.stdout: xmlstarlet zip 2024-09-10T16:27:34.722 INFO:teuthology.orchestra.run.smithi189.stdout:Suggested packages: 2024-09-10T16:27:34.722 INFO:teuthology.orchestra.run.smithi189.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-10T16:27:34.722 INFO:teuthology.orchestra.run.smithi189.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-10T16:27:34.723 INFO:teuthology.orchestra.run.smithi189.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-10T16:27:34.723 INFO:teuthology.orchestra.run.smithi189.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-10T16:27:34.723 INFO:teuthology.orchestra.run.smithi189.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-10T16:27:34.723 INFO:teuthology.orchestra.run.smithi189.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-10T16:27:34.723 INFO:teuthology.orchestra.run.smithi189.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-10T16:27:34.723 INFO:teuthology.orchestra.run.smithi189.stdout:Recommended packages: 2024-09-10T16:27:34.723 INFO:teuthology.orchestra.run.smithi189.stdout: btrfs-tools 2024-09-10T16:27:34.805 INFO:teuthology.orchestra.run.smithi081.stdout:The following NEW packages will be installed: 2024-09-10T16:27:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T16:27:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T16:27:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-10T16:27:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-10T16:27:34.805 INFO:teuthology.orchestra.run.smithi081.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-10T16:27:34.806 INFO:teuthology.orchestra.run.smithi081.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-10T16:27:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-10T16:27:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-10T16:27:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-10T16:27:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-10T16:27:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-10T16:27:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T16:27:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T16:27:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T16:27:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T16:27:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T16:27:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T16:27:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T16:27:34.807 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-10T16:27:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-10T16:27:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-10T16:27:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-10T16:27:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-10T16:27:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-10T16:27:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-10T16:27:34.808 INFO:teuthology.orchestra.run.smithi081.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-10T16:27:34.826 INFO:teuthology.orchestra.run.smithi189.stdout:The following NEW packages will be installed: 2024-09-10T16:27:34.826 INFO:teuthology.orchestra.run.smithi189.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-10T16:27:34.826 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-10T16:27:34.826 INFO:teuthology.orchestra.run.smithi189.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-10T16:27:34.826 INFO:teuthology.orchestra.run.smithi189.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-10T16:27:34.827 INFO:teuthology.orchestra.run.smithi189.stdout: liblua5.3-dev libnbd0 liboath0 libonig5 libpcre2-16-0 libqt5core5a 2024-09-10T16:27:34.827 INFO:teuthology.orchestra.run.smithi189.stdout: libqt5dbus5 libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-10T16:27:34.828 INFO:teuthology.orchestra.run.smithi189.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-10T16:27:34.828 INFO:teuthology.orchestra.run.smithi189.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-10T16:27:34.828 INFO:teuthology.orchestra.run.smithi189.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-10T16:27:34.828 INFO:teuthology.orchestra.run.smithi189.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-10T16:27:34.829 INFO:teuthology.orchestra.run.smithi189.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-10T16:27:34.829 INFO:teuthology.orchestra.run.smithi189.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-10T16:27:34.829 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-10T16:27:34.829 INFO:teuthology.orchestra.run.smithi189.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-10T16:27:34.829 INFO:teuthology.orchestra.run.smithi189.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-10T16:27:34.829 INFO:teuthology.orchestra.run.smithi189.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-10T16:27:34.829 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-10T16:27:34.829 INFO:teuthology.orchestra.run.smithi189.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-10T16:27:34.829 INFO:teuthology.orchestra.run.smithi189.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-10T16:27:34.829 INFO:teuthology.orchestra.run.smithi189.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-10T16:27:34.829 INFO:teuthology.orchestra.run.smithi189.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-10T16:27:34.830 INFO:teuthology.orchestra.run.smithi189.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-10T16:27:34.830 INFO:teuthology.orchestra.run.smithi189.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-10T16:27:34.830 INFO:teuthology.orchestra.run.smithi189.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-10T16:27:34.830 INFO:teuthology.orchestra.run.smithi189.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-10T16:27:34.830 INFO:teuthology.orchestra.run.smithi189.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-10T16:27:34.867 INFO:teuthology.orchestra.run.smithi081.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T16:27:34.867 INFO:teuthology.orchestra.run.smithi081.stdout:Need to get 251 MB of archives. 2024-09-10T16:27:34.867 INFO:teuthology.orchestra.run.smithi081.stdout:After this operation, 932 MB of additional disk space will be used. 2024-09-10T16:27:34.867 INFO:teuthology.orchestra.run.smithi081.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T16:27:34.955 INFO:teuthology.orchestra.run.smithi081.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T16:27:34.957 INFO:teuthology.orchestra.run.smithi081.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4858-gbad1f558-1jammy [3,634 kB] 2024-09-10T16:27:34.958 INFO:teuthology.orchestra.run.smithi081.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T16:27:34.970 INFO:teuthology.orchestra.run.smithi189.stdout:0 upgraded, 119 newly installed, 0 to remove and 331 not upgraded. 2024-09-10T16:27:34.970 INFO:teuthology.orchestra.run.smithi189.stdout:Need to get 251 MB of archives. 2024-09-10T16:27:34.971 INFO:teuthology.orchestra.run.smithi189.stdout:After this operation, 932 MB of additional disk space will be used. 2024-09-10T16:27:34.971 INFO:teuthology.orchestra.run.smithi189.stdout:Get:1 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4858-gbad1f558-1jammy [3,634 kB] 2024-09-10T16:27:34.975 INFO:teuthology.orchestra.run.smithi081.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T16:27:35.016 INFO:teuthology.orchestra.run.smithi189.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-10T16:27:35.043 INFO:teuthology.orchestra.run.smithi081.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T16:27:35.048 INFO:teuthology.orchestra.run.smithi081.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T16:27:35.061 INFO:teuthology.orchestra.run.smithi081.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T16:27:35.065 INFO:teuthology.orchestra.run.smithi081.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-10T16:27:35.066 INFO:teuthology.orchestra.run.smithi081.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T16:27:35.066 INFO:teuthology.orchestra.run.smithi081.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T16:27:35.067 INFO:teuthology.orchestra.run.smithi081.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T16:27:35.076 INFO:teuthology.orchestra.run.smithi081.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T16:27:35.078 INFO:teuthology.orchestra.run.smithi081.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T16:27:35.080 INFO:teuthology.orchestra.run.smithi081.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T16:27:35.081 INFO:teuthology.orchestra.run.smithi081.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T16:27:35.098 INFO:teuthology.orchestra.run.smithi081.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T16:27:35.100 INFO:teuthology.orchestra.run.smithi081.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T16:27:35.102 INFO:teuthology.orchestra.run.smithi081.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T16:27:35.104 INFO:teuthology.orchestra.run.smithi081.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T16:27:35.105 INFO:teuthology.orchestra.run.smithi081.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T16:27:35.105 INFO:teuthology.orchestra.run.smithi081.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T16:27:35.115 INFO:teuthology.orchestra.run.smithi081.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T16:27:35.116 INFO:teuthology.orchestra.run.smithi081.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T16:27:35.116 INFO:teuthology.orchestra.run.smithi081.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T16:27:35.116 INFO:teuthology.orchestra.run.smithi081.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T16:27:35.132 INFO:teuthology.orchestra.run.smithi081.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T16:27:35.132 INFO:teuthology.orchestra.run.smithi081.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T16:27:35.133 INFO:teuthology.orchestra.run.smithi081.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T16:27:35.135 INFO:teuthology.orchestra.run.smithi081.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T16:27:35.136 INFO:teuthology.orchestra.run.smithi081.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T16:27:35.136 INFO:teuthology.orchestra.run.smithi081.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T16:27:35.149 INFO:teuthology.orchestra.run.smithi081.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T16:27:35.150 INFO:teuthology.orchestra.run.smithi081.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T16:27:35.150 INFO:teuthology.orchestra.run.smithi081.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T16:27:35.151 INFO:teuthology.orchestra.run.smithi081.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T16:27:35.166 INFO:teuthology.orchestra.run.smithi081.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T16:27:35.167 INFO:teuthology.orchestra.run.smithi081.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T16:27:35.167 INFO:teuthology.orchestra.run.smithi081.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T16:27:35.173 INFO:teuthology.orchestra.run.smithi081.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T16:27:35.173 INFO:teuthology.orchestra.run.smithi081.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T16:27:35.173 INFO:teuthology.orchestra.run.smithi081.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T16:27:35.183 INFO:teuthology.orchestra.run.smithi081.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T16:27:35.185 INFO:teuthology.orchestra.run.smithi081.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T16:27:35.187 INFO:teuthology.orchestra.run.smithi081.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T16:27:35.187 INFO:teuthology.orchestra.run.smithi081.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T16:27:35.200 INFO:teuthology.orchestra.run.smithi081.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T16:27:35.201 INFO:teuthology.orchestra.run.smithi081.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T16:27:35.204 INFO:teuthology.orchestra.run.smithi081.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T16:27:35.204 INFO:teuthology.orchestra.run.smithi081.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T16:27:35.205 INFO:teuthology.orchestra.run.smithi081.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T16:27:35.207 INFO:teuthology.orchestra.run.smithi081.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T16:27:35.254 INFO:teuthology.orchestra.run.smithi081.stdout:Get:53 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4858-gbad1f558-1jammy [3,330 kB] 2024-09-10T16:27:35.259 INFO:teuthology.orchestra.run.smithi081.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T16:27:35.260 INFO:teuthology.orchestra.run.smithi081.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T16:27:35.265 INFO:teuthology.orchestra.run.smithi081.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T16:27:35.265 INFO:teuthology.orchestra.run.smithi081.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T16:27:35.265 INFO:teuthology.orchestra.run.smithi081.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T16:27:35.266 INFO:teuthology.orchestra.run.smithi189.stdout:Get:3 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4858-gbad1f558-1jammy [3,330 kB] 2024-09-10T16:27:35.279 INFO:teuthology.orchestra.run.smithi081.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T16:27:35.281 INFO:teuthology.orchestra.run.smithi081.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T16:27:35.281 INFO:teuthology.orchestra.run.smithi081.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T16:27:35.296 INFO:teuthology.orchestra.run.smithi081.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T16:27:35.296 INFO:teuthology.orchestra.run.smithi081.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T16:27:35.296 INFO:teuthology.orchestra.run.smithi081.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T16:27:35.297 INFO:teuthology.orchestra.run.smithi081.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T16:27:35.297 INFO:teuthology.orchestra.run.smithi081.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T16:27:35.297 INFO:teuthology.orchestra.run.smithi081.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T16:27:35.312 INFO:teuthology.orchestra.run.smithi081.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T16:27:35.313 INFO:teuthology.orchestra.run.smithi081.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T16:27:35.316 INFO:teuthology.orchestra.run.smithi081.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T16:27:35.329 INFO:teuthology.orchestra.run.smithi081.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T16:27:35.331 INFO:teuthology.orchestra.run.smithi081.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T16:27:35.331 INFO:teuthology.orchestra.run.smithi081.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T16:27:35.334 INFO:teuthology.orchestra.run.smithi081.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T16:27:35.336 INFO:teuthology.orchestra.run.smithi081.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T16:27:35.337 INFO:teuthology.orchestra.run.smithi081.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T16:27:35.338 INFO:teuthology.orchestra.run.smithi081.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T16:27:35.346 INFO:teuthology.orchestra.run.smithi081.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T16:27:35.347 INFO:teuthology.orchestra.run.smithi081.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T16:27:35.350 INFO:teuthology.orchestra.run.smithi081.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T16:27:35.363 INFO:teuthology.orchestra.run.smithi081.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T16:27:35.364 INFO:teuthology.orchestra.run.smithi081.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T16:27:35.364 INFO:teuthology.orchestra.run.smithi081.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T16:27:35.366 INFO:teuthology.orchestra.run.smithi081.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T16:27:35.366 INFO:teuthology.orchestra.run.smithi081.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T16:27:35.372 INFO:teuthology.orchestra.run.smithi081.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T16:27:35.372 INFO:teuthology.orchestra.run.smithi081.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T16:27:35.380 INFO:teuthology.orchestra.run.smithi081.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T16:27:35.382 INFO:teuthology.orchestra.run.smithi081.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T16:27:35.383 INFO:teuthology.orchestra.run.smithi081.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T16:27:35.385 INFO:teuthology.orchestra.run.smithi081.stdout:Get:91 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4858-gbad1f558-1jammy [722 kB] 2024-09-10T16:27:35.398 INFO:teuthology.orchestra.run.smithi189.stdout:Get:4 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4858-gbad1f558-1jammy [722 kB] 2024-09-10T16:27:35.407 INFO:teuthology.orchestra.run.smithi081.stdout:Get:92 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4858-gbad1f558-1jammy [357 kB] 2024-09-10T16:27:35.420 INFO:teuthology.orchestra.run.smithi189.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4858-gbad1f558-1jammy [357 kB] 2024-09-10T16:27:35.423 INFO:teuthology.orchestra.run.smithi081.stdout:Get:93 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4858-gbad1f558-1jammy [32.8 kB] 2024-09-10T16:27:35.424 INFO:teuthology.orchestra.run.smithi081.stdout:Get:94 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4858-gbad1f558-1jammy [180 kB] 2024-09-10T16:27:35.428 INFO:teuthology.orchestra.run.smithi081.stdout:Get:95 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4858-gbad1f558-1jammy [71.2 kB] 2024-09-10T16:27:35.430 INFO:teuthology.orchestra.run.smithi081.stdout:Get:96 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4858-gbad1f558-1jammy [338 kB] 2024-09-10T16:27:35.435 INFO:teuthology.orchestra.run.smithi189.stdout:Get:6 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4858-gbad1f558-1jammy [32.8 kB] 2024-09-10T16:27:35.436 INFO:teuthology.orchestra.run.smithi189.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4858-gbad1f558-1jammy [180 kB] 2024-09-10T16:27:35.439 INFO:teuthology.orchestra.run.smithi189.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-10T16:27:35.440 INFO:teuthology.orchestra.run.smithi189.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4858-gbad1f558-1jammy [71.2 kB] 2024-09-10T16:27:35.442 INFO:teuthology.orchestra.run.smithi189.stdout:Get:10 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4858-gbad1f558-1jammy [338 kB] 2024-09-10T16:27:35.443 INFO:teuthology.orchestra.run.smithi081.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4858-gbad1f558-1jammy [7,987 kB] 2024-09-10T16:27:35.451 INFO:teuthology.orchestra.run.smithi189.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-10T16:27:35.455 INFO:teuthology.orchestra.run.smithi189.stdout:Get:12 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4858-gbad1f558-1jammy [7,987 kB] 2024-09-10T16:27:35.533 INFO:teuthology.orchestra.run.smithi189.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-10T16:27:35.714 INFO:teuthology.orchestra.run.smithi189.stdout:Get:14 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4858-gbad1f558-1jammy [112 kB] 2024-09-10T16:27:35.716 INFO:teuthology.orchestra.run.smithi189.stdout:Get:15 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4858-gbad1f558-1jammy [473 kB] 2024-09-10T16:27:35.730 INFO:teuthology.orchestra.run.smithi189.stdout:Get:16 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4858-gbad1f558-1jammy [28.3 MB] 2024-09-10T16:27:35.730 INFO:teuthology.orchestra.run.smithi081.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4858-gbad1f558-1jammy [112 kB] 2024-09-10T16:27:35.733 INFO:teuthology.orchestra.run.smithi081.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4858-gbad1f558-1jammy [473 kB] 2024-09-10T16:27:35.742 INFO:teuthology.orchestra.run.smithi081.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4858-gbad1f558-1jammy [28.3 MB] 2024-09-10T16:27:35.763 INFO:teuthology.orchestra.run.smithi189.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-10T16:27:35.774 INFO:teuthology.orchestra.run.smithi189.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-10T16:27:35.803 INFO:teuthology.orchestra.run.smithi189.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-10T16:27:35.812 INFO:teuthology.orchestra.run.smithi189.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libnbd0 amd64 1.10.5-1 [71.3 kB] 2024-09-10T16:27:35.814 INFO:teuthology.orchestra.run.smithi189.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-10T16:27:35.815 INFO:teuthology.orchestra.run.smithi189.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-10T16:27:35.816 INFO:teuthology.orchestra.run.smithi189.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-10T16:27:35.834 INFO:teuthology.orchestra.run.smithi189.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-10T16:27:35.839 INFO:teuthology.orchestra.run.smithi189.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-10T16:27:35.846 INFO:teuthology.orchestra.run.smithi189.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-10T16:27:35.925 INFO:teuthology.orchestra.run.smithi189.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-10T16:27:35.926 INFO:teuthology.orchestra.run.smithi189.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-10T16:27:35.930 INFO:teuthology.orchestra.run.smithi189.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-10T16:27:35.934 INFO:teuthology.orchestra.run.smithi189.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-10T16:27:35.938 INFO:teuthology.orchestra.run.smithi189.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-10T16:27:35.939 INFO:teuthology.orchestra.run.smithi189.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-10T16:27:35.940 INFO:teuthology.orchestra.run.smithi189.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-10T16:27:35.942 INFO:teuthology.orchestra.run.smithi189.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-10T16:27:35.943 INFO:teuthology.orchestra.run.smithi189.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-10T16:27:36.009 INFO:teuthology.orchestra.run.smithi189.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-10T16:27:36.026 INFO:teuthology.orchestra.run.smithi189.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-10T16:27:36.026 INFO:teuthology.orchestra.run.smithi189.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-10T16:27:36.027 INFO:teuthology.orchestra.run.smithi189.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-10T16:27:36.028 INFO:teuthology.orchestra.run.smithi189.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-10T16:27:36.033 INFO:teuthology.orchestra.run.smithi189.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-10T16:27:36.034 INFO:teuthology.orchestra.run.smithi189.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-10T16:27:36.091 INFO:teuthology.orchestra.run.smithi189.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-10T16:27:36.092 INFO:teuthology.orchestra.run.smithi189.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-10T16:27:36.094 INFO:teuthology.orchestra.run.smithi189.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-10T16:27:36.173 INFO:teuthology.orchestra.run.smithi189.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-10T16:27:36.173 INFO:teuthology.orchestra.run.smithi189.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-10T16:27:36.176 INFO:teuthology.orchestra.run.smithi189.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-10T16:27:36.177 INFO:teuthology.orchestra.run.smithi189.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-10T16:27:36.178 INFO:teuthology.orchestra.run.smithi189.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-10T16:27:36.189 INFO:teuthology.orchestra.run.smithi189.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-10T16:27:36.255 INFO:teuthology.orchestra.run.smithi189.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-10T16:27:36.255 INFO:teuthology.orchestra.run.smithi189.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-10T16:27:36.256 INFO:teuthology.orchestra.run.smithi189.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-10T16:27:36.259 INFO:teuthology.orchestra.run.smithi189.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-10T16:27:36.336 INFO:teuthology.orchestra.run.smithi189.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-10T16:27:36.338 INFO:teuthology.orchestra.run.smithi189.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-10T16:27:36.340 INFO:teuthology.orchestra.run.smithi189.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-10T16:27:36.342 INFO:teuthology.orchestra.run.smithi189.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-10T16:27:36.347 INFO:teuthology.orchestra.run.smithi189.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-10T16:27:36.348 INFO:teuthology.orchestra.run.smithi189.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-10T16:27:36.418 INFO:teuthology.orchestra.run.smithi189.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-10T16:27:36.422 INFO:teuthology.orchestra.run.smithi189.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-10T16:27:36.585 INFO:teuthology.orchestra.run.smithi189.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-10T16:27:36.586 INFO:teuthology.orchestra.run.smithi189.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-10T16:27:36.589 INFO:teuthology.orchestra.run.smithi189.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-10T16:27:36.590 INFO:teuthology.orchestra.run.smithi189.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-10T16:27:36.592 INFO:teuthology.orchestra.run.smithi189.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-10T16:27:36.628 INFO:teuthology.orchestra.run.smithi189.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-10T16:27:36.631 INFO:teuthology.orchestra.run.smithi189.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-10T16:27:36.631 INFO:teuthology.orchestra.run.smithi189.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-10T16:27:36.694 INFO:teuthology.orchestra.run.smithi189.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-10T16:27:36.694 INFO:teuthology.orchestra.run.smithi189.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-10T16:27:36.751 INFO:teuthology.orchestra.run.smithi189.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-10T16:27:36.755 INFO:teuthology.orchestra.run.smithi081.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4858-gbad1f558-1jammy [5,206 kB] 2024-09-10T16:27:36.765 INFO:teuthology.orchestra.run.smithi189.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-10T16:27:36.766 INFO:teuthology.orchestra.run.smithi189.stdout:Get:76 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4858-gbad1f558-1jammy [5,206 kB] 2024-09-10T16:27:36.766 INFO:teuthology.orchestra.run.smithi189.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-10T16:27:36.767 INFO:teuthology.orchestra.run.smithi189.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-10T16:27:36.768 INFO:teuthology.orchestra.run.smithi189.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-10T16:27:36.769 INFO:teuthology.orchestra.run.smithi189.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-10T16:27:36.778 INFO:teuthology.orchestra.run.smithi189.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-10T16:27:36.833 INFO:teuthology.orchestra.run.smithi189.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-10T16:27:36.833 INFO:teuthology.orchestra.run.smithi081.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4858-gbad1f558-1jammy [251 kB] 2024-09-10T16:27:36.836 INFO:teuthology.orchestra.run.smithi189.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-10T16:27:36.838 INFO:teuthology.orchestra.run.smithi189.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-10T16:27:36.839 INFO:teuthology.orchestra.run.smithi081.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4858-gbad1f558-1jammy [124 kB] 2024-09-10T16:27:36.841 INFO:teuthology.orchestra.run.smithi081.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4858-gbad1f558-1jammy [1,560 kB] 2024-09-10T16:27:36.846 INFO:teuthology.orchestra.run.smithi189.stdout:Get:85 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4858-gbad1f558-1jammy [251 kB] 2024-09-10T16:27:36.848 INFO:teuthology.orchestra.run.smithi189.stdout:Get:86 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4858-gbad1f558-1jammy [124 kB] 2024-09-10T16:27:36.850 INFO:teuthology.orchestra.run.smithi189.stdout:Get:87 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4858-gbad1f558-1jammy [1,560 kB] 2024-09-10T16:27:36.889 INFO:teuthology.orchestra.run.smithi081.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4858-gbad1f558-1jammy [6,309 kB] 2024-09-10T16:27:36.898 INFO:teuthology.orchestra.run.smithi189.stdout:Get:88 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4858-gbad1f558-1jammy [6,309 kB] 2024-09-10T16:27:36.915 INFO:teuthology.orchestra.run.smithi189.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-10T16:27:36.921 INFO:teuthology.orchestra.run.smithi189.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-10T16:27:36.923 INFO:teuthology.orchestra.run.smithi189.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-10T16:27:36.925 INFO:teuthology.orchestra.run.smithi189.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-10T16:27:36.936 INFO:teuthology.orchestra.run.smithi189.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-10T16:27:36.937 INFO:teuthology.orchestra.run.smithi189.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-10T16:27:36.945 INFO:teuthology.orchestra.run.smithi189.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-10T16:27:36.996 INFO:teuthology.orchestra.run.smithi189.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-10T16:27:36.998 INFO:teuthology.orchestra.run.smithi189.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-10T16:27:36.998 INFO:teuthology.orchestra.run.smithi189.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-10T16:27:37.078 INFO:teuthology.orchestra.run.smithi189.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-10T16:27:37.080 INFO:teuthology.orchestra.run.smithi189.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-10T16:27:37.097 INFO:teuthology.orchestra.run.smithi189.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-10T16:27:37.097 INFO:teuthology.orchestra.run.smithi189.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-10T16:27:37.098 INFO:teuthology.orchestra.run.smithi189.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-10T16:27:37.099 INFO:teuthology.orchestra.run.smithi189.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4858-gbad1f558-1jammy [23.1 MB] 2024-09-10T16:27:37.105 INFO:teuthology.orchestra.run.smithi189.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-10T16:27:37.105 INFO:teuthology.orchestra.run.smithi189.stdout:Get:106 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-10T16:27:37.107 INFO:teuthology.orchestra.run.smithi081.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4858-gbad1f558-1jammy [23.1 MB] 2024-09-10T16:27:37.935 INFO:teuthology.orchestra.run.smithi189.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4858-gbad1f558-1jammy [14.0 kB] 2024-09-10T16:27:37.936 INFO:teuthology.orchestra.run.smithi189.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4858-gbad1f558-1jammy [880 kB] 2024-09-10T16:27:37.952 INFO:teuthology.orchestra.run.smithi189.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4858-gbad1f558-1jammy [2,453 kB] 2024-09-10T16:27:37.966 INFO:teuthology.orchestra.run.smithi081.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4858-gbad1f558-1jammy [14.0 kB] 2024-09-10T16:27:37.967 INFO:teuthology.orchestra.run.smithi081.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4858-gbad1f558-1jammy [880 kB] 2024-09-10T16:27:37.984 INFO:teuthology.orchestra.run.smithi081.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4858-gbad1f558-1jammy [2,453 kB] 2024-09-10T16:27:37.993 INFO:teuthology.orchestra.run.smithi189.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4858-gbad1f558-1jammy [813 kB] 2024-09-10T16:27:38.003 INFO:teuthology.orchestra.run.smithi189.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4858-gbad1f558-1jammy [160 kB] 2024-09-10T16:27:38.005 INFO:teuthology.orchestra.run.smithi189.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4858-gbad1f558-1jammy [61.4 MB] 2024-09-10T16:27:38.025 INFO:teuthology.orchestra.run.smithi081.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4858-gbad1f558-1jammy [813 kB] 2024-09-10T16:27:38.035 INFO:teuthology.orchestra.run.smithi081.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4858-gbad1f558-1jammy [160 kB] 2024-09-10T16:27:38.037 INFO:teuthology.orchestra.run.smithi081.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4858-gbad1f558-1jammy [61.4 MB] 2024-09-10T16:27:40.312 INFO:teuthology.orchestra.run.smithi189.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4858-gbad1f558-1jammy [8,625 kB] 2024-09-10T16:27:40.364 INFO:teuthology.orchestra.run.smithi081.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4858-gbad1f558-1jammy [8,625 kB] 2024-09-10T16:27:40.448 INFO:teuthology.orchestra.run.smithi189.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4858-gbad1f558-1jammy [14.2 kB] 2024-09-10T16:27:40.449 INFO:teuthology.orchestra.run.smithi189.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4858-gbad1f558-1jammy [55.3 MB] 2024-09-10T16:27:40.546 INFO:teuthology.orchestra.run.smithi081.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4858-gbad1f558-1jammy [14.2 kB] 2024-09-10T16:27:40.547 INFO:teuthology.orchestra.run.smithi081.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4858-gbad1f558-1jammy [55.3 MB] 2024-09-10T16:27:42.513 INFO:teuthology.orchestra.run.smithi189.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4858-gbad1f558-1jammy [130 kB] 2024-09-10T16:27:42.516 INFO:teuthology.orchestra.run.smithi189.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4858-gbad1f558-1jammy [39.0 kB] 2024-09-10T16:27:42.517 INFO:teuthology.orchestra.run.smithi189.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4858-gbad1f558-1jammy [15.9 MB] 2024-09-10T16:27:42.616 INFO:teuthology.orchestra.run.smithi081.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4858-gbad1f558-1jammy [130 kB] 2024-09-10T16:27:42.619 INFO:teuthology.orchestra.run.smithi081.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4858-gbad1f558-1jammy [39.0 kB] 2024-09-10T16:27:42.620 INFO:teuthology.orchestra.run.smithi081.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4858-gbad1f558-1jammy [15.9 MB] 2024-09-10T16:27:42.890 INFO:teuthology.orchestra.run.smithi189.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4858-gbad1f558-1jammy [91.2 kB] 2024-09-10T16:27:43.016 INFO:teuthology.orchestra.run.smithi081.stdout:Get:119 https://4.chacra.ceph.com/r/ceph/wip-bharath7-testing-2024-09-10-1409/bad1f558c327094897e4a32e99dd5cb4ae6ccd46/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4858-gbad1f558-1jammy [91.2 kB] 2024-09-10T16:27:43.464 INFO:teuthology.orchestra.run.smithi189.stdout:Fetched 251 MB in 8s (31.1 MB/s) 2024-09-10T16:27:43.594 INFO:teuthology.orchestra.run.smithi081.stdout:Fetched 251 MB in 8s (30.6 MB/s) 2024-09-10T16:27:43.630 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T16:27:43.731 INFO:teuthology.orchestra.run.smithi189.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T16:27:43.736 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T16:27:43.743 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-10T16:27:43.828 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T16:27:43.843 INFO:teuthology.orchestra.run.smithi081.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-10T16:27:43.848 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-10T16:27:43.933 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T16:27:44.132 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T16:27:44.158 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T16:27:44.190 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T16:27:44.270 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-10T16:27:44.296 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-10T16:27:44.337 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T16:27:44.585 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T16:27:44.611 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T16:27:44.640 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-10T16:27:44.651 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T16:27:44.666 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-10T16:27:44.706 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T16:27:45.121 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T16:27:45.135 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-10T16:27:45.148 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T16:27:45.161 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T16:27:45.197 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T16:27:45.210 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T16:27:45.542 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T16:27:45.568 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T16:27:45.600 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T16:27:45.622 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-10T16:27:45.649 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T16:27:45.689 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T16:27:45.945 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T16:27:45.971 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T16:27:45.991 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-10T16:27:46.011 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T16:27:46.018 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-10T16:27:46.050 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T16:27:46.364 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T16:27:46.386 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-10T16:27:46.390 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T16:27:46.413 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-10T16:27:46.431 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T16:27:46.453 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T16:27:46.700 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package librados2. 2024-09-10T16:27:46.727 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../007-librados2_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:46.758 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking librados2 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:46.814 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librados2. 2024-09-10T16:27:46.841 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../007-librados2_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:46.881 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librados2 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:47.220 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libnbd0. 2024-09-10T16:27:47.247 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-10T16:27:47.286 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-10T16:27:47.334 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libnbd0. 2024-09-10T16:27:47.360 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../008-libnbd0_1.10.5-1_amd64.deb ... 2024-09-10T16:27:47.400 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libnbd0 (1.10.5-1) ... 2024-09-10T16:27:47.606 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package librbd1. 2024-09-10T16:27:47.633 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../009-librbd1_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:47.673 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking librbd1 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:47.953 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librbd1. 2024-09-10T16:27:47.979 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../009-librbd1_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:48.020 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librbd1 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:48.076 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T16:27:48.102 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:48.142 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libcephfs2 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:48.403 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-rados. 2024-09-10T16:27:48.430 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:48.469 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-rados (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:48.473 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs2. 2024-09-10T16:27:48.499 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../010-libcephfs2_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:48.540 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs2 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:48.789 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T16:27:48.809 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rados. 2024-09-10T16:27:48.816 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:27:48.824 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../011-python3-rados_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:48.856 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-ceph-argparse (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:48.867 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rados (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:49.108 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T16:27:49.124 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:49.162 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-10T16:27:49.166 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-cephfs (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:49.188 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../012-python3-ceph-argparse_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:27:49.228 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-argparse (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:49.447 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cephfs. 2024-09-10T16:27:49.452 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T16:27:49.463 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../013-python3-cephfs_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:49.479 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:27:49.505 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cephfs (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:49.510 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-ceph-common (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:49.789 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T16:27:49.804 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T16:27:49.817 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-10T16:27:49.843 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../014-python3-ceph-common_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:27:49.847 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T16:27:49.883 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-ceph-common (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:50.175 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T16:27:50.178 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-10T16:27:50.202 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T16:27:50.204 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../015-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-10T16:27:50.236 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T16:27:50.241 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T16:27:50.536 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T16:27:50.556 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-prettytable. 2024-09-10T16:27:50.563 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:50.582 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../016-python3-prettytable_2.5.0-2_all.deb ... 2024-09-10T16:27:50.602 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-rbd (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:50.623 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-10T16:27:50.867 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rbd. 2024-09-10T16:27:50.893 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../017-python3-rbd_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:50.934 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rbd (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:50.964 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T16:27:50.991 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T16:27:51.031 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T16:27:51.279 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-10T16:27:51.291 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T16:27:51.305 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../018-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-10T16:27:51.307 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T16:27:51.341 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T16:27:51.345 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T16:27:51.589 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-10T16:27:51.594 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T16:27:51.604 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../019-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-10T16:27:51.610 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T16:27:51.648 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T16:27:51.652 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T16:27:51.942 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-10T16:27:51.969 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../020-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-10T16:27:51.981 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package lua5.1. 2024-09-10T16:27:52.008 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T16:27:52.008 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T16:27:52.047 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T16:27:52.337 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua5.1. 2024-09-10T16:27:52.359 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package lua-any. 2024-09-10T16:27:52.364 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../021-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-10T16:27:52.374 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-10T16:27:52.404 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-10T16:27:52.409 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T16:27:52.611 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package zip. 2024-09-10T16:27:52.627 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-10T16:27:52.670 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T16:27:52.699 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua-any. 2024-09-10T16:27:52.714 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../022-lua-any_27ubuntu1_all.deb ... 2024-09-10T16:27:52.749 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-10T16:27:53.023 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package unzip. 2024-09-10T16:27:53.050 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T16:27:53.089 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T16:27:53.160 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package zip. 2024-09-10T16:27:53.186 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../023-zip_3.0-12build2_amd64.deb ... 2024-09-10T16:27:53.226 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking zip (3.0-12build2) ... 2024-09-10T16:27:53.510 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package luarocks. 2024-09-10T16:27:53.537 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T16:27:53.546 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package unzip. 2024-09-10T16:27:53.573 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../024-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-10T16:27:53.577 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T16:27:53.613 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-10T16:27:53.918 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package librgw2. 2024-09-10T16:27:53.933 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../026-librgw2_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:53.989 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking librgw2 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:54.000 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package luarocks. 2024-09-10T16:27:54.026 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../025-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-10T16:27:54.067 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-10T16:27:54.416 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package librgw2. 2024-09-10T16:27:54.432 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../026-librgw2_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:54.466 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking librgw2 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:54.604 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T16:27:54.619 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:54.662 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-rgw (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:54.999 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T16:27:55.025 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T16:27:55.065 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T16:27:55.085 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rgw. 2024-09-10T16:27:55.101 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../027-python3-rgw_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:55.144 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rgw (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:55.351 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T16:27:55.367 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:55.401 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libradosstriper1 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:55.480 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-10T16:27:55.507 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../028-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-10T16:27:55.547 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T16:27:55.804 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-common. 2024-09-10T16:27:55.825 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libradosstriper1. 2024-09-10T16:27:55.831 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:55.840 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../029-libradosstriper1_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:55.871 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-common (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:55.875 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libradosstriper1 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:56.286 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-common. 2024-09-10T16:27:56.313 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../030-ceph-common_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:56.353 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-common (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:57.401 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-base. 2024-09-10T16:27:57.428 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:57.477 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-base (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:57.842 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-base. 2024-09-10T16:27:57.868 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../031-ceph-base_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:27:57.918 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-base (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:27:58.047 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T16:27:58.070 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T16:27:58.105 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T16:27:58.496 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-10T16:27:58.522 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../032-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-10T16:27:58.563 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-10T16:27:58.700 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T16:27:58.727 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T16:27:58.766 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T16:27:58.874 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cheroot. 2024-09-10T16:27:58.900 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../033-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-10T16:27:58.941 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T16:27:59.094 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T16:27:59.121 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T16:27:59.161 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T16:27:59.235 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-10T16:27:59.262 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../034-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-10T16:27:59.294 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-10T16:27:59.464 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T16:27:59.491 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T16:27:59.530 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T16:27:59.571 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-10T16:27:59.598 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../035-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-10T16:27:59.638 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-10T16:27:59.783 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T16:27:59.799 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T16:27:59.833 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T16:27:59.941 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-10T16:27:59.968 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../036-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-10T16:28:00.008 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-10T16:28:00.103 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T16:28:00.118 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T16:28:00.161 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T16:28:00.261 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempora. 2024-09-10T16:28:00.276 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../037-python3-tempora_4.1.2-1_all.deb ... 2024-09-10T16:28:00.310 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-10T16:28:00.464 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-portend. 2024-09-10T16:28:00.491 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-10T16:28:00.530 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T16:28:00.563 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-portend. 2024-09-10T16:28:00.589 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../038-python3-portend_3.0.0-1_all.deb ... 2024-09-10T16:28:00.630 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-10T16:28:00.834 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T16:28:00.860 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T16:28:00.900 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T16:28:00.941 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-10T16:28:00.968 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../039-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-10T16:28:01.008 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-10T16:28:01.295 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T16:28:01.311 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-10T16:28:01.321 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T16:28:01.337 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../040-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-10T16:28:01.370 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T16:28:01.378 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-10T16:28:01.715 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T16:28:01.723 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-natsort. 2024-09-10T16:28:01.742 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T16:28:01.749 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../041-python3-natsort_8.0.2-1_all.deb ... 2024-09-10T16:28:01.781 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T16:28:01.798 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-10T16:28:02.135 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T16:28:02.151 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-logutils. 2024-09-10T16:28:02.161 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T16:28:02.178 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../042-python3-logutils_0.3.3-8_all.deb ... 2024-09-10T16:28:02.201 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T16:28:02.228 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-10T16:28:02.504 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T16:28:02.530 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T16:28:02.570 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T16:28:02.596 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-10T16:28:02.623 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../043-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-10T16:28:02.670 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-10T16:28:02.849 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-mako. 2024-09-10T16:28:02.875 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T16:28:02.907 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T16:28:02.999 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-mako. 2024-09-10T16:28:03.026 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../044-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-10T16:28:03.065 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T16:28:03.369 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T16:28:03.385 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-10T16:28:03.395 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T16:28:03.411 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../045-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-10T16:28:03.427 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T16:28:03.451 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-10T16:28:03.730 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T16:28:03.754 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-10T16:28:03.757 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T16:28:03.781 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../046-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-10T16:28:03.796 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T16:28:03.821 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-10T16:28:04.100 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-webob. 2024-09-10T16:28:04.124 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webob. 2024-09-10T16:28:04.126 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T16:28:04.151 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../047-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-10T16:28:04.166 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T16:28:04.191 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T16:28:04.502 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T16:28:04.519 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-waitress. 2024-09-10T16:28:04.528 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T16:28:04.546 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../048-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-10T16:28:04.572 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T16:28:04.589 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T16:28:04.838 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T16:28:04.865 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T16:28:04.880 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-tempita. 2024-09-10T16:28:04.905 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T16:28:04.907 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../049-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-10T16:28:04.938 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T16:28:05.208 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-paste. 2024-09-10T16:28:05.234 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T16:28:05.241 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-paste. 2024-09-10T16:28:05.268 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../050-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-10T16:28:05.274 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T16:28:05.308 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T16:28:05.603 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T16:28:05.618 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T16:28:05.619 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-10T16:28:05.635 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../051-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-10T16:28:05.661 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T16:28:05.669 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T16:28:05.947 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T16:28:05.973 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T16:28:06.006 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-10T16:28:06.014 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T16:28:06.032 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../052-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-10T16:28:06.072 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-10T16:28:06.334 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T16:28:06.361 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T16:28:06.392 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-webtest. 2024-09-10T16:28:06.400 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T16:28:06.419 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../053-python3-webtest_2.0.35-1_all.deb ... 2024-09-10T16:28:06.459 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-10T16:28:06.703 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T16:28:06.730 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T16:28:06.770 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T16:28:06.770 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pecan. 2024-09-10T16:28:06.797 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../054-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-10T16:28:06.836 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T16:28:07.133 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T16:28:07.160 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T16:28:07.183 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-certifi. 2024-09-10T16:28:07.199 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T16:28:07.210 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../055-python3-certifi_2020.6.20-1_all.deb ... 2024-09-10T16:28:07.249 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-10T16:28:07.494 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-idna. 2024-09-10T16:28:07.518 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T16:28:07.544 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-idna. 2024-09-10T16:28:07.553 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T16:28:07.571 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../056-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-10T16:28:07.611 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T16:28:07.831 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T16:28:07.857 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T16:28:07.897 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T16:28:07.930 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-urllib3. 2024-09-10T16:28:07.957 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../057-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-10T16:28:07.997 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T16:28:09.018 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests. 2024-09-10T16:28:09.045 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T16:28:09.084 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T16:28:09.392 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-requests. 2024-09-10T16:28:09.395 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T16:28:09.418 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../058-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-10T16:28:09.422 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T16:28:09.458 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T16:28:09.462 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T16:28:09.765 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T16:28:09.769 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-10T16:28:09.780 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:28:09.796 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../059-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-10T16:28:09.823 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:09.836 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T16:28:10.147 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-10T16:28:10.163 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../060-ceph-mgr-modules-core_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:28:10.206 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:10.229 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T16:28:10.255 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:10.295 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:10.594 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-10T16:28:10.606 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T16:28:10.621 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../061-libsqlite3-mod-ceph_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:10.633 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T16:28:10.660 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:10.672 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T16:28:10.943 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T16:28:10.969 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T16:28:10.980 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-10T16:28:11.000 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T16:28:11.006 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../062-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-10T16:28:11.046 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-10T16:28:11.320 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T16:28:11.325 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-openssl. 2024-09-10T16:28:11.347 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:11.352 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../063-python3-openssl_21.0.0-1_all.deb ... 2024-09-10T16:28:11.387 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:11.391 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-10T16:28:11.711 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr. 2024-09-10T16:28:11.738 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../064-ceph-mgr_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:11.777 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:11.782 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T16:28:11.808 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:11.848 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mon (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:12.173 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mon. 2024-09-10T16:28:12.199 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../065-ceph-mon_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:12.238 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mon (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:12.419 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T16:28:12.445 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:12.477 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-osd (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:12.851 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-osd. 2024-09-10T16:28:12.878 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../066-ceph-osd_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:12.917 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-osd (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:13.547 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph. 2024-09-10T16:28:13.563 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../067-ceph_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:13.596 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:13.874 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T16:28:13.901 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:13.958 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-fuse (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:13.995 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph. 2024-09-10T16:28:14.011 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../067-ceph_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:14.045 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:14.328 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T16:28:14.354 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:14.364 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-fuse. 2024-09-10T16:28:14.391 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../068-ceph-fuse_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:14.394 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mds (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:14.431 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-fuse (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:14.789 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package cephadm. 2024-09-10T16:28:14.809 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mds. 2024-09-10T16:28:14.815 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../070-cephadm_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:14.836 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../069-ceph-mds_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:14.855 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking cephadm (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:14.876 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mds (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:15.133 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T16:28:15.160 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T16:28:15.191 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T16:28:15.254 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package cephadm. 2024-09-10T16:28:15.281 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../070-cephadm_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:15.312 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking cephadm (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:15.486 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T16:28:15.513 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T16:28:15.552 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T16:28:15.648 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-10T16:28:15.675 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../071-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-10T16:28:15.714 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-10T16:28:16.009 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-10T16:28:16.036 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../072-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T16:28:16.067 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T16:28:16.524 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-babel. 2024-09-10T16:28:16.551 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T16:28:16.590 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T16:28:16.910 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T16:28:16.937 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T16:28:16.977 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T16:28:17.089 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-babel. 2024-09-10T16:28:17.117 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../073-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-10T16:28:17.155 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T16:28:17.347 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T16:28:17.373 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:28:17.413 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:17.492 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-jinja2. 2024-09-10T16:28:17.519 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../074-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-10T16:28:17.558 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T16:28:17.750 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T16:28:17.777 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T16:28:17.817 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T16:28:17.895 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-10T16:28:17.922 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../075-ceph-mgr-cephadm_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:28:17.961 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:18.103 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-routes. 2024-09-10T16:28:18.129 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T16:28:18.169 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T16:28:18.290 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-10T16:28:18.317 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../076-python3-repoze.lru_0.7-2_all.deb ... 2024-09-10T16:28:18.356 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-10T16:28:18.506 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T16:28:18.533 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:28:18.618 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-routes. 2024-09-10T16:28:18.633 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../077-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-10T16:28:18.667 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T16:28:18.781 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:18.987 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-10T16:28:19.015 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../078-ceph-mgr-dashboard_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:28:19.045 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:21.420 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T16:28:21.449 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T16:28:21.478 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T16:28:21.861 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-10T16:28:21.878 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../079-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-10T16:28:21.919 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T16:28:21.948 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T16:28:21.975 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T16:28:22.014 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T16:28:22.387 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T16:28:22.414 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T16:28:22.439 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-joblib. 2024-09-10T16:28:22.453 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T16:28:22.467 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../080-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-10T16:28:22.505 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T16:28:22.764 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T16:28:22.792 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T16:28:22.876 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-10T16:28:22.904 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../081-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-10T16:28:22.916 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T16:28:22.942 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-10T16:28:23.254 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-sklearn. 2024-09-10T16:28:23.281 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../082-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-10T16:28:23.414 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T16:28:23.651 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T16:28:23.680 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:28:23.717 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:24.084 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-10T16:28:24.110 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../083-ceph-mgr-diskprediction-local_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:28:24.148 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:24.663 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T16:28:24.691 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T16:28:24.729 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T16:28:25.066 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T16:28:25.094 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T16:28:25.132 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T16:28:25.318 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-cachetools. 2024-09-10T16:28:25.346 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../084-python3-cachetools_5.0.0-1_all.deb ... 2024-09-10T16:28:25.385 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-10T16:28:25.461 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T16:28:25.488 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T16:28:25.527 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T16:28:25.646 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-10T16:28:25.662 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../085-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-10T16:28:25.696 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-10T16:28:25.839 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T16:28:25.866 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-10T16:28:25.905 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T16:28:26.016 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-10T16:28:26.044 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../086-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-10T16:28:26.082 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T16:28:26.184 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T16:28:26.211 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T16:28:26.242 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T16:28:26.394 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-rsa. 2024-09-10T16:28:26.422 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../087-python3-rsa_4.8-1_all.deb ... 2024-09-10T16:28:26.460 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-10T16:28:26.562 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T16:28:26.590 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T16:28:26.629 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T16:28:26.764 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-google-auth. 2024-09-10T16:28:26.792 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../088-python3-google-auth_1.5.1-3_all.deb ... 2024-09-10T16:28:26.830 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-10T16:28:26.940 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T16:28:26.967 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T16:28:27.006 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T16:28:27.153 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-10T16:28:27.178 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../089-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-10T16:28:27.217 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T16:28:27.318 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T16:28:27.346 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T16:28:27.385 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T16:28:27.503 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-websocket. 2024-09-10T16:28:27.532 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../090-python3-websocket_1.2.3-1_all.deb ... 2024-09-10T16:28:27.561 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-10T16:28:27.857 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-10T16:28:27.885 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../091-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-10T16:28:27.923 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T16:28:28.041 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T16:28:28.069 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:28:28.107 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:28.393 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T16:28:28.421 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T16:28:28.451 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T16:28:28.587 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-10T16:28:28.604 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../092-ceph-mgr-k8sevents_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:28:28.645 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:28.948 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-10T16:28:29.068 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T16:28:29.068 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T16:28:29.068 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../093-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-10T16:28:29.069 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T16:28:29.113 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T16:28:29.359 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-10T16:28:29.374 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package jq. 2024-09-10T16:28:29.387 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../094-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T16:28:29.390 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T16:28:29.426 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T16:28:29.432 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T16:28:29.826 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package socat. 2024-09-10T16:28:29.843 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T16:28:29.879 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package jq. 2024-09-10T16:28:29.885 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T16:28:29.906 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../095-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-10T16:28:29.945 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-10T16:28:30.173 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package socat. 2024-09-10T16:28:30.188 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T16:28:30.189 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../096-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-10T16:28:30.217 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T16:28:30.222 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-10T16:28:30.255 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T16:28:30.509 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package xmlstarlet. 2024-09-10T16:28:30.537 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../097-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-10T16:28:30.575 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-10T16:28:30.609 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-test. 2024-09-10T16:28:30.625 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:30.667 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-test (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:30.938 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-test. 2024-09-10T16:28:30.955 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../098-ceph-test_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:30.988 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-test (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:33.147 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T16:28:33.175 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:28:33.213 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking ceph-volume (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:33.517 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T16:28:33.534 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:33.542 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package ceph-volume. 2024-09-10T16:28:33.571 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../099-ceph-volume_19.3.0-4858-gbad1f558-1jammy_all.deb ... 2024-09-10T16:28:33.575 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking libcephfs-dev (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:33.609 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking ceph-volume (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:33.879 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T16:28:33.907 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T16:28:33.921 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-10T16:28:33.945 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T16:28:33.950 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../100-libcephfs-dev_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:33.988 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking libcephfs-dev (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:34.241 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T16:28:34.257 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T16:28:34.274 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-10T16:28:34.291 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T16:28:34.302 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../101-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-10T16:28:34.340 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T16:28:34.662 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T16:28:34.679 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-10T16:28:34.690 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T16:28:34.707 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../102-lua-sec_1.0.2-1_amd64.deb ... 2024-09-10T16:28:34.728 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T16:28:34.745 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-10T16:28:35.091 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package nvme-cli. 2024-09-10T16:28:35.119 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../103-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-10T16:28:35.149 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T16:28:35.150 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package pkg-config. 2024-09-10T16:28:35.179 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T16:28:35.225 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T16:28:35.470 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T16:28:35.487 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T16:28:35.512 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package pkg-config. 2024-09-10T16:28:35.528 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T16:28:35.529 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../104-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-10T16:28:35.570 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T16:28:35.824 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-10T16:28:35.852 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../105-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-10T16:28:35.890 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-10T16:28:35.948 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T16:28:35.976 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T16:28:36.014 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T16:28:36.292 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T16:28:36.309 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T16:28:36.310 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-10T16:28:36.338 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../106-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-10T16:28:36.342 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T16:28:36.376 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-10T16:28:36.646 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T16:28:36.674 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T16:28:36.679 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pastescript. 2024-09-10T16:28:36.707 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../107-python3-pastescript_2.0.2-4_all.deb ... 2024-09-10T16:28:36.712 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T16:28:36.745 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-10T16:28:37.024 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T16:28:37.052 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T16:28:37.082 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T16:28:37.082 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pluggy. 2024-09-10T16:28:37.110 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../108-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-10T16:28:37.149 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-10T16:28:37.443 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-py. 2024-09-10T16:28:37.444 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-psutil. 2024-09-10T16:28:37.472 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-10T16:28:37.472 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../109-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-10T16:28:37.502 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-10T16:28:37.518 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T16:28:37.826 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T16:28:37.830 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-py. 2024-09-10T16:28:37.846 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T16:28:37.858 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../110-python3-py_1.10.0-1_all.deb ... 2024-09-10T16:28:37.888 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T16:28:37.904 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-10T16:28:38.191 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pygments. 2024-09-10T16:28:38.207 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../111-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-10T16:28:38.241 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T16:28:38.292 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T16:28:38.309 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T16:28:38.342 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T16:28:38.653 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-toml. 2024-09-10T16:28:38.681 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-10T16:28:38.711 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-10T16:28:38.720 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T16:28:38.728 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../112-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-10T16:28:38.770 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-10T16:28:39.023 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T16:28:39.051 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T16:28:39.089 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T16:28:39.097 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-toml. 2024-09-10T16:28:39.126 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../113-python3-toml_0.10.2-1_all.deb ... 2024-09-10T16:28:39.164 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-10T16:28:39.426 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T16:28:39.455 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T16:28:39.467 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-pytest. 2024-09-10T16:28:39.492 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T16:28:39.495 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../114-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-10T16:28:39.533 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T16:28:39.762 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T16:28:39.790 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T16:28:39.829 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T16:28:39.870 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package python3-simplejson. 2024-09-10T16:28:39.898 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../115-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-10T16:28:39.937 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-10T16:28:40.206 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-10T16:28:40.234 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../116-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-10T16:28:40.272 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-10T16:28:40.558 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package radosgw. 2024-09-10T16:28:40.586 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../117-radosgw_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:40.624 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking radosgw (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:41.002 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package radosgw. 2024-09-10T16:28:41.030 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../117-radosgw_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:41.068 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking radosgw (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:41.519 INFO:teuthology.orchestra.run.smithi081.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T16:28:41.547 INFO:teuthology.orchestra.run.smithi081.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:41.585 INFO:teuthology.orchestra.run.smithi081.stdout:Unpacking rbd-fuse (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:41.874 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T16:28:41.971 INFO:teuthology.orchestra.run.smithi189.stdout:Selecting previously unselected package rbd-fuse. 2024-09-10T16:28:41.999 INFO:teuthology.orchestra.run.smithi189.stdout:Preparing to unpack .../118-rbd-fuse_19.3.0-4858-gbad1f558-1jammy_amd64.deb ... 2024-09-10T16:28:42.037 INFO:teuthology.orchestra.run.smithi189.stdout:Unpacking rbd-fuse (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:42.174 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T16:28:42.301 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T16:28:42.350 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-10T16:28:42.564 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T16:28:42.600 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-10T16:28:42.735 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-10T16:28:42.874 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T16:28:42.999 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-10T16:28:43.297 INFO:teuthology.orchestra.run.smithi081.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T16:28:43.337 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-10T16:28:43.360 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up cephadm (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:43.824 INFO:teuthology.orchestra.run.smithi189.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-10T16:28:43.877 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user cephadm....done 2024-09-10T16:28:43.887 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up cephadm (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:44.017 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T16:28:44.310 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T16:28:44.486 INFO:teuthology.orchestra.run.smithi189.stdout:Adding system user cephadm....done 2024-09-10T16:28:44.635 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-10T16:28:44.703 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T16:28:44.829 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T16:28:44.894 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-10T16:28:45.080 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T16:28:45.129 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-10T16:28:45.247 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-10T16:28:45.340 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T16:28:45.466 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T16:28:45.489 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-10T16:28:45.741 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-10T16:28:45.768 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T16:28:45.867 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-10T16:28:46.120 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T16:28:46.160 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-10T16:28:46.363 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T16:28:46.512 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-10T16:28:46.614 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T16:28:46.747 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-10T16:28:46.865 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T16:28:47.031 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-10T16:28:47.117 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T16:28:47.283 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-10T16:28:47.376 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T16:28:47.534 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-10T16:28:47.627 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-argparse (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:47.785 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-10T16:28:47.878 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T16:28:48.021 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-10T16:28:48.028 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-ceph-argparse (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:48.131 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T16:28:48.257 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T16:28:48.325 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-10T16:28:48.383 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T16:28:48.538 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libnbd0 (1.10.5-1) ... 2024-09-10T16:28:48.639 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-10T16:28:48.642 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T16:28:48.765 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-10T16:28:48.891 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-10T16:28:49.044 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T16:28:49.073 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T16:28:49.137 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T16:28:49.150 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-10T16:28:49.247 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T16:28:49.553 INFO:teuthology.orchestra.run.smithi189.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-10T16:28:49.582 INFO:teuthology.orchestra.run.smithi189.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-10T16:28:49.606 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T16:28:49.645 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-10T16:28:49.732 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T16:28:49.746 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-10T16:28:50.009 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T16:28:50.089 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-10T16:28:50.207 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-10T16:28:50.285 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T16:28:50.474 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-10T16:28:50.603 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T16:28:50.726 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-10T16:28:50.729 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T16:28:51.019 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up zip (3.0-12build2) ... 2024-09-10T16:28:51.145 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-10T16:28:51.406 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T16:28:51.667 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T16:28:51.792 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T16:28:51.796 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-10T16:28:51.951 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T16:28:52.048 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-10T16:28:52.173 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-10T16:28:52.252 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T16:28:52.300 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-10T16:28:52.600 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-10T16:28:52.645 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T16:28:52.880 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T16:28:52.969 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-10T16:28:53.220 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-10T16:28:53.239 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T16:28:53.532 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T16:28:53.588 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-10T16:28:53.867 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T16:28:53.889 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-10T16:28:54.118 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T16:28:54.244 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-ceph-common (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:54.249 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-10T16:28:54.508 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-10T16:28:54.554 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T16:28:54.634 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-ceph-common (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:28:54.855 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T16:28:54.944 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-10T16:28:55.545 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-10T16:28:56.003 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T16:28:56.222 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T16:28:56.339 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T16:28:56.607 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T16:28:56.643 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-10T16:28:56.733 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T16:28:56.859 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T16:28:56.861 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T16:28:56.995 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-10T16:28:57.153 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T16:28:57.255 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-10T16:28:57.364 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-10T16:28:57.412 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T16:28:57.490 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-10T16:28:57.646 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T16:28:57.756 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T16:28:57.791 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-10T16:28:58.026 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-10T16:28:58.049 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T16:28:58.261 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T16:28:58.300 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T16:28:58.378 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-10T16:28:58.568 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T16:28:58.680 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-10T16:28:58.827 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T16:28:58.922 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-10T16:28:59.087 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T16:28:59.182 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-10T16:28:59.330 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T16:28:59.441 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-10T16:28:59.448 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T16:28:59.684 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-10T16:28:59.757 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T16:28:59.883 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T16:29:00.124 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-10T16:29:00.124 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-10T16:29:00.250 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T16:29:00.354 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-10T16:29:00.480 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-10T16:29:00.552 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T16:29:00.764 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-10T16:29:00.804 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T16:29:00.921 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T16:29:01.039 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T16:29:01.049 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-10T16:29:01.111 INFO:teuthology.orchestra.run.smithi081.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T16:29:01.299 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-10T16:29:01.357 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T16:29:01.425 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-10T16:29:01.483 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T16:29:01.552 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-10T16:29:01.642 INFO:teuthology.orchestra.run.smithi189.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-10T16:29:01.876 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T16:29:01.887 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-10T16:29:01.988 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-10T16:29:02.136 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T16:29:02.271 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T16:29:02.356 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-10T16:29:02.530 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T16:29:02.590 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-10T16:29:02.656 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T16:29:02.716 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-10T16:29:02.976 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-10T16:29:02.982 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T16:29:03.102 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-10T16:29:03.292 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T16:29:03.428 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-10T16:29:03.601 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T16:29:03.712 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-10T16:29:03.727 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T16:29:03.980 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-10T16:29:03.995 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T16:29:04.098 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-10T16:29:04.340 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T16:29:04.374 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-10T16:29:04.617 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T16:29:04.744 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-10T16:29:04.993 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T16:29:05.011 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-10T16:29:05.295 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T16:29:05.380 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-10T16:29:05.639 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T16:29:05.667 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-10T16:29:05.757 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librados2 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:05.883 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:06.009 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T16:29:06.025 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-10T16:29:06.145 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up librados2 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:06.246 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:06.346 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs2 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:06.356 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-10T16:29:06.463 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libradosstriper1 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:06.581 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T16:29:06.692 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libcephfs2 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:06.818 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libradosstriper1 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:06.841 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librbd1 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:06.944 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-10T16:29:06.967 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-modules-core (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:07.093 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-fuse (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:07.221 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up librbd1 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:07.322 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-modules-core (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:07.334 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T16:29:07.334 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T16:29:07.431 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-fuse (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:07.640 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T16:29:07.640 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-10T16:29:07.836 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up libcephfs-dev (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:08.006 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rados (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:08.124 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up librgw2 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:08.140 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up libcephfs-dev (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:08.250 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T16:29:08.266 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-rados (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:08.392 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up librgw2 (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:08.519 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-10T16:29:09.404 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rbd (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:09.514 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up rbd-fuse (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:09.640 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-rgw (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:09.722 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-rbd (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:09.774 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up python3-cephfs (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:09.832 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up rbd-fuse (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:09.901 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-common (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:09.957 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-rgw (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:10.083 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up python3-cephfs (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:10.210 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-common (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:10.404 INFO:teuthology.orchestra.run.smithi081.stdout:Adding group ceph....done 2024-09-10T16:29:10.712 INFO:teuthology.orchestra.run.smithi081.stdout:Adding system user ceph....done 2024-09-10T16:29:10.744 INFO:teuthology.orchestra.run.smithi189.stdout:Adding group ceph....done 2024-09-10T16:29:10.872 INFO:teuthology.orchestra.run.smithi081.stdout:Setting system user ceph properties....done 2024-09-10T16:29:10.885 INFO:teuthology.orchestra.run.smithi081.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T16:29:11.022 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T16:29:11.129 INFO:teuthology.orchestra.run.smithi189.stdout:Adding system user ceph....done 2024-09-10T16:29:11.297 INFO:teuthology.orchestra.run.smithi189.stdout:Setting system user ceph properties....done 2024-09-10T16:29:11.311 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T16:29:11.312 INFO:teuthology.orchestra.run.smithi189.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-10T16:29:11.446 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-10T16:29:11.773 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-10T16:29:11.777 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-test (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:11.903 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up radosgw (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:12.285 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-test (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:12.357 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T16:29:12.357 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T16:29:12.420 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up radosgw (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:12.821 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-base (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:12.910 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T16:29:12.910 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-10T16:29:13.155 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T16:29:13.389 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-base (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:13.607 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mds (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:13.694 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-10T16:29:13.830 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T16:29:13.830 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T16:29:14.165 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mds (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:14.292 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:14.397 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T16:29:14.397 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-10T16:29:14.508 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T16:29:14.508 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T16:29:14.859 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:14.968 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-osd (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:15.081 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T16:29:15.081 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-10T16:29:15.244 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T16:29:15.244 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T16:29:15.551 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-osd (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:15.816 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T16:29:15.816 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-10T16:29:15.908 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:16.034 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:16.185 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mon (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:16.328 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:16.400 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T16:29:16.401 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T16:29:16.455 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:16.581 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mon (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:16.775 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T16:29:16.775 INFO:teuthology.orchestra.run.smithi189.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-10T16:29:16.911 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-cephadm (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:17.053 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:17.179 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-mgr-dashboard (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:17.265 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-cephadm (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:17.331 INFO:teuthology.orchestra.run.smithi081.stdout:Setting up ceph-volume (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:17.416 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:17.542 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-mgr-dashboard (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:17.693 INFO:teuthology.orchestra.run.smithi189.stdout:Setting up ceph-volume (19.3.0-4858-gbad1f558-1jammy) ... 2024-09-10T16:29:17.826 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T16:29:17.934 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T16:29:18.087 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T16:29:18.105 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-10T16:29:18.205 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-10T16:29:18.333 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-10T16:29:19.221 INFO:teuthology.orchestra.run.smithi081.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T16:29:19.542 INFO:teuthology.orchestra.run.smithi189.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-10T16:29:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T16:29:19.881 DEBUG:teuthology.parallel:result is None 2024-09-10T16:29:20.187 INFO:teuthology.orchestra.run.smithi189.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-10T16:29:20.192 DEBUG:teuthology.parallel:result is None 2024-09-10T16:29:20.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T16:29:20.333 DEBUG:teuthology.orchestra.run.smithi081:> dpkg-query -W -f '${Version}' ceph 2024-09-10T16:29:20.352 INFO:teuthology.orchestra.run.smithi081.stdout:19.3.0-4858-gbad1f558-1jammy 2024-09-10T16:29:20.353 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4858-gbad1f558-1jammy 2024-09-10T16:29:20.353 INFO:teuthology.task.install:The correct ceph version 19.3.0-4858-gbad1f558-1jammy is installed. 2024-09-10T16:29:20.355 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=bad1f558c327094897e4a32e99dd5cb4ae6ccd46 2024-09-10T16:29:20.493 DEBUG:teuthology.orchestra.run.smithi189:> dpkg-query -W -f '${Version}' ceph 2024-09-10T16:29:20.511 INFO:teuthology.orchestra.run.smithi189.stdout:19.3.0-4858-gbad1f558-1jammy 2024-09-10T16:29:20.512 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4858-gbad1f558-1jammy 2024-09-10T16:29:20.512 INFO:teuthology.task.install:The correct ceph version 19.3.0-4858-gbad1f558-1jammy is installed. 2024-09-10T16:29:20.513 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-10T16:29:20.514 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:20.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T16:29:20.528 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:20.529 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-10T16:29:20.570 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-10T16:29:20.571 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:20.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T16:29:20.584 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T16:29:20.641 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:20.641 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/daemon-helper 2024-09-10T16:29:20.655 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-10T16:29:20.709 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-10T16:29:20.710 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:20.710 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T16:29:20.722 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T16:29:20.775 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:20.776 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-10T16:29:20.789 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-10T16:29:20.848 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-10T16:29:20.848 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:20.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T16:29:20.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T16:29:20.916 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:20.916 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/usr/bin/stdin-killer 2024-09-10T16:29:20.929 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-10T16:29:20.985 INFO:teuthology.run_tasks:Running task ceph... 2024-09-10T16:29:21.068 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-10T16:29:21.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2024-09-10T16:29:21.071 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 777 /var/log/ceph 2024-09-10T16:29:21.084 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-10T16:29:21.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T16:29:21.126 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-10T16:29:21.138 INFO:tasks.ceph:Creating extra log directories... 2024-09-10T16:29:21.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T16:29:21.178 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-10T16:29:21.204 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-10T16:29:21.204 INFO:tasks.ceph:config {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'slow request', 'overall HEALTH_'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': False, 'mon_bind_addrvec': True} 2024-09-10T16:29:21.204 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310', 'branch': 'wip-bharath7-testing-2024-09-10-1409', 'description': 'rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-zlib} rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete}', 'email': 'skanta@redhat.com', 'first_in_suite': False, 'job_id': '7899310', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-bharath7-testing-2024-09-10-1409'}, 'ceph': {'conf': {'client': {'debug monc': 20, 'debug ms': 1}, 'global': {'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'osd': {'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd mclock profile': 'high_recovery_ops', 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'ScrubResult', 'scrub mismatch', 'overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_AVAILABILITY\\)', '\\(SLOW_OPS\\)', 'slow request', '\\(OSD_SLOW_PING_TIME', 'overall HEALTH_', '\\(MON_DOWN\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'slow request', 'overall HEALTH_'], 'mon_bind_msgr2': False, 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'}, 'ceph-deploy': {'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-bharath7-testing-2024-09-10-1409', 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46'}}, 'owner': 'scheduled_skanta@teuthology', 'priority': 99, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mon.d', 'mon.e', 'osd.0', 'osd.1', 'osd.2'], ['mon.f', 'mon.g', 'mon.h', 'mon.i', 'mgr.x', 'osd.3', 'osd.4', 'osd.5', 'client.0']], 'seed': 5245, 'sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-bharath7-testing-2024-09-10-1409', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_bad1f558c327094897e4a32e99dd5cb4ae6ccd46/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': 'bad1f558c327094897e4a32e99dd5cb4ae6ccd46', 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMauob6BlDSyINEYhVySazDYQ2QoC6yY6xyn+GfvhclcyiIoJxQLvHj4Y6wvVNZaNtE3PpxPTanme72z+VzppzE=', 'smithi189.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBcpN9Igm3L5PHANPgkZddyioMzvv3jTMXqVEBRJHqKgZkg1+biVpdjAIO0mhxFBPWmOB+uvWjLwjHpoxiy2bCo='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'mon_thrash': {'revive_delay': 90, 'thrash_delay': 1, 'thrash_many': True}}, {'exec': {'client.0': ['ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel', 'ceph_test_rados_delete_pools_parallel']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-10_15:30:27', 'tube': 'smithi', 'user': 'skanta', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-10T16:29:21.205 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T16:29:21.230 DEBUG:teuthology.orchestra.run.smithi189:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-10T16:29:21.242 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T16:29:21.278 DEBUG:teuthology.orchestra.run.smithi189:> sudo install -d -m0777 -- /var/run/ceph 2024-09-10T16:29:21.301 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:21.301 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T16:29:21.337 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T16:29:21.337 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-10T16:29:21.385 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T16:29:21.385 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T16:29:21.385 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 889 Links: 1 2024-09-10T16:29:21.385 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T16:29:21.385 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-10 16:23:55.432935809 +0000 2024-09-10T16:29:21.385 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-10 16:23:55.188937988 +0000 2024-09-10T16:29:21.386 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-10 16:23:55.188937988 +0000 2024-09-10T16:29:21.386 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-10T16:29:21.386 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T16:29:21.440 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-10T16:29:21.440 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-10T16:29:21.440 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000380066 s, 1.3 MB/s 2024-09-10T16:29:21.441 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T16:29:21.490 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-10T16:29:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T16:29:21.537 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T16:29:21.537 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 898 Links: 1 2024-09-10T16:29:21.537 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T16:29:21.537 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-10 16:23:55.964931056 +0000 2024-09-10T16:29:21.537 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-10 16:23:55.684933558 +0000 2024-09-10T16:29:21.538 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-10 16:23:55.684933558 +0000 2024-09-10T16:29:21.538 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-10T16:29:21.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T16:29:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-10T16:29:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-10T16:29:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000342326 s, 1.5 MB/s 2024-09-10T16:29:21.592 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T16:29:21.642 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-10T16:29:21.689 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T16:29:21.689 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T16:29:21.689 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 915 Links: 1 2024-09-10T16:29:21.689 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T16:29:21.689 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-10 16:23:56.480926448 +0000 2024-09-10T16:29:21.689 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-10 16:23:56.212928841 +0000 2024-09-10T16:29:21.690 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-10 16:23:56.212928841 +0000 2024-09-10T16:29:21.690 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-10T16:29:21.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T16:29:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-10T16:29:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-10T16:29:21.744 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000442253 s, 1.2 MB/s 2024-09-10T16:29:21.745 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T16:29:21.794 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-10T16:29:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T16:29:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T16:29:21.841 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 937 Links: 1 2024-09-10T16:29:21.841 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T16:29:21.841 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-10 16:23:56.928922446 +0000 2024-09-10T16:29:21.841 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-10 16:23:56.712924376 +0000 2024-09-10T16:29:21.841 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-10 16:23:56.712924376 +0000 2024-09-10T16:29:21.841 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: - 2024-09-10T16:29:21.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T16:29:21.895 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-10T16:29:21.895 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-10T16:29:21.895 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000313101 s, 1.6 MB/s 2024-09-10T16:29:21.896 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T16:29:21.946 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-10T16:29:21.946 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:21.946 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/scratch_devs of=/dev/stdout 2024-09-10T16:29:21.952 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-10T16:29:21.952 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_1 2024-09-10T16:29:21.998 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-10T16:29:21.998 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T16:29:21.998 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 884 Links: 1 2024-09-10T16:29:21.998 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T16:29:21.998 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 16:23:55.484367208 +0000 2024-09-10T16:29:21.998 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 16:23:55.236369423 +0000 2024-09-10T16:29:21.998 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 16:23:55.236369423 +0000 2024-09-10T16:29:21.998 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: - 2024-09-10T16:29:21.999 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-10T16:29:22.052 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T16:29:22.052 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T16:29:22.052 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000449403 s, 1.1 MB/s 2024-09-10T16:29:22.054 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-10T16:29:22.107 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_2 2024-09-10T16:29:22.153 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-10T16:29:22.153 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T16:29:22.153 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-09-10T16:29:22.154 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T16:29:22.154 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 16:23:55.980362778 +0000 2024-09-10T16:29:22.154 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 16:23:55.724365063 +0000 2024-09-10T16:29:22.154 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 16:23:55.724365063 +0000 2024-09-10T16:29:22.154 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: - 2024-09-10T16:29:22.154 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-10T16:29:22.208 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T16:29:22.208 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T16:29:22.208 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000414207 s, 1.2 MB/s 2024-09-10T16:29:22.209 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-10T16:29:22.259 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_3 2024-09-10T16:29:22.305 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-10T16:29:22.306 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T16:29:22.306 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 914 Links: 1 2024-09-10T16:29:22.306 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T16:29:22.306 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 16:23:56.480358311 +0000 2024-09-10T16:29:22.306 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 16:23:56.228360562 +0000 2024-09-10T16:29:22.306 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 16:23:56.228360562 +0000 2024-09-10T16:29:22.306 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: - 2024-09-10T16:29:22.306 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-10T16:29:22.360 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T16:29:22.360 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T16:29:22.360 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000355936 s, 1.4 MB/s 2024-09-10T16:29:22.361 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-10T16:29:22.411 DEBUG:teuthology.orchestra.run.smithi189:> stat /dev/vg_nvme/lv_4 2024-09-10T16:29:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-10T16:29:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-10T16:29:22.458 INFO:teuthology.orchestra.run.smithi189.stdout:Device: 5h/5d Inode: 934 Links: 1 2024-09-10T16:29:22.458 INFO:teuthology.orchestra.run.smithi189.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-10T16:29:22.458 INFO:teuthology.orchestra.run.smithi189.stdout:Access: 2024-09-10 16:23:57.000353667 +0000 2024-09-10T16:29:22.458 INFO:teuthology.orchestra.run.smithi189.stdout:Modify: 2024-09-10 16:23:56.732356060 +0000 2024-09-10T16:29:22.458 INFO:teuthology.orchestra.run.smithi189.stdout:Change: 2024-09-10 16:23:56.732356060 +0000 2024-09-10T16:29:22.458 INFO:teuthology.orchestra.run.smithi189.stdout: Birth: - 2024-09-10T16:29:22.459 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-10T16:29:22.512 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records in 2024-09-10T16:29:22.512 INFO:teuthology.orchestra.run.smithi189.stderr:1+0 records out 2024-09-10T16:29:22.512 INFO:teuthology.orchestra.run.smithi189.stderr:512 bytes copied, 0.000379614 s, 1.3 MB/s 2024-09-10T16:29:22.513 DEBUG:teuthology.orchestra.run.smithi189:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-10T16:29:22.563 INFO:tasks.ceph:osd dev map: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-10T16:29:22.563 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi189.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-10T16:29:22.563 INFO:tasks.ceph:Generating config... 2024-09-10T16:29:22.565 INFO:tasks.ceph:[client] debug monc = 20 2024-09-10T16:29:22.565 INFO:tasks.ceph:[client] debug ms = 1 2024-09-10T16:29:22.565 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-10T16:29:22.565 INFO:tasks.ceph:[global] mon election default strategy = 3 2024-09-10T16:29:22.565 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-09-10T16:29:22.565 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-10T16:29:22.565 INFO:tasks.ceph:[global] ms type = async 2024-09-10T16:29:22.565 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-10T16:29:22.565 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-10T16:29:22.566 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-10T16:29:22.566 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-10T16:29:22.566 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-10T16:29:22.566 INFO:tasks.ceph:[mon] mon min osdmap epochs = 25 2024-09-10T16:29:22.566 INFO:tasks.ceph:[mon] mon osdmap full prune interval = 2 2024-09-10T16:29:22.566 INFO:tasks.ceph:[mon] mon osdmap full prune min = 15 2024-09-10T16:29:22.566 INFO:tasks.ceph:[mon] mon osdmap full prune txsize = 2 2024-09-10T16:29:22.566 INFO:tasks.ceph:[mon] mon scrub inject crc mismatch = 0.01 2024-09-10T16:29:22.566 INFO:tasks.ceph:[mon] mon scrub inject missing keys = 0.05 2024-09-10T16:29:22.566 INFO:tasks.ceph:[mon] mon scrub interval = 300 2024-09-10T16:29:22.566 INFO:tasks.ceph:[mon] paxos min = 10 2024-09-10T16:29:22.566 INFO:tasks.ceph:[mon] paxos service trim min = 5 2024-09-10T16:29:22.566 INFO:tasks.ceph:[mon] paxos trim min = 10 2024-09-10T16:29:22.567 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-10T16:29:22.567 INFO:tasks.ceph:[osd] bluestore compression algorithm = zlib 2024-09-10T16:29:22.567 INFO:tasks.ceph:[osd] bluestore compression mode = aggressive 2024-09-10T16:29:22.567 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-10T16:29:22.567 INFO:tasks.ceph:[osd] bluestore write v2 = True 2024-09-10T16:29:22.567 INFO:tasks.ceph:[osd] bluestore zero block detection = True 2024-09-10T16:29:22.567 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-09-10T16:29:22.567 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-09-10T16:29:22.567 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-10T16:29:22.567 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-10T16:29:22.567 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-09-10T16:29:22.567 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-10T16:29:22.567 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-10T16:29:22.568 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-10T16:29:22.568 INFO:tasks.ceph:[osd] osd debug verify cached snaps = True 2024-09-10T16:29:22.568 INFO:tasks.ceph:[osd] osd debug verify missing on start = True 2024-09-10T16:29:22.568 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-10T16:29:22.568 INFO:tasks.ceph:[osd] osd mclock override recovery settings = True 2024-09-10T16:29:22.568 INFO:tasks.ceph:[osd] osd mclock profile = high_recovery_ops 2024-09-10T16:29:22.568 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-10T16:29:22.568 INFO:tasks.ceph:[osd] osd op queue = debug_random 2024-09-10T16:29:22.568 INFO:tasks.ceph:[osd] osd op queue cut off = debug_random 2024-09-10T16:29:22.568 INFO:tasks.ceph:Setting up mon.a... 2024-09-10T16:29:22.569 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-10T16:29:22.603 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2024-09-10T16:29:22.623 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-10T16:29:22.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T16:29:22.752 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '[v1:172.21.15.81:6789]'), ('mon.b', '[v1:172.21.15.81:6790]'), ('mon.c', '[v1:172.21.15.81:6791]'), ('mon.d', '[v1:172.21.15.81:6792]'), ('mon.e', '[v1:172.21.15.81:6793]'), ('mon.f', '[v1:172.21.15.189:6789]'), ('mon.g', '[v1:172.21.15.189:6790]'), ('mon.h', '[v1:172.21.15.189:6791]'), ('mon.i', '[v1:172.21.15.189:6792]')] 2024-09-10T16:29:22.753 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '[v1:172.21.15.81:6789],[v1:172.21.15.81:6790],[v1:172.21.15.81:6791],[v1:172.21.15.81:6792],[v1:172.21.15.81:6793],[v1:172.21.15.189:6789],[v1:172.21.15.189:6790],[v1:172.21.15.189:6791],[v1:172.21.15.189:6792]', 'mon client directed command retry': 5, 'mon election default strategy': 3, 'ms bind msgr2': False, 'ms inject socket failures': 5000, 'ms type': 'async'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore compression algorithm': 'zlib', 'bluestore compression mode': 'aggressive', 'bluestore fsck on mount': True, 'bluestore write v2': True, 'bluestore zero block detection': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd debug verify cached snaps': True, 'osd debug verify missing on start': True, 'osd failsafe full ratio': 0.95, 'osd mclock override recovery settings': True, 'osd objectstore': 'bluestore', 'osd op queue': 'debug_random', 'osd op queue cut off': 'debug_random'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon min osdmap epochs': 25, 'mon osdmap full prune interval': 2, 'mon osdmap full prune min': 15, 'mon osdmap full prune txsize': 2, 'mon scrub inject crc mismatch': 0.01, 'mon scrub inject missing keys': 0.05, 'mon scrub interval': 300, 'paxos min': 10, 'paxos service trim min': 5, 'paxos trim min': 10}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug monc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mon.d': {}, 'mon.e': {}, 'mon.f': {}, 'mon.g': {}, 'mon.h': {}, 'mon.i': {}} 2024-09-10T16:29:22.754 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:22.754 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T16:29:22.802 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --addv a '[v1:172.21.15.81:6789]' --addv b '[v1:172.21.15.81:6790]' --addv c '[v1:172.21.15.81:6791]' --addv d '[v1:172.21.15.81:6792]' --addv e '[v1:172.21.15.81:6793]' --addv f '[v1:172.21.15.189:6789]' --addv g '[v1:172.21.15.189:6790]' --addv h '[v1:172.21.15.189:6791]' --addv i '[v1:172.21.15.189:6792]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-10T16:29:22.908 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-10T16:29:22.908 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:22.908 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = quincy 2024-09-10T16:29:22.908 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2024-09-10T16:29:22.908 INFO:teuthology.orchestra.run.smithi081.stdout:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:22.908 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:22.908 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:22.908 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 17 (quincy) 2024-09-10T16:29:22.908 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 3 2024-09-10T16:29:22.908 INFO:teuthology.orchestra.run.smithi081.stdout:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:22.909 INFO:teuthology.orchestra.run.smithi081.stdout:1: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:22.909 INFO:teuthology.orchestra.run.smithi081.stdout:2: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:22.909 INFO:teuthology.orchestra.run.smithi081.stdout:3: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:22.909 INFO:teuthology.orchestra.run.smithi081.stdout:4: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:22.909 INFO:teuthology.orchestra.run.smithi081.stdout:5: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:22.909 INFO:teuthology.orchestra.run.smithi081.stdout:6: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:22.909 INFO:teuthology.orchestra.run.smithi081.stdout:7: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:22.909 INFO:teuthology.orchestra.run.smithi081.stdout:8: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:22.909 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (9 monitors) 2024-09-10T16:29:22.910 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-10T16:29:22.914 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8... 2024-09-10T16:29:22.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T16:29:22.958 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-10T16:29:22.986 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-10T16:29:22.986 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-09-10T16:29:22.986 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T16:29:22.986 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-09-10T16:29:22.986 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.986 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-09-10T16:29:22.986 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.987 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-09-10T16:29:22.987 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.987 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-09-10T16:29:22.987 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-09-10T16:29:22.987 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.987 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-09-10T16:29:22.987 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-09-10T16:29:22.987 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.987 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T16:29:22.987 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-09-10T16:29:22.987 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.987 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T16:29:22.987 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T16:29:22.988 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.988 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-09-10T16:29:22.988 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.988 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-09-10T16:29:22.988 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-09-10T16:29:22.988 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-09-10T16:29:22.988 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-09-10T16:29:22.988 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-09-10T16:29:22.988 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-09-10T16:29:22.988 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-09-10T16:29:22.988 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T16:29:22.988 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T16:29:22.989 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-09-10T16:29:22.989 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.989 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T16:29:22.989 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.989 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-09-10T16:29:22.989 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.989 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-09-10T16:29:22.989 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.989 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-09-10T16:29:22.989 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-09-10T16:29:22.989 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-09-10T16:29:22.990 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "[v1:172.21.15.81:6789],[v1:172.21.15.81:6790],[v1:172.21.15.81:6791],[v1:172.21.15.81:6792],[v1:172.21.15.81:6793],[v1:172.21.15.189:6789],[v1:172.21.15.189:6790],[v1:172.21.15.189:6791],[v1:172.21.15.189:6792]" 2024-09-10T16:29:22.990 INFO:teuthology.orchestra.run.smithi081.stdout: mon client directed command retry = 5 2024-09-10T16:29:22.990 INFO:teuthology.orchestra.run.smithi081.stdout: mon election default strategy = 3 2024-09-10T16:29:22.990 INFO:teuthology.orchestra.run.smithi081.stdout: ms bind msgr2 = False 2024-09-10T16:29:22.990 INFO:teuthology.orchestra.run.smithi081.stdout: ms inject socket failures = 5000 2024-09-10T16:29:22.990 INFO:teuthology.orchestra.run.smithi081.stdout: ms type = async 2024-09-10T16:29:22.990 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:22.990 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.990 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-09-10T16:29:22.990 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-09-10T16:29:22.990 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.990 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-09-10T16:29:22.991 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-09-10T16:29:22.991 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-09-10T16:29:22.991 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.991 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-09-10T16:29:22.991 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-09-10T16:29:22.991 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.991 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-09-10T16:29:22.991 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-09-10T16:29:22.991 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-09-10T16:29:22.991 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug trim objects = true 2024-09-10T16:29:22.991 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.991 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-09-10T16:29:22.992 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-09-10T16:29:22.992 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.992 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-09-10T16:29:22.992 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.992 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-09-10T16:29:22.992 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.992 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-09-10T16:29:22.992 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.992 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-09-10T16:29:22.992 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-09-10T16:29:22.993 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.993 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-09-10T16:29:22.993 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-09-10T16:29:22.993 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-09-10T16:29:22.993 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore compression algorithm = zlib 2024-09-10T16:29:22.993 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore compression mode = aggressive 2024-09-10T16:29:22.993 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-09-10T16:29:22.993 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore write v2 = True 2024-09-10T16:29:22.993 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore zero block detection = True 2024-09-10T16:29:22.993 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 20 2024-09-10T16:29:22.993 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 20 2024-09-10T16:29:22.993 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-10T16:29:22.993 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-09-10T16:29:22.993 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 10 2024-09-10T16:29:22.994 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T16:29:22.994 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-09-10T16:29:22.994 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-09-10T16:29:22.994 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify cached snaps = True 2024-09-10T16:29:22.994 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify missing on start = True 2024-09-10T16:29:22.994 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-09-10T16:29:22.994 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock override recovery settings = True 2024-09-10T16:29:22.994 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-09-10T16:29:22.994 INFO:teuthology.orchestra.run.smithi081.stdout: osd op queue = debug_random 2024-09-10T16:29:22.994 INFO:teuthology.orchestra.run.smithi081.stdout: osd op queue cut off = debug_random 2024-09-10T16:29:22.994 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.994 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-09-10T16:29:22.994 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-10T16:29:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-09-10T16:29:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-10T16:29:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-10T16:29:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-10T16:29:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-10T16:29:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-09-10T16:29:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.995 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-09-10T16:29:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-10T16:29:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-10T16:29:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-09-10T16:29:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-10T16:29:22.995 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-09-10T16:29:22.996 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-09-10T16:29:22.996 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-10T16:29:22.996 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-09-10T16:29:22.996 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-09-10T16:29:22.996 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-10T16:29:22.996 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.996 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T16:29:22.996 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T16:29:22.996 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T16:29:22.996 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.996 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T16:29:22.996 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T16:29:22.996 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T16:29:22.996 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-09-10T16:29:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-09-10T16:29:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-09-10T16:29:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: mon min osdmap epochs = 25 2024-09-10T16:29:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: mon osdmap full prune interval = 2 2024-09-10T16:29:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: mon osdmap full prune min = 15 2024-09-10T16:29:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: mon osdmap full prune txsize = 2 2024-09-10T16:29:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: mon scrub inject crc mismatch = 0.01 2024-09-10T16:29:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: mon scrub inject missing keys = 0.05 2024-09-10T16:29:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: mon scrub interval = 300 2024-09-10T16:29:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: paxos min = 10 2024-09-10T16:29:22.997 INFO:teuthology.orchestra.run.smithi081.stdout: paxos service trim min = 5 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: paxos trim min = 10 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: debug monc = 20 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.d] 2024-09-10T16:29:22.998 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.e] 2024-09-10T16:29:22.999 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.f] 2024-09-10T16:29:22.999 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.g] 2024-09-10T16:29:22.999 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.h] 2024-09-10T16:29:22.999 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.i] 2024-09-10T16:29:22.999 INFO:teuthology.orchestra.run.smithi189.stdout:[global] 2024-09-10T16:29:22.999 INFO:teuthology.orchestra.run.smithi189.stdout: chdir = "" 2024-09-10T16:29:22.999 INFO:teuthology.orchestra.run.smithi189.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-10T16:29:23.000 INFO:teuthology.orchestra.run.smithi189.stdout: auth supported = cephx 2024-09-10T16:29:23.000 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.000 INFO:teuthology.orchestra.run.smithi189.stdout: filestore xattr use omap = true 2024-09-10T16:29:23.000 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.000 INFO:teuthology.orchestra.run.smithi189.stdout: mon clock drift allowed = 1.000 2024-09-10T16:29:23.000 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.000 INFO:teuthology.orchestra.run.smithi189.stdout: osd crush chooseleaf type = 0 2024-09-10T16:29:23.000 INFO:teuthology.orchestra.run.smithi189.stdout: auth debug = true 2024-09-10T16:29:23.000 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.000 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on old message = true 2024-09-10T16:29:23.000 INFO:teuthology.orchestra.run.smithi189.stdout: ms die on bug = true 2024-09-10T16:29:23.000 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.000 INFO:teuthology.orchestra.run.smithi189.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-10T16:29:23.001 INFO:teuthology.orchestra.run.smithi189.stdout: mon pg warn max object skew = 0 2024-09-10T16:29:23.001 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.001 INFO:teuthology.orchestra.run.smithi189.stdout: # disable pg_autoscaler by default for new pools 2024-09-10T16:29:23.001 INFO:teuthology.orchestra.run.smithi189.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-10T16:29:23.001 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.001 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default size = 2 2024-09-10T16:29:23.001 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.001 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow primary affinity = true 2024-09-10T16:29:23.001 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd allow pg remap = true 2024-09-10T16:29:23.001 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on legacy crush tunables = false 2024-09-10T16:29:23.001 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on crush straw calc version zero = false 2024-09-10T16:29:23.001 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on no sortbitwise = false 2024-09-10T16:29:23.001 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on osd down out interval zero = false 2024-09-10T16:29:23.001 INFO:teuthology.orchestra.run.smithi189.stdout: mon warn on too few osds = false 2024-09-10T16:29:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-10T16:29:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-10T16:29:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: mon_allow_pool_size_one = true 2024-09-10T16:29:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-10T16:29:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: osd default data pool replay window = 5 2024-09-10T16:29:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: mon allow pool delete = true 2024-09-10T16:29:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: mon cluster log file level = debug 2024-09-10T16:29:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: debug asserts on shutdown = true 2024-09-10T16:29:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: mon health detail to clog = false 2024-09-10T16:29:23.002 INFO:teuthology.orchestra.run.smithi189.stdout: mon host = "[v1:172.21.15.81:6789],[v1:172.21.15.81:6790],[v1:172.21.15.81:6791],[v1:172.21.15.81:6792],[v1:172.21.15.81:6793],[v1:172.21.15.189:6789],[v1:172.21.15.189:6790],[v1:172.21.15.189:6791],[v1:172.21.15.189:6792]" 2024-09-10T16:29:23.003 INFO:teuthology.orchestra.run.smithi189.stdout: mon client directed command retry = 5 2024-09-10T16:29:23.003 INFO:teuthology.orchestra.run.smithi189.stdout: mon election default strategy = 3 2024-09-10T16:29:23.003 INFO:teuthology.orchestra.run.smithi189.stdout: ms bind msgr2 = False 2024-09-10T16:29:23.003 INFO:teuthology.orchestra.run.smithi189.stdout: ms inject socket failures = 5000 2024-09-10T16:29:23.003 INFO:teuthology.orchestra.run.smithi189.stdout: ms type = async 2024-09-10T16:29:23.003 INFO:teuthology.orchestra.run.smithi189.stdout: fsid = 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:23.003 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.003 INFO:teuthology.orchestra.run.smithi189.stdout:[osd] 2024-09-10T16:29:23.003 INFO:teuthology.orchestra.run.smithi189.stdout: osd journal size = 100 2024-09-10T16:29:23.003 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.003 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub load threshold = 5.0 2024-09-10T16:29:23.003 INFO:teuthology.orchestra.run.smithi189.stdout: osd scrub max interval = 600 2024-09-10T16:29:23.003 INFO:teuthology.orchestra.run.smithi189.stdout: osd mclock profile = high_recovery_ops 2024-09-10T16:29:23.003 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.004 INFO:teuthology.orchestra.run.smithi189.stdout: osd recover clone overlap = true 2024-09-10T16:29:23.004 INFO:teuthology.orchestra.run.smithi189.stdout: osd recovery max chunk = 1048576 2024-09-10T16:29:23.004 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.004 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug shutdown = true 2024-09-10T16:29:23.004 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug op order = true 2024-09-10T16:29:23.004 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug verify stray on activate = true 2024-09-10T16:29:23.004 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug trim objects = true 2024-09-10T16:29:23.004 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.004 INFO:teuthology.orchestra.run.smithi189.stdout: osd open classes on start = true 2024-09-10T16:29:23.004 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug pg log writeout = true 2024-09-10T16:29:23.004 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.004 INFO:teuthology.orchestra.run.smithi189.stdout: osd deep scrub update digest min age = 30 2024-09-10T16:29:23.004 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.004 INFO:teuthology.orchestra.run.smithi189.stdout: osd map max advance = 10 2024-09-10T16:29:23.005 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.005 INFO:teuthology.orchestra.run.smithi189.stdout: journal zero on create = true 2024-09-10T16:29:23.005 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.005 INFO:teuthology.orchestra.run.smithi189.stdout: filestore ondisk finisher threads = 3 2024-09-10T16:29:23.005 INFO:teuthology.orchestra.run.smithi189.stdout: filestore apply finisher threads = 3 2024-09-10T16:29:23.005 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.005 INFO:teuthology.orchestra.run.smithi189.stdout: bdev debug aio = true 2024-09-10T16:29:23.005 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug misdirected ops = true 2024-09-10T16:29:23.005 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore block size = 96636764160 2024-09-10T16:29:23.005 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore compression algorithm = zlib 2024-09-10T16:29:23.005 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore compression mode = aggressive 2024-09-10T16:29:23.005 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore fsck on mount = True 2024-09-10T16:29:23.006 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore write v2 = True 2024-09-10T16:29:23.006 INFO:teuthology.orchestra.run.smithi189.stdout: bluestore zero block detection = True 2024-09-10T16:29:23.006 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluefs = 20 2024-09-10T16:29:23.006 INFO:teuthology.orchestra.run.smithi189.stdout: debug bluestore = 20 2024-09-10T16:29:23.006 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-09-10T16:29:23.006 INFO:teuthology.orchestra.run.smithi189.stdout: debug osd = 20 2024-09-10T16:29:23.006 INFO:teuthology.orchestra.run.smithi189.stdout: debug rocksdb = 10 2024-09-10T16:29:23.006 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd backfillfull_ratio = 0.85 2024-09-10T16:29:23.006 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd full ratio = 0.9 2024-09-10T16:29:23.006 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd nearfull ratio = 0.8 2024-09-10T16:29:23.006 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug verify cached snaps = True 2024-09-10T16:29:23.006 INFO:teuthology.orchestra.run.smithi189.stdout: osd debug verify missing on start = True 2024-09-10T16:29:23.007 INFO:teuthology.orchestra.run.smithi189.stdout: osd failsafe full ratio = 0.95 2024-09-10T16:29:23.007 INFO:teuthology.orchestra.run.smithi189.stdout: osd mclock override recovery settings = True 2024-09-10T16:29:23.007 INFO:teuthology.orchestra.run.smithi189.stdout: osd objectstore = bluestore 2024-09-10T16:29:23.007 INFO:teuthology.orchestra.run.smithi189.stdout: osd op queue = debug_random 2024-09-10T16:29:23.007 INFO:teuthology.orchestra.run.smithi189.stdout: osd op queue cut off = debug_random 2024-09-10T16:29:23.007 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.007 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr] 2024-09-10T16:29:23.007 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-09-10T16:29:23.007 INFO:teuthology.orchestra.run.smithi189.stdout: debug mgr = 20 2024-09-10T16:29:23.007 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-09-10T16:29:23.007 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-09-10T16:29:23.007 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-09-10T16:29:23.007 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-09-10T16:29:23.007 INFO:teuthology.orchestra.run.smithi189.stdout: mgr/telemetry/nag = false 2024-09-10T16:29:23.008 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.008 INFO:teuthology.orchestra.run.smithi189.stdout:[mon] 2024-09-10T16:29:23.008 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-09-10T16:29:23.008 INFO:teuthology.orchestra.run.smithi189.stdout: debug mon = 20 2024-09-10T16:29:23.008 INFO:teuthology.orchestra.run.smithi189.stdout: debug paxos = 20 2024-09-10T16:29:23.008 INFO:teuthology.orchestra.run.smithi189.stdout: debug auth = 20 2024-09-10T16:29:23.008 INFO:teuthology.orchestra.run.smithi189.stdout: mon data avail warn = 5 2024-09-10T16:29:23.008 INFO:teuthology.orchestra.run.smithi189.stdout: mon mgr mkfs grace = 240 2024-09-10T16:29:23.008 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min pgs per osd = 4 2024-09-10T16:29:23.008 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd reporter subtree level = osd 2024-09-10T16:29:23.008 INFO:teuthology.orchestra.run.smithi189.stdout: mon osd prime pg temp = true 2024-09-10T16:29:23.008 INFO:teuthology.orchestra.run.smithi189.stdout: mon reweight min bytes per osd = 10 2024-09-10T16:29:23.009 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.009 INFO:teuthology.orchestra.run.smithi189.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-10T16:29:23.009 INFO:teuthology.orchestra.run.smithi189.stdout: auth mon ticket ttl = 660 # 11m 2024-09-10T16:29:23.009 INFO:teuthology.orchestra.run.smithi189.stdout: auth service ticket ttl = 240 # 4m 2024-09-10T16:29:23.009 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.009 INFO:teuthology.orchestra.run.smithi189.stdout: # don't complain about insecure global_id in the test suite 2024-09-10T16:29:23.009 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-10T16:29:23.009 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-10T16:29:23.009 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.009 INFO:teuthology.orchestra.run.smithi189.stdout: # 1m isn't quite enough 2024-09-10T16:29:23.009 INFO:teuthology.orchestra.run.smithi189.stdout: mon_down_mkfs_grace = 2m 2024-09-10T16:29:23.009 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.009 INFO:teuthology.orchestra.run.smithi189.stdout: mon_warn_on_filestore_osds = false 2024-09-10T16:29:23.010 INFO:teuthology.orchestra.run.smithi189.stdout: mon min osdmap epochs = 25 2024-09-10T16:29:23.010 INFO:teuthology.orchestra.run.smithi189.stdout: mon osdmap full prune interval = 2 2024-09-10T16:29:23.010 INFO:teuthology.orchestra.run.smithi189.stdout: mon osdmap full prune min = 15 2024-09-10T16:29:23.010 INFO:teuthology.orchestra.run.smithi189.stdout: mon osdmap full prune txsize = 2 2024-09-10T16:29:23.010 INFO:teuthology.orchestra.run.smithi189.stdout: mon scrub inject crc mismatch = 0.01 2024-09-10T16:29:23.010 INFO:teuthology.orchestra.run.smithi189.stdout: mon scrub inject missing keys = 0.05 2024-09-10T16:29:23.010 INFO:teuthology.orchestra.run.smithi189.stdout: mon scrub interval = 300 2024-09-10T16:29:23.010 INFO:teuthology.orchestra.run.smithi189.stdout: paxos min = 10 2024-09-10T16:29:23.010 INFO:teuthology.orchestra.run.smithi189.stdout: paxos service trim min = 5 2024-09-10T16:29:23.010 INFO:teuthology.orchestra.run.smithi189.stdout: paxos trim min = 10 2024-09-10T16:29:23.010 INFO:teuthology.orchestra.run.smithi189.stdout: 2024-09-10T16:29:23.010 INFO:teuthology.orchestra.run.smithi189.stdout:[client] 2024-09-10T16:29:23.010 INFO:teuthology.orchestra.run.smithi189.stdout: rgw cache enabled = true 2024-09-10T16:29:23.010 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable ops log = true 2024-09-10T16:29:23.011 INFO:teuthology.orchestra.run.smithi189.stdout: rgw enable usage log = true 2024-09-10T16:29:23.011 INFO:teuthology.orchestra.run.smithi189.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-10T16:29:23.011 INFO:teuthology.orchestra.run.smithi189.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-10T16:29:23.011 INFO:teuthology.orchestra.run.smithi189.stdout: debug monc = 20 2024-09-10T16:29:23.011 INFO:teuthology.orchestra.run.smithi189.stdout: debug ms = 1 2024-09-10T16:29:23.011 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.a] 2024-09-10T16:29:23.011 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.b] 2024-09-10T16:29:23.011 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.c] 2024-09-10T16:29:23.011 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.d] 2024-09-10T16:29:23.011 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.e] 2024-09-10T16:29:23.011 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.f] 2024-09-10T16:29:23.011 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.g] 2024-09-10T16:29:23.011 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.h] 2024-09-10T16:29:23.011 INFO:teuthology.orchestra.run.smithi189.stdout:[mon.i] 2024-09-10T16:29:23.013 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-10T16:29:23.013 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-10T16:29:23.105 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-10T16:29:23.106 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:23.106 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-10T16:29:23.110 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:23.110 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-10T16:29:23.157 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T16:29:23.158 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:23.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T16:29:23.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T16:29:23.221 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:23.221 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T16:29:23.269 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T16:29:23.269 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:23.269 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-10T16:29:23.269 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-10T16:29:23.293 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:23.293 DEBUG:teuthology.orchestra.run.smithi189:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-10T16:29:23.342 INFO:tasks.ceph:Setting up mon nodes... 2024-09-10T16:29:23.342 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-10T16:29:23.342 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T16:29:23.429 INFO:teuthology.orchestra.run.smithi189.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-10T16:29:23.452 INFO:tasks.ceph:Setting up mds nodes... 2024-09-10T16:29:23.453 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-10T16:29:23.453 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-10T16:29:23.486 INFO:teuthology.orchestra.run.smithi189.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-10T16:29:23.497 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-10T16:29:23.497 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'}, Remote(name='ubuntu@smithi189.front.sepia.ceph.com'): {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'}} 2024-09-10T16:29:23.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-10T16:29:23.510 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-10T16:29:23.510 INFO:tasks.ceph:role: osd.0 2024-09-10T16:29:23.511 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T16:29:23.511 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T16:29:23.572 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T16:29:23.572 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T16:29:23.573 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T16:29:23.573 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T16:29:23.573 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T16:29:23.573 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-10T16:29:23.573 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T16:29:23.573 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T16:29:23.573 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T16:29:23.573 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T16:29:24.027 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-10T16:29:24.029 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-10T16:29:24.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-10T16:29:24.124 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-10T16:29:24.134 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T16:29:24.134 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T16:29:24.135 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-10T16:29:24.186 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-10T16:29:24.186 INFO:tasks.ceph:role: osd.1 2024-09-10T16:29:24.187 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T16:29:24.187 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T16:29:24.250 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T16:29:24.250 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T16:29:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T16:29:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T16:29:24.251 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T16:29:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-10T16:29:24.251 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T16:29:24.251 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T16:29:24.251 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T16:29:24.251 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T16:29:24.728 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-10T16:29:24.730 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-10T16:29:24.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-10T16:29:24.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-10T16:29:24.900 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T16:29:24.901 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T16:29:24.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-10T16:29:24.960 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3'} 2024-09-10T16:29:24.960 INFO:tasks.ceph:role: osd.2 2024-09-10T16:29:24.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T16:29:24.961 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T16:29:25.029 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T16:29:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T16:29:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T16:29:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T16:29:25.029 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T16:29:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-10T16:29:25.029 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T16:29:25.029 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T16:29:25.029 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T16:29:25.029 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T16:29:25.499 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-10T16:29:25.501 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-10T16:29:25.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-10T16:29:25.641 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-10T16:29:25.652 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T16:29:25.653 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T16:29:25.653 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T16:29:25.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:25.771+0000 7f64841b87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-10T16:29:25.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:25.771+0000 7f64841b87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-10T16:29:25.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:25.771+0000 7f64841b87c0 -1 bdev(0x55d2d6ea5800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-10T16:29:25.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:25.771+0000 7f64841b87c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-10T16:29:28.957 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-10T16:29:28.970 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T16:29:29.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:29.047+0000 7fe837f937c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-10T16:29:29.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:29.047+0000 7fe837f937c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-10T16:29:29.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:29.047+0000 7fe837f937c0 -1 bdev(0x5586516e9800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-10T16:29:29.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:29.047+0000 7fe837f937c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-10T16:29:32.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-10T16:29:32.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T16:29:32.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:32.335+0000 7fde5c3fa7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-10T16:29:32.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:32.335+0000 7fde5c3fa7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-10T16:29:32.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:32.335+0000 7fde5c3fa7c0 -1 bdev(0x5649ff1a1800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-10T16:29:32.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:32.335+0000 7fde5c3fa7c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-10T16:29:35.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-10T16:29:35.530 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-10T16:29:35.546 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-10T16:29:35.546 INFO:tasks.ceph:role: osd.3 2024-09-10T16:29:35.546 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T16:29:35.546 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-10T16:29:35.608 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T16:29:35.609 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T16:29:35.609 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T16:29:35.609 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T16:29:35.609 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T16:29:35.609 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-09-10T16:29:35.609 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T16:29:35.609 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T16:29:35.609 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T16:29:35.609 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T16:29:36.085 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-09-10T16:29:36.087 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-09-10T16:29:36.087 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-3 2024-09-10T16:29:36.235 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-10T16:29:36.247 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T16:29:36.247 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T16:29:36.247 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-10T16:29:36.301 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-10T16:29:36.301 INFO:tasks.ceph:role: osd.4 2024-09-10T16:29:36.301 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T16:29:36.301 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-10T16:29:36.364 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T16:29:36.364 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T16:29:36.364 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T16:29:36.364 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T16:29:36.364 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T16:29:36.364 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-09-10T16:29:36.364 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T16:29:36.365 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T16:29:36.365 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T16:29:36.365 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T16:29:36.786 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-09-10T16:29:36.788 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-09-10T16:29:36.788 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-4 2024-09-10T16:29:36.850 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-10T16:29:36.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T16:29:36.904 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T16:29:36.904 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-10T16:29:36.957 INFO:tasks.ceph:roles_to_devs: {'osd.3': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_2', 'osd.5': '/dev/vg_nvme/lv_3'} 2024-09-10T16:29:36.958 INFO:tasks.ceph:role: osd.5 2024-09-10T16:29:36.958 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T16:29:36.958 DEBUG:teuthology.orchestra.run.smithi189:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-10T16:29:37.021 INFO:teuthology.orchestra.run.smithi189.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-10T16:29:37.021 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-10T16:29:37.021 INFO:teuthology.orchestra.run.smithi189.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-10T16:29:37.021 INFO:teuthology.orchestra.run.smithi189.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-10T16:29:37.021 INFO:teuthology.orchestra.run.smithi189.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-10T16:29:37.021 INFO:teuthology.orchestra.run.smithi189.stdout: = sunit=0 swidth=0 blks 2024-09-10T16:29:37.021 INFO:teuthology.orchestra.run.smithi189.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-10T16:29:37.021 INFO:teuthology.orchestra.run.smithi189.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-10T16:29:37.022 INFO:teuthology.orchestra.run.smithi189.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-10T16:29:37.022 INFO:teuthology.orchestra.run.smithi189.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-10T16:29:37.500 INFO:teuthology.orchestra.run.smithi189.stdout:Discarding blocks...Done. 2024-09-10T16:29:37.502 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi189.front.sepia.ceph.com -o noatime 2024-09-10T16:29:37.502 DEBUG:teuthology.orchestra.run.smithi189:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-5 2024-09-10T16:29:37.608 DEBUG:teuthology.orchestra.run.smithi189:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-10T16:29:37.619 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T16:29:37.620 INFO:teuthology.orchestra.run.smithi189.stderr:sudo: /sbin/restorecon: command not found 2024-09-10T16:29:37.620 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T16:29:37.738 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:37.738+0000 7fba566437c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-10T16:29:37.743 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:37.742+0000 7fba566437c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-10T16:29:37.743 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:37.742+0000 7fba566437c0 -1 bdev(0x55f1c5241800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-10T16:29:37.743 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:37.742+0000 7fba566437c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-10T16:29:40.899 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-10T16:29:40.913 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T16:29:40.995 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:40.994+0000 7fced11c67c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-10T16:29:40.995 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:40.994+0000 7fced11c67c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-10T16:29:40.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:40.994+0000 7fced11c67c0 -1 bdev(0x559420429800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-10T16:29:40.996 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:40.994+0000 7fced11c67c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-10T16:29:44.110 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-10T16:29:44.165 DEBUG:teuthology.orchestra.run.smithi189:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-10T16:29:44.250 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:44.250+0000 7fa918ae87c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-10T16:29:44.251 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:44.250+0000 7fa918ae87c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-10T16:29:44.251 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:44.250+0000 7fa918ae87c0 -1 bdev(0x565316a1d800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-10T16:29:44.251 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:44.250+0000 7fa918ae87c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-10T16:29:47.395 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-10T16:29:47.450 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-10T16:29:47.450 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:47.450 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-10T16:29:47.465 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:47.465 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-10T16:29:47.519 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:47.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-10T16:29:47.572 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:47.572 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-10T16:29:47.585 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:47.585 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-10T16:29:47.640 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:47.640 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-10T16:29:47.693 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:47.693 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-10T16:29:47.749 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:47.749 DEBUG:teuthology.orchestra.run.smithi189:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-10T16:29:47.797 INFO:tasks.ceph:Adding keys to all mons... 2024-09-10T16:29:47.798 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T16:29:47.800 DEBUG:teuthology.orchestra.run.smithi189:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-10T16:29:47.843 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2024-09-10T16:29:47.843 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDlc+BmsFMwLhAAO8CVHVQVWjwr58DFIMY6DQ== 2024-09-10T16:29:47.843 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2024-09-10T16:29:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDpc+BmcIYUAxAABbX3OsEteTzXJyi6A0B8qQ== 2024-09-10T16:29:47.844 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2024-09-10T16:29:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDsc+BmBkE7FBAAf8B7zJKHzrNFCI4S0dKTxg== 2024-09-10T16:29:47.844 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2024-09-10T16:29:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDjc+BmBDOuGRAAHcu5bt/AwAR29iiVLo7W3A== 2024-09-10T16:29:47.844 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2024-09-10T16:29:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDxc+Bmr4EjLBAAIz4jlh8YlC87DN63+9lmHA== 2024-09-10T16:29:47.844 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2024-09-10T16:29:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD0c+BmIU1tOxAAtPDjAtXUqROhr/+/aqo9yQ== 2024-09-10T16:29:47.844 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2024-09-10T16:29:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD4c+BmbNQCDxAAAF8kg/9iUah+u/eM4hnoOg== 2024-09-10T16:29:47.844 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-10T16:29:47.844 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQDjc+Bm/xAXHRAAY+pz4YEgH8igua/ZalY2Qw== 2024-09-10T16:29:47.852 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.0] 2024-09-10T16:29:47.852 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDlc+BmsFMwLhAAO8CVHVQVWjwr58DFIMY6DQ== 2024-09-10T16:29:47.852 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.1] 2024-09-10T16:29:47.852 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDpc+BmcIYUAxAABbX3OsEteTzXJyi6A0B8qQ== 2024-09-10T16:29:47.852 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.2] 2024-09-10T16:29:47.852 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDsc+BmBkE7FBAAf8B7zJKHzrNFCI4S0dKTxg== 2024-09-10T16:29:47.852 INFO:teuthology.orchestra.run.smithi189.stdout:[mgr.x] 2024-09-10T16:29:47.852 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDjc+BmBDOuGRAAHcu5bt/AwAR29iiVLo7W3A== 2024-09-10T16:29:47.852 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.3] 2024-09-10T16:29:47.852 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDxc+Bmr4EjLBAAIz4jlh8YlC87DN63+9lmHA== 2024-09-10T16:29:47.852 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.4] 2024-09-10T16:29:47.852 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQD0c+BmIU1tOxAAtPDjAtXUqROhr/+/aqo9yQ== 2024-09-10T16:29:47.853 INFO:teuthology.orchestra.run.smithi189.stdout:[osd.5] 2024-09-10T16:29:47.853 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQD4c+BmbNQCDxAAAF8kg/9iUah+u/eM4hnoOg== 2024-09-10T16:29:47.853 INFO:teuthology.orchestra.run.smithi189.stdout:[client.0] 2024-09-10T16:29:47.853 INFO:teuthology.orchestra.run.smithi189.stdout: key = AQDjc+Bm/xAXHRAAY+pz4YEgH8igua/ZalY2Qw== 2024-09-10T16:29:47.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T16:29:47.890 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T16:29:47.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T16:29:47.944 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T16:29:48.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T16:29:48.030 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T16:29:48.109 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T16:29:48.111 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-10T16:29:48.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T16:29:48.200 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T16:29:48.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T16:29:48.286 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T16:29:48.330 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T16:29:48.370 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-10T16:29:48.418 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T16:29:48.454 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-10T16:29:48.499 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-10T16:29:48.500 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-10T16:29:48.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T16:29:48.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-10T16:29:48.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-10T16:29:48.712 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T16:29:48.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-10T16:29:48.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-10T16:29:48.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T16:29:48.955 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-10T16:29:48.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-d 2024-09-10T16:29:49.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i d --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T16:29:49.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-d 2024-09-10T16:29:49.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-e 2024-09-10T16:29:49.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i e --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T16:29:49.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-e 2024-09-10T16:29:49.279 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mon/ceph-f 2024-09-10T16:29:49.294 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i f --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T16:29:49.387 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-f 2024-09-10T16:29:49.399 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mon/ceph-g 2024-09-10T16:29:49.454 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i g --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T16:29:49.542 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-g 2024-09-10T16:29:49.552 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mon/ceph-h 2024-09-10T16:29:49.610 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i h --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T16:29:49.696 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-h 2024-09-10T16:29:49.748 DEBUG:teuthology.orchestra.run.smithi189:> sudo mkdir -p /var/lib/ceph/mon/ceph-i 2024-09-10T16:29:49.800 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i i --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-10T16:29:49.892 DEBUG:teuthology.orchestra.run.smithi189:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-i 2024-09-10T16:29:49.902 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T16:29:49.905 DEBUG:teuthology.orchestra.run.smithi189:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-10T16:29:49.949 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-10T16:29:49.949 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-10T16:29:49.950 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-10T16:29:49.953 INFO:tasks.ceph.mon.a:Started 2024-09-10T16:29:49.954 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T16:29:49.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T16:29:49.956 INFO:tasks.ceph.mon.b:Started 2024-09-10T16:29:49.956 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T16:29:49.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T16:29:49.958 INFO:tasks.ceph.mon.c:Started 2024-09-10T16:29:49.958 INFO:tasks.ceph.mon.d:Restarting daemon 2024-09-10T16:29:49.959 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-09-10T16:29:49.961 INFO:tasks.ceph.mon.d:Started 2024-09-10T16:29:49.961 INFO:tasks.ceph.mon.e:Restarting daemon 2024-09-10T16:29:49.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i e 2024-09-10T16:29:49.963 INFO:tasks.ceph.mon.e:Started 2024-09-10T16:29:49.964 INFO:tasks.ceph.mon.f:Restarting daemon 2024-09-10T16:29:49.964 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-09-10T16:29:49.994 INFO:tasks.ceph.mon.f:Started 2024-09-10T16:29:49.995 INFO:tasks.ceph.mon.g:Restarting daemon 2024-09-10T16:29:49.995 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-09-10T16:29:49.997 INFO:tasks.ceph.mon.g:Started 2024-09-10T16:29:49.997 INFO:tasks.ceph.mon.h:Restarting daemon 2024-09-10T16:29:49.997 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2024-09-10T16:29:50.000 INFO:tasks.ceph.mon.h:Started 2024-09-10T16:29:50.000 INFO:tasks.ceph.mon.i:Restarting daemon 2024-09-10T16:29:50.000 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-09-10T16:29:50.002 INFO:tasks.ceph.mon.i:Started 2024-09-10T16:29:50.003 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-10T16:29:50.003 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-10T16:29:50.003 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-10T16:29:50.005 INFO:tasks.ceph.mgr.x:Started 2024-09-10T16:29:50.005 DEBUG:tasks.ceph:set 0 configs 2024-09-10T16:29:50.005 INFO:tasks.ceph:Setting crush tunables to default 2024-09-10T16:29:50.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2024-09-10T16:29:50.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.127+0000 7fe29000c640 10 monclient: get_monmap_and_config 2024-09-10T16:29:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.127+0000 7fe29000c640 10 monclient: build_initial_monmap 2024-09-10T16:29:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.127+0000 7fe29000c640 10 monclient: monmap: 2024-09-10T16:29:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:29:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:50.133721+0000 2024-09-10T16:29:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:50.133721+0000 2024-09-10T16:29:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:50.134 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:50.135 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe29000c640 1 Processor -- start 2024-09-10T16:29:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe29000c640 1 -- start start 2024-09-10T16:29:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe29000c640 10 monclient: init 2024-09-10T16:29:50.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe29000c640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe29000c640 10 monclient: _add_conns ranks=[4,2,1,0,5,3,8,6,7] 2024-09-10T16:29:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe29000c640 10 monclient(hunting): picked mon.noname-c con 0x7fe288073db0 addr v1:172.21.15.81:6791/0 2024-09-10T16:29:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe29000c640 10 monclient(hunting): picked mon.noname-b con 0x7fe288136a40 addr v1:172.21.15.81:6790/0 2024-09-10T16:29:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe29000c640 10 monclient(hunting): picked mon.noname-f con 0x7fe28813d4e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:29:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe29000c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe28809dc00 con 0x7fe28813d4e0 2024-09-10T16:29:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe29000c640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe28809dee0 con 0x7fe288136a40 2024-09-10T16:29:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe29000c640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe28809d090 con 0x7fe288073db0 2024-09-10T16:29:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe29000c640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe29000c640 10 monclient(hunting): authenticate will time out at 957.532841s 2024-09-10T16:29:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe28d5a7640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fe288136a40 0x7fe28813bdc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:59082/0 (socket says 172.21.15.81:59082) 2024-09-10T16:29:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe28d5a7640 1 -- 172.21.15.81:0/4126739078 learned_addr learned my addr 172.21.15.81:0/4126739078 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:29:50.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:50.131+0000 7fe28dda8640 1 --1- 172.21.15.81:0/4126739078 >> v1:172.21.15.81:6791/0 conn(0x7fe288073db0 0x7fe2880a4640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:55638/0 (socket says 172.21.15.81:55638) 2024-09-10T16:29:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 10 monclient(hunting): tick 2024-09-10T16:29:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 10 monclient(hunting): _check_auth_tickets 2024-09-10T16:29:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 1 monclient(hunting): continuing hunt 2024-09-10T16:29:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 10 monclient(hunting): _reopen_session rank -1 2024-09-10T16:29:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 1 -- 172.21.15.81:0/4126739078 >> v1:172.21.15.81:6791/0 conn(0x7fe288073db0 legacy=0x7fe2880a4640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 1 -- 172.21.15.81:0/4126739078 >> v1:172.21.15.81:6790/0 conn(0x7fe288136a40 legacy=0x7fe28813bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 1 -- 172.21.15.81:0/4126739078 >> v1:172.21.15.189:6789/0 conn(0x7fe28813d4e0 legacy=0x7fe28813f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 10 monclient: _add_conns ranks=[0,3,7,5,8,6] 2024-09-10T16:29:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 10 monclient(hunting): picked mon.noname-a con 0x7fe26c0037f0 addr v1:172.21.15.81:6789/0 2024-09-10T16:29:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 10 monclient(hunting): picked mon.noname-g con 0x7fe26c007480 addr v1:172.21.15.189:6790/0 2024-09-10T16:29:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 10 monclient(hunting): picked mon.noname-i con 0x7fe26c00b1d0 addr v1:172.21.15.189:6792/0 2024-09-10T16:29:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 1 -- 172.21.15.81:0/4126739078 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2880a4d50 con 0x7fe26c0037f0 2024-09-10T16:29:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 1 -- 172.21.15.81:0/4126739078 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe26c00fff0 con 0x7fe26c007480 2024-09-10T16:29:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 1 -- 172.21.15.81:0/4126739078 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe26c011290 con 0x7fe26c00b1d0 2024-09-10T16:29:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:53.131+0000 7fe27f7fe640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:55.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.279+0000 7fe28cda6640 1 -- 172.21.15.81:0/4126739078 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2090813014 0 0) 0x7fe26c00fff0 con 0x7fe26c007480 2024-09-10T16:29:55.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.279+0000 7fe28cda6640 10 monclient(hunting): _negotiate 2024-09-10T16:29:55.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.279+0000 7fe28cda6640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:55.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.279+0000 7fe28cda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:55.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.279+0000 7fe28cda6640 10 monclient(hunting): my global_id is 4107 2024-09-10T16:29:55.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.279+0000 7fe28cda6640 1 -- 172.21.15.81:0/4126739078 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe274003530 con 0x7fe26c007480 2024-09-10T16:29:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.279+0000 7fe28cda6640 1 -- 172.21.15.81:0/4126739078 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3733763035 0 0) 0x7fe2880a4d50 con 0x7fe26c0037f0 2024-09-10T16:29:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.279+0000 7fe28cda6640 10 monclient(hunting): _negotiate 2024-09-10T16:29:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.279+0000 7fe28cda6640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.279+0000 7fe28cda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.279+0000 7fe28cda6640 10 monclient(hunting): my global_id is 4104 2024-09-10T16:29:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.279+0000 7fe28cda6640 1 -- 172.21.15.81:0/4126739078 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe26c00fff0 con 0x7fe26c0037f0 2024-09-10T16:29:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 1 -- 172.21.15.81:0/4126739078 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1755107761 0 0) 0x7fe26c011290 con 0x7fe26c00b1d0 2024-09-10T16:29:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient(hunting): _negotiate 2024-09-10T16:29:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient(hunting): my global_id is 4111 2024-09-10T16:29:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 1 -- 172.21.15.81:0/4126739078 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2880a4d50 con 0x7fe26c00b1d0 2024-09-10T16:29:55.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 1 -- 172.21.15.81:0/4126739078 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2572707917 0 0) 0x7fe274003530 con 0x7fe26c007480 2024-09-10T16:29:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 1 -- 172.21.15.81:0/4126739078 >> v1:172.21.15.189:6792/0 conn(0x7fe26c00b1d0 legacy=0x7fe26c00d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 1 -- 172.21.15.81:0/4126739078 >> v1:172.21.15.81:6789/0 conn(0x7fe26c0037f0 legacy=0x7fe26c005c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient: _finish_hunting 0 2024-09-10T16:29:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 1 monclient: found mon.noname-g 2024-09-10T16:29:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.189:6790/0 2024-09-10T16:29:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 1 -- 172.21.15.81:0/4126739078 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe26c012530 con 0x7fe26c007480 2024-09-10T16:29:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient: _finish_auth 0 2024-09-10T16:29:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient: _check_auth_tickets 2024-09-10T16:29:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 1 -- 172.21.15.81:0/4126739078 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fe278001880 con 0x7fe26c007480 2024-09-10T16:29:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-10T16:29:55.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient: dump: 2024-09-10T16:29:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:29:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:55.288 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:55.289 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:55.289 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:55.289 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:55.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe29000c640 5 monclient: authenticate success, global_id 4107 2024-09-10T16:29:55.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe29000c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:29:55.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28e5a9640 1 -- 172.21.15.81:0/4126739078 reap_dead start 2024-09-10T16:29:55.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 1 -- 172.21.15.81:0/4126739078 <== mon.3 v1:172.21.15.189:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe278001a90 con 0x7fe26c007480 2024-09-10T16:29:55.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:55.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe29000c640 10 monclient: get_monmap_and_config success 2024-09-10T16:29:55.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 1 -- 172.21.15.81:0/4126739078 <== mon.3 v1:172.21.15.189:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fe278004bf0 con 0x7fe26c007480 2024-09-10T16:29:55.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe29000c640 4 set_mon_vals no callback set 2024-09-10T16:29:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:29:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe28cda6640 10 monclient: dump: 2024-09-10T16:29:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:29:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:55.295 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe29000c640 10 monclient: shutdown 2024-09-10T16:29:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe29000c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe29000c640 1 -- 172.21.15.81:0/4126739078 >> v1:172.21.15.189:6790/0 conn(0x7fe26c007480 legacy=0x7fe26c009900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe29000c640 1 -- 172.21.15.81:0/4126739078 shutdown_connections 2024-09-10T16:29:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe29000c640 1 -- 172.21.15.81:0/4126739078 >> 172.21.15.81:0/4126739078 conn(0x7fe2880a8cf0 msgr2=0x7fe2880a51f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe29000c640 1 -- 172.21.15.81:0/4126739078 shutdown_connections 2024-09-10T16:29:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.283+0000 7fe29000c640 1 -- 172.21.15.81:0/4126739078 wait complete. 2024-09-10T16:29:55.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 10 monclient: build_initial_monmap 2024-09-10T16:29:55.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 10 monclient: monmap: 2024-09-10T16:29:55.296 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:29:55.296 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:29:55.296 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:29:55.296 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:29:55.296 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:55.296 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:29:55.296 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:55.296 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:55.296 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:55.296 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:55.296 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:55.297 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 1 Processor -- start 2024-09-10T16:29:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 1 -- start start 2024-09-10T16:29:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 10 monclient: init 2024-09-10T16:29:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 10 monclient: _add_conns ranks=[2,6,4,8,7,1,3,0,5] 2024-09-10T16:29:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 10 monclient(hunting): picked mon.noname-b con 0x7fe26c007480 addr v1:172.21.15.81:6790/0 2024-09-10T16:29:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 10 monclient(hunting): picked mon.noname-d con 0x7fe2880a3fc0 addr v1:172.21.15.81:6792/0 2024-09-10T16:29:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 10 monclient(hunting): picked mon.noname-c con 0x7fe2881cdb80 addr v1:172.21.15.81:6791/0 2024-09-10T16:29:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe288133f80 con 0x7fe26c007480 2024-09-10T16:29:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2881363e0 con 0x7fe2881cdb80 2024-09-10T16:29:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2881ce230 con 0x7fe2880a3fc0 2024-09-10T16:29:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe28d5a7640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fe2880a3fc0 0x7fe2881d2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:35104/0 (socket says 172.21.15.81:35104) 2024-09-10T16:29:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe28d5a7640 1 -- 172.21.15.81:0/1293175529 learned_addr learned my addr 172.21.15.81:0/1293175529 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:29:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.287+0000 7fe29000c640 10 monclient(hunting): authenticate will time out at 962.691611s 2024-09-10T16:29:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3989915162 0 0) 0x7fe2881ce230 con 0x7fe2880a3fc0 2024-09-10T16:29:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:29:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): my global_id is 4110 2024-09-10T16:29:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe26c009000 con 0x7fe2880a3fc0 2024-09-10T16:29:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe28d5a7640 1 -- 172.21.15.81:0/1293175529 >> v1:172.21.15.81:6792/0 conn(0x7fe2880a3fc0 legacy=0x7fe2881d2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T16:29:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe28d5a7640 1 -- 172.21.15.81:0/1293175529 >> v1:172.21.15.81:6792/0 conn(0x7fe2880a3fc0 legacy=0x7fe2881d2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T16:29:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe28d5a7640 1 --1- 172.21.15.81:0/1293175529 >> v1:172.21.15.81:6792/0 conn(0x7fe2880a3fc0 0x7fe2881d2ee0 :-1 s=OPENED pgs=27 cs=1 l=1).handle_message read tag failed 2024-09-10T16:29:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe28d5a7640 1 --1- 172.21.15.81:0/1293175529 >> v1:172.21.15.81:6792/0 conn(0x7fe2880a3fc0 0x7fe2881d2ee0 :-1 s=OPENED pgs=27 cs=1 l=1).fault on lossy channel, failing 2024-09-10T16:29:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.81:6792/0 2024-09-10T16:29:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2157931677 0 0) 0x7fe2880a4d50 con 0x7fe2881cdb80 2024-09-10T16:29:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:29:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): my global_id is 4108 2024-09-10T16:29:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2881ce230 con 0x7fe2881cdb80 2024-09-10T16:29:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4060305988 0 0) 0x7fe2881ce230 con 0x7fe2881cdb80 2024-09-10T16:29:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe2880a4d50 con 0x7fe2881cdb80 2024-09-10T16:29:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fe280001cf0 con 0x7fe2881cdb80 2024-09-10T16:29:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:29:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): dump: 2024-09-10T16:29:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:29:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:55.301 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:29:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1727029460 0 0) 0x7fe288133f80 con 0x7fe26c007480 2024-09-10T16:29:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:29:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): my global_id is 4106 2024-09-10T16:29:55.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe2881ce230 con 0x7fe26c007480 2024-09-10T16:29:55.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2162616849 0 0) 0x7fe2881ce230 con 0x7fe26c007480 2024-09-10T16:29:55.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe288133f80 con 0x7fe26c007480 2024-09-10T16:29:55.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fe2840019a0 con 0x7fe26c007480 2024-09-10T16:29:55.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:55.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:29:55.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.291+0000 7fe27e7fc640 10 monclient(hunting): dump: 2024-09-10T16:29:55.304 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:29:55.304 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:55.304 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:55.305 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:55.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 696589313 0 0) 0x7fe2880a4d50 con 0x7fe2881cdb80 2024-09-10T16:29:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 >> v1:172.21.15.81:6792/0 conn(0x7fe2880a3fc0 legacy=0x7fe2881d2ee0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:29:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 >> v1:172.21.15.81:6790/0 conn(0x7fe26c007480 legacy=0x7fe2880a38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:29:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 1 monclient: found mon.c 2024-09-10T16:29:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:29:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2880a0360 con 0x7fe2881cdb80 2024-09-10T16:29:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 10 monclient: _finish_auth 0 2024-09-10T16:29:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:29:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe29000c640 5 monclient: authenticate success, global_id 4108 2024-09-10T16:29:55.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe29000c640 10 monclient: _renew_subs 2024-09-10T16:29:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe29000c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:29:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe29000c640 1 -- 172.21.15.81:0/1293175529 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe28809f020 con 0x7fe2881cdb80 2024-09-10T16:29:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe29000c640 10 monclient: _renew_subs 2024-09-10T16:29:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe29000c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:29:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe29000c640 1 -- 172.21.15.81:0/1293175529 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fe28809eb60 con 0x7fe2881cdb80 2024-09-10T16:29:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe280004b00 con 0x7fe2881cdb80 2024-09-10T16:29:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fe280004ff0 con 0x7fe2881cdb80 2024-09-10T16:29:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:29:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27f7fe640 4 set_mon_vals no callback set 2024-09-10T16:29:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 10 monclient: dump: 2024-09-10T16:29:55.307 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:29:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:55.308 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:55.309 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7fe280005520 con 0x7fe2881cdb80 2024-09-10T16:29:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (unknown 1606446608 0 0) 0x7fe280006a20 con 0x7fe2881cdb80 2024-09-10T16:29:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe29000c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe29000c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe29000c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:29:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.295+0000 7fe29000c640 1 -- 172.21.15.81:0/1293175529 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe270005090 con 0x7fe2881cdb80 2024-09-10T16:29:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.299+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7fe2881363e0 con 0x7fe2881cdb80 2024-09-10T16:29:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.299+0000 7fe27e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:55.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.299+0000 7fe27e7fc640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:29:55.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.379+0000 7fe29000c640 10 start_mon_command cmd=[{"prefix": "osd crush tunables", "profile": "default"}] 2024-09-10T16:29:55.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.379+0000 7fe29000c640 10 monclient: _send_command 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-09-10T16:29:55.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.379+0000 7fe29000c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:29:55.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.379+0000 7fe29000c640 1 -- 172.21.15.81:0/1293175529 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fe270005380 con 0x7fe2881cdb80 2024-09-10T16:29:55.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.391+0000 7fe27e7fc640 1 -- 172.21.15.81:0/1293175529 <== mon.4 v1:172.21.15.81:6791/0 10 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (unknown 2277712955 0 0) 0x7fe280005a60 con 0x7fe2881cdb80 2024-09-10T16:29:55.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.391+0000 7fe27e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd crush tunables", "profile": "default"}] 2024-09-10T16:29:55.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.391+0000 7fe27e7fc640 10 monclient: _finish_command 2 = system:0 adjusted tunables profile to default 2024-09-10T16:29:55.393 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-09-10T16:29:55.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.391+0000 7fe29000c640 10 monclient: shutdown 2024-09-10T16:29:55.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.391+0000 7fe29000c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:55.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.391+0000 7fe29000c640 1 -- 172.21.15.81:0/1293175529 >> v1:172.21.15.81:6791/0 conn(0x7fe2881cdb80 legacy=0x7fe2881d6610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:55.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.391+0000 7fe29000c640 1 -- 172.21.15.81:0/1293175529 shutdown_connections 2024-09-10T16:29:55.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.391+0000 7fe29000c640 1 -- 172.21.15.81:0/1293175529 >> 172.21.15.81:0/1293175529 conn(0x7fe2880a8cf0 msgr2=0x7fe288135090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:55.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.391+0000 7fe29000c640 1 -- 172.21.15.81:0/1293175529 shutdown_connections 2024-09-10T16:29:55.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:55.391+0000 7fe29000c640 1 -- 172.21.15.81:0/1293175529 wait complete. 2024-09-10T16:29:55.410 INFO:tasks.ceph:check_enable_crimson: False 2024-09-10T16:29:55.411 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-10T16:29:55.411 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:55.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-10T16:29:55.422 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:55.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-10T16:29:55.474 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-10T16:29:55.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-10T16:29:55.527 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:55.527 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-10T16:29:55.541 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:55.541 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-10T16:29:55.596 DEBUG:teuthology.orchestra.run.smithi189:> set -ex 2024-09-10T16:29:55.596 DEBUG:teuthology.orchestra.run.smithi189:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-10T16:29:55.652 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new c68b183d-5af0-4465-bf0b-1b1410e7a5c3 0 2024-09-10T16:29:55.819 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 10 monclient: get_monmap_and_config 2024-09-10T16:29:55.819 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 10 monclient: build_initial_monmap 2024-09-10T16:29:55.819 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 10 monclient: monmap: 2024-09-10T16:29:55.819 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 0 2024-09-10T16:29:55.819 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:55.819 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:55.820885+0000 2024-09-10T16:29:55.819 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:55.820885+0000 2024-09-10T16:29:55.819 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:55.820 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:55.820 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:55.820 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:55.820 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:55.820 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:55.820 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:55.820 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:55.820 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:55.820 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:55.820 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:55.820 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:55.827 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 1 Processor -- start 2024-09-10T16:29:55.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 1 -- start start 2024-09-10T16:29:55.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 10 monclient: init 2024-09-10T16:29:55.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:55.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 10 monclient: _add_conns ranks=[3,4,7,6,5,8,1,0,2] 2024-09-10T16:29:55.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 10 monclient(hunting): picked mon.noname-g con 0x7fadd4139330 addr v1:172.21.15.189:6790/0 2024-09-10T16:29:55.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 10 monclient(hunting): picked mon.noname-c con 0x7fadd40a27a0 addr v1:172.21.15.81:6791/0 2024-09-10T16:29:55.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 10 monclient(hunting): picked mon.noname-i con 0x7fadd413f8d0 addr v1:172.21.15.189:6792/0 2024-09-10T16:29:55.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd40a1dc0 con 0x7fadd4139330 2024-09-10T16:29:55.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd40a1520 con 0x7fadd40a27a0 2024-09-10T16:29:55.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd40a1800 con 0x7fadd413f8d0 2024-09-10T16:29:55.828 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:55.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd9086640 10 monclient(hunting): authenticate will time out at 959.111447s 2024-09-10T16:29:55.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd2d9d640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7fadd4139330 0x7fadd4139710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:42642/0 (socket says 172.21.15.189:42642) 2024-09-10T16:29:55.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd2d9d640 1 -- 172.21.15.189:0/715527348 learned_addr learned my addr 172.21.15.189:0/715527348 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-10T16:29:55.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd1d9b640 1 -- 172.21.15.189:0/715527348 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3200728520 0 0) 0x7fadd40a1dc0 con 0x7fadd4139330 2024-09-10T16:29:55.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd1d9b640 10 monclient(hunting): _negotiate 2024-09-10T16:29:55.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd1d9b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:55.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:55.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd1d9b640 10 monclient(hunting): my global_id is 4116 2024-09-10T16:29:55.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd1d9b640 1 -- 172.21.15.189:0/715527348 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadbc003530 con 0x7fadd4139330 2024-09-10T16:29:55.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd1d9b640 1 -- 172.21.15.189:0/715527348 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 798168317 0 0) 0x7fadd40a1800 con 0x7fadd413f8d0 2024-09-10T16:29:55.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd1d9b640 10 monclient(hunting): _negotiate 2024-09-10T16:29:55.829 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd1d9b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:55.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:55.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd1d9b640 10 monclient(hunting): my global_id is 4129 2024-09-10T16:29:55.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.818+0000 7fadd1d9b640 1 -- 172.21.15.189:0/715527348 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadd40a1dc0 con 0x7fadd413f8d0 2024-09-10T16:29:55.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 1 -- 172.21.15.189:0/715527348 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2007568395 0 0) 0x7fadbc003530 con 0x7fadd4139330 2024-09-10T16:29:55.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 1 -- 172.21.15.189:0/715527348 >> v1:172.21.15.189:6792/0 conn(0x7fadd413f8d0 legacy=0x7fadd4141cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:55.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 1 -- 172.21.15.189:0/715527348 >> v1:172.21.15.81:6791/0 conn(0x7fadd40a27a0 legacy=0x7fadd413e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:55.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 10 monclient: _finish_hunting 0 2024-09-10T16:29:55.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 1 monclient: found mon.noname-g 2024-09-10T16:29:55.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:55.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.189:6790/0 2024-09-10T16:29:55.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 1 -- 172.21.15.189:0/715527348 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd40689b0 con 0x7fadd4139330 2024-09-10T16:29:55.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 10 monclient: _finish_auth 0 2024-09-10T16:29:55.830 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 10 monclient: _check_auth_tickets 2024-09-10T16:29:55.831 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:55.831 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 1 -- 172.21.15.189:0/715527348 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fadc4001770 con 0x7fadd4139330 2024-09-10T16:29:55.831 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:55.831 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-10T16:29:55.831 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 10 monclient: dump: 2024-09-10T16:29:55.831 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:55.831 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:55.831 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.831 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.831 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:55.831 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:55.831 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:55.831 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:55.832 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:55.832 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:55.832 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:55.832 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:55.832 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:55.832 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:55.832 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:55.832 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:55.832 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 5 monclient: authenticate success, global_id 4116 2024-09-10T16:29:55.832 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:29:55.832 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 1 -- 172.21.15.189:0/715527348 <== mon.3 v1:172.21.15.189:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fadc4001990 con 0x7fadd4139330 2024-09-10T16:29:55.832 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:55.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 1 -- 172.21.15.189:0/715527348 <== mon.3 v1:172.21.15.189:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fadc4004bf0 con 0x7fadd4139330 2024-09-10T16:29:55.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 10 monclient: get_monmap_and_config success 2024-09-10T16:29:55.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 4 set_mon_vals no callback set 2024-09-10T16:29:55.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:55.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:29:55.833 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd1d9b640 10 monclient: dump: 2024-09-10T16:29:55.833 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:55.833 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:55.833 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.833 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.833 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:55.833 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:55.833 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:55.834 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:55.834 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:55.834 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:55.834 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:55.834 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:55.834 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:55.834 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:55.834 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:55.834 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:55.834 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 10 monclient: shutdown 2024-09-10T16:29:55.834 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:55.834 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 1 -- 172.21.15.189:0/715527348 >> v1:172.21.15.189:6790/0 conn(0x7fadd4139330 legacy=0x7fadd4139710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:55.834 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 1 -- 172.21.15.189:0/715527348 shutdown_connections 2024-09-10T16:29:55.834 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 1 -- 172.21.15.189:0/715527348 >> 172.21.15.189:0/715527348 conn(0x7fadd40a5280 msgr2=0x7fadd40a5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:55.835 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 1 -- 172.21.15.189:0/715527348 shutdown_connections 2024-09-10T16:29:55.835 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 1 -- 172.21.15.189:0/715527348 wait complete. 2024-09-10T16:29:55.835 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 10 monclient: build_initial_monmap 2024-09-10T16:29:55.835 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 10 monclient: monmap: 2024-09-10T16:29:55.835 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 0 2024-09-10T16:29:55.835 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:29:55.835 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 0.000000 2024-09-10T16:29:55.835 INFO:teuthology.orchestra.run.smithi189.stderr:created 0.000000 2024-09-10T16:29:55.835 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:55.835 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 1 2024-09-10T16:29:55.835 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:55.835 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:55.835 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:55.836 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:55.836 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:55.836 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:55.836 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:55.836 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:55.836 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:55.836 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:55.836 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 1 Processor -- start 2024-09-10T16:29:55.836 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 1 -- start start 2024-09-10T16:29:55.836 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 10 monclient: init 2024-09-10T16:29:55.836 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:55.836 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 10 monclient: _add_conns ranks=[0,2,8,4,5,7,1,3,6] 2024-09-10T16:29:55.836 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 10 monclient(hunting): picked mon.noname-a con 0x7fadd40a27a0 addr v1:172.21.15.81:6789/0 2024-09-10T16:29:55.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 10 monclient(hunting): picked mon.noname-b con 0x7fadd4139330 addr v1:172.21.15.81:6790/0 2024-09-10T16:29:55.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 10 monclient(hunting): picked mon.noname-e con 0x7fadd413f8d0 addr v1:172.21.15.81:6793/0 2024-09-10T16:29:55.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd40736c0 con 0x7fadd40a27a0 2024-09-10T16:29:55.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd4123180 con 0x7fadd4139330 2024-09-10T16:29:55.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fadd4123460 con 0x7fadd413f8d0 2024-09-10T16:29:55.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:55.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd9086640 10 monclient(hunting): authenticate will time out at 959.114486s 2024-09-10T16:29:55.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd259c640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fadd4139330 0x7fadd41d2c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.189:34040/0 (socket says 172.21.15.189:34040) 2024-09-10T16:29:55.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd2d9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fadd40a27a0 0x7fadd41ce130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.189:59600/0 (socket says 172.21.15.189:59600) 2024-09-10T16:29:55.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadd259c640 1 -- 172.21.15.189:0/3798564529 learned_addr learned my addr 172.21.15.189:0/3798564529 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-10T16:29:55.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2536546209 0 0) 0x7fadd4123460 con 0x7fadd413f8d0 2024-09-10T16:29:55.837 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:29:55.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:55.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:55.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 10 monclient(hunting): my global_id is 4112 2024-09-10T16:29:55.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadc0003530 con 0x7fadd413f8d0 2024-09-10T16:29:55.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1312910046 0 0) 0x7fadd40689b0 con 0x7fadd40a27a0 2024-09-10T16:29:55.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:29:55.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:55.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:55.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 10 monclient(hunting): my global_id is 4122 2024-09-10T16:29:55.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadd4123460 con 0x7fadd40a27a0 2024-09-10T16:29:55.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2118880314 0 0) 0x7fadd4123180 con 0x7fadd4139330 2024-09-10T16:29:55.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:29:55.838 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:55.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:55.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 10 monclient(hunting): my global_id is 4115 2024-09-10T16:29:55.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fadd40689b0 con 0x7fadd4139330 2024-09-10T16:29:55.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.822+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3240210411 0 0) 0x7fadd40689b0 con 0x7fadd4139330 2024-09-10T16:29:55.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fadd4123180 con 0x7fadd4139330 2024-09-10T16:29:55.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fadc8001a10 con 0x7fadd4139330 2024-09-10T16:29:55.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:55.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:29:55.839 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient(hunting): dump: 2024-09-10T16:29:55.839 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:55.839 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:55.839 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.839 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.840 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:55.840 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:55.840 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:55.840 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:55.840 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:55.840 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:55.840 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:55.840 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:55.840 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:55.840 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:55.840 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:55.840 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:55.840 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:29:55.840 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 425872051 0 0) 0x7fadc0003530 con 0x7fadd413f8d0 2024-09-10T16:29:55.841 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fadd40689b0 con 0x7fadd413f8d0 2024-09-10T16:29:55.841 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fadcc001d60 con 0x7fadd413f8d0 2024-09-10T16:29:55.841 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:55.841 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:29:55.841 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient(hunting): dump: 2024-09-10T16:29:55.841 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:55.841 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:55.841 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.841 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.841 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:55.841 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:55.841 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:55.841 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:55.842 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:55.842 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:55.842 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:55.842 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:55.842 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:55.842 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:55.842 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:55.842 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:55.842 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4282157702 0 0) 0x7fadd4123460 con 0x7fadd40a27a0 2024-09-10T16:29:55.842 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fadc0003530 con 0x7fadd40a27a0 2024-09-10T16:29:55.842 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fadc4001730 con 0x7fadd40a27a0 2024-09-10T16:29:55.842 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:55.842 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:29:55.842 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient(hunting): dump: 2024-09-10T16:29:55.843 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:55.843 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:55.843 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.843 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.843 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:55.843 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:55.843 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:55.843 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:55.843 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:55.843 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:55.843 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:55.843 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:55.843 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:55.844 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:55.844 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:55.844 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:55.844 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3154813836 0 0) 0x7fadd4123180 con 0x7fadd4139330 2024-09-10T16:29:55.844 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 >> v1:172.21.15.81:6793/0 conn(0x7fadd413f8d0 legacy=0x7fadd41d63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:55.844 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 >> v1:172.21.15.81:6789/0 conn(0x7fadd40a27a0 legacy=0x7fadd41ce130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:55.844 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:29:55.844 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 monclient: found mon.b 2024-09-10T16:29:55.844 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:55.844 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:29:55.844 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadd41c49c0 con 0x7fadd4139330 2024-09-10T16:29:55.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient: _finish_auth 0 2024-09-10T16:29:55.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:29:55.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:55.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadd9086640 5 monclient: authenticate success, global_id 4115 2024-09-10T16:29:55.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadd9086640 10 monclient: _renew_subs 2024-09-10T16:29:55.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadd9086640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:29:55.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadd9086640 1 -- 172.21.15.189:0/3798564529 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fadd40a7e80 con 0x7fadd4139330 2024-09-10T16:29:55.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadd9086640 10 monclient: _renew_subs 2024-09-10T16:29:55.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadd9086640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:29:55.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadd9086640 1 -- 172.21.15.189:0/3798564529 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fadd41383f0 con 0x7fadd4139330 2024-09-10T16:29:55.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fadc8001c30 con 0x7fadd4139330 2024-09-10T16:29:55.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:55.845 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fadc8003c10 con 0x7fadd4139330 2024-09-10T16:29:55.846 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadd159a640 4 set_mon_vals no callback set 2024-09-10T16:29:55.846 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:55.846 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:29:55.846 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 10 monclient: dump: 2024-09-10T16:29:55.846 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:55.846 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:55.846 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.846 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:55.846 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:55.846 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:55.846 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:55.846 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:55.846 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:55.846 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:55.847 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:55.847 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:55.847 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:55.847 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:55.847 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:55.847 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:55.847 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7fadc80041c0 con 0x7fadd4139330 2024-09-10T16:29:55.847 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (unknown 1046751622 0 0) 0x7fadc80069b0 con 0x7fadd4139330 2024-09-10T16:29:55.847 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadd9086640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:55.847 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadd9086640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:55.847 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadd9086640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:29:55.847 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.826+0000 7fadd9086640 1 -- 172.21.15.189:0/3798564529 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadb4005090 con 0x7fadd4139330 2024-09-10T16:29:55.848 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.830+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7fadc8005980 con 0x7fadd4139330 2024-09-10T16:29:55.848 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.830+0000 7fadbb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:55.848 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.830+0000 7fadbb7fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:29:55.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.902+0000 7fadd9086640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "c68b183d-5af0-4465-bf0b-1b1410e7a5c3", "id": 0}] 2024-09-10T16:29:55.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.902+0000 7fadd9086640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "c68b183d-5af0-4465-bf0b-1b1410e7a5c3", "id": 0}] 2024-09-10T16:29:55.903 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.902+0000 7fadd9086640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:29:55.904 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.902+0000 7fadd9086640 1 -- 172.21.15.189:0/3798564529 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "osd new", "uuid": "c68b183d-5af0-4465-bf0b-1b1410e7a5c3", "id": 0} v 0) -- 0x7fadb4005380 con 0x7fadd4139330 2024-09-10T16:29:55.907 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.906+0000 7fadbb7fe640 1 -- 172.21.15.189:0/3798564529 <== mon.2 v1:172.21.15.81:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c68b183d-5af0-4465-bf0b-1b1410e7a5c3", "id": 0}]=0 v3) ==== 112+0+2 (unknown 419803636 0 732707515) 0x7fadc8005c30 con 0x7fadd4139330 2024-09-10T16:29:55.907 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.906+0000 7fadbb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "c68b183d-5af0-4465-bf0b-1b1410e7a5c3", "id": 0}] 2024-09-10T16:29:55.907 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.906+0000 7fadbb7fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:29:55.907 INFO:teuthology.orchestra.run.smithi189.stdout:0 2024-09-10T16:29:55.908 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.906+0000 7fadd9086640 10 monclient: shutdown 2024-09-10T16:29:55.909 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.906+0000 7fadd9086640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:55.909 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.906+0000 7fadd9086640 1 -- 172.21.15.189:0/3798564529 >> v1:172.21.15.81:6790/0 conn(0x7fadd4139330 legacy=0x7fadd41d2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:55.909 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.906+0000 7fadd9086640 1 -- 172.21.15.189:0/3798564529 shutdown_connections 2024-09-10T16:29:55.909 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.906+0000 7fadd9086640 1 -- 172.21.15.189:0/3798564529 >> 172.21.15.189:0/3798564529 conn(0x7fadd40a5280 msgr2=0x7fadd4139f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:55.909 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.906+0000 7fadd9086640 1 -- 172.21.15.189:0/3798564529 shutdown_connections 2024-09-10T16:29:55.909 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:55.906+0000 7fadd9086640 1 -- 172.21.15.189:0/3798564529 wait complete. 2024-09-10T16:29:55.924 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new b0e4a6b2-56e9-4f68-8dc0-998d3dec5bc9 1 2024-09-10T16:29:56.043 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 10 monclient: get_monmap_and_config 2024-09-10T16:29:56.043 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 10 monclient: build_initial_monmap 2024-09-10T16:29:56.043 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 10 monclient: monmap: 2024-09-10T16:29:56.043 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 0 2024-09-10T16:29:56.043 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.043 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:56.045047+0000 2024-09-10T16:29:56.043 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:56.045047+0000 2024-09-10T16:29:56.043 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:56.044 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.044 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:56.044 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:56.044 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:56.044 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:56.044 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:56.044 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:56.044 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:56.044 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:56.044 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:56.044 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.051 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 1 Processor -- start 2024-09-10T16:29:56.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 1 -- start start 2024-09-10T16:29:56.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 10 monclient: init 2024-09-10T16:29:56.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:56.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 10 monclient: _add_conns ranks=[6,4,0,7,8,3,1,5,2] 2024-09-10T16:29:56.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 10 monclient(hunting): picked mon.noname-d con 0x7fa0700a3860 addr v1:172.21.15.81:6792/0 2024-09-10T16:29:56.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 10 monclient(hunting): picked mon.noname-c con 0x7fa07009ce50 addr v1:172.21.15.81:6791/0 2024-09-10T16:29:56.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 10 monclient(hunting): picked mon.noname-a con 0x7fa0700a4350 addr v1:172.21.15.81:6789/0 2024-09-10T16:29:56.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa07009e370 con 0x7fa0700a4350 2024-09-10T16:29:56.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0700a5380 con 0x7fa07009ce50 2024-09-10T16:29:56.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa07009f960 con 0x7fa0700a3860 2024-09-10T16:29:56.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:56.052 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.042+0000 7fa078266640 10 monclient(hunting): authenticate will time out at 959.335771s 2024-09-10T16:29:56.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa076002640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fa0700a3860 0x7fa0700a3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.189:59960/0 (socket says 172.21.15.189:59960) 2024-09-10T16:29:56.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa076002640 1 -- 172.21.15.189:0/2860869502 learned_addr learned my addr 172.21.15.189:0/2860869502 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-10T16:29:56.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075801640 1 --1- 172.21.15.189:0/2860869502 >> v1:172.21.15.81:6791/0 conn(0x7fa07009ce50 0x7fa07013a850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.189:54450/0 (socket says 172.21.15.189:54450) 2024-09-10T16:29:56.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 1 -- 172.21.15.189:0/2860869502 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3445656087 0 0) 0x7fa07009f960 con 0x7fa0700a3860 2024-09-10T16:29:56.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient(hunting): my global_id is 4119 2024-09-10T16:29:56.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 1 -- 172.21.15.189:0/2860869502 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa058003530 con 0x7fa0700a3860 2024-09-10T16:29:56.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 1 -- 172.21.15.189:0/2860869502 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2405771302 0 0) 0x7fa0700a5380 con 0x7fa07009ce50 2024-09-10T16:29:56.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.053 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient(hunting): my global_id is 4126 2024-09-10T16:29:56.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 1 -- 172.21.15.189:0/2860869502 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa07009f960 con 0x7fa07009ce50 2024-09-10T16:29:56.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 1 -- 172.21.15.189:0/2860869502 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2493239052 0 0) 0x7fa07009e370 con 0x7fa0700a4350 2024-09-10T16:29:56.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient(hunting): my global_id is 4131 2024-09-10T16:29:56.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 1 -- 172.21.15.189:0/2860869502 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0700a5380 con 0x7fa0700a4350 2024-09-10T16:29:56.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 1 -- 172.21.15.189:0/2860869502 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3478746195 0 0) 0x7fa07009f960 con 0x7fa07009ce50 2024-09-10T16:29:56.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 1 -- 172.21.15.189:0/2860869502 >> v1:172.21.15.81:6792/0 conn(0x7fa0700a3860 legacy=0x7fa0700a3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 1 -- 172.21.15.189:0/2860869502 >> v1:172.21.15.81:6789/0 conn(0x7fa0700a4350 legacy=0x7fa07013df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.054 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient: _finish_hunting 0 2024-09-10T16:29:56.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 1 monclient: found mon.noname-c 2024-09-10T16:29:56.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:56.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:29:56.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 1 -- 172.21.15.189:0/2860869502 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa07009d2d0 con 0x7fa07009ce50 2024-09-10T16:29:56.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient: _finish_auth 0 2024-09-10T16:29:56.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient: _check_auth_tickets 2024-09-10T16:29:56.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:56.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 5 monclient: authenticate success, global_id 4126 2024-09-10T16:29:56.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 1 -- 172.21.15.189:0/2860869502 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa064001820 con 0x7fa07009ce50 2024-09-10T16:29:56.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:29:56.055 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient: dump: 2024-09-10T16:29:56.055 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.055 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.056 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.056 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.056 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.056 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.056 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.056 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.056 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.056 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.056 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.056 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.056 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.056 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.056 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.057 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.057 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:29:56.057 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 1 -- 172.21.15.189:0/2860869502 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa0640019c0 con 0x7fa07009ce50 2024-09-10T16:29:56.057 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:56.057 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 1 -- 172.21.15.189:0/2860869502 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa064004b30 con 0x7fa07009ce50 2024-09-10T16:29:56.057 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 10 monclient: get_monmap_and_config success 2024-09-10T16:29:56.057 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 4 set_mon_vals no callback set 2024-09-10T16:29:56.057 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.057 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:29:56.057 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075000640 10 monclient: dump: 2024-09-10T16:29:56.057 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.057 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.057 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.057 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.058 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.058 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.058 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.058 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.058 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.058 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.058 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.058 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.058 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.058 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.058 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.058 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.058 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 10 monclient: shutdown 2024-09-10T16:29:56.059 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:56.059 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 1 -- 172.21.15.189:0/2860869502 >> v1:172.21.15.81:6791/0 conn(0x7fa07009ce50 legacy=0x7fa07013a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.059 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 1 -- 172.21.15.189:0/2860869502 shutdown_connections 2024-09-10T16:29:56.059 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 1 -- 172.21.15.189:0/2860869502 >> 172.21.15.189:0/2860869502 conn(0x7fa0700a8450 msgr2=0x7fa0700a4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:56.059 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 1 -- 172.21.15.189:0/2860869502 shutdown_connections 2024-09-10T16:29:56.059 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 1 -- 172.21.15.189:0/2860869502 wait complete. 2024-09-10T16:29:56.059 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 10 monclient: build_initial_monmap 2024-09-10T16:29:56.059 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 10 monclient: monmap: 2024-09-10T16:29:56.059 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 0 2024-09-10T16:29:56.059 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:29:56.059 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 0.000000 2024-09-10T16:29:56.059 INFO:teuthology.orchestra.run.smithi189.stderr:created 0.000000 2024-09-10T16:29:56.059 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:56.060 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 1 2024-09-10T16:29:56.060 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:56.060 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:56.060 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:56.060 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:56.060 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:56.060 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:56.060 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:56.060 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:56.060 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:56.060 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.060 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 1 Processor -- start 2024-09-10T16:29:56.060 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 1 -- start start 2024-09-10T16:29:56.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 10 monclient: init 2024-09-10T16:29:56.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:56.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 10 monclient: _add_conns ranks=[1,5,4,8,3,0,6,2,7] 2024-09-10T16:29:56.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 10 monclient(hunting): picked mon.noname-f con 0x7fa07009ce50 addr v1:172.21.15.189:6789/0 2024-09-10T16:29:56.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 10 monclient(hunting): picked mon.noname-h con 0x7fa0700a3860 addr v1:172.21.15.189:6791/0 2024-09-10T16:29:56.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 10 monclient(hunting): picked mon.noname-c con 0x7fa0700a4350 addr v1:172.21.15.81:6791/0 2024-09-10T16:29:56.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa070125e60 con 0x7fa07009ce50 2024-09-10T16:29:56.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0700a7670 con 0x7fa0700a4350 2024-09-10T16:29:56.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0700a7140 con 0x7fa0700a3860 2024-09-10T16:29:56.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:56.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa078266640 10 monclient(hunting): authenticate will time out at 959.339722s 2024-09-10T16:29:56.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075801640 1 --1- >> v1:172.21.15.189:6791/0 conn(0x7fa0700a3860 0x7fa0701d2a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6791/0 says I am v1:172.21.15.189:56746/0 (socket says 172.21.15.189:56746) 2024-09-10T16:29:56.061 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa076002640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fa07009ce50 0x7fa070133790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:33890/0 (socket says 172.21.15.189:33890) 2024-09-10T16:29:56.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.046+0000 7fa075801640 1 -- 172.21.15.189:0/2546399709 learned_addr learned my addr 172.21.15.189:0/2546399709 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-10T16:29:56.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3221979998 0 0) 0x7fa070125e60 con 0x7fa07009ce50 2024-09-10T16:29:56.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): my global_id is 4114 2024-09-10T16:29:56.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa05c003530 con 0x7fa07009ce50 2024-09-10T16:29:56.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1677206172 0 0) 0x7fa0700a7140 con 0x7fa0700a3860 2024-09-10T16:29:56.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): my global_id is 4127 2024-09-10T16:29:56.062 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa070125e60 con 0x7fa0700a3860 2024-09-10T16:29:56.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285832941 0 0) 0x7fa0700a7670 con 0x7fa0700a4350 2024-09-10T16:29:56.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): my global_id is 4135 2024-09-10T16:29:56.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0700a7140 con 0x7fa0700a4350 2024-09-10T16:29:56.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2768625950 0 0) 0x7fa05c003530 con 0x7fa07009ce50 2024-09-10T16:29:56.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa0700a7670 con 0x7fa07009ce50 2024-09-10T16:29:56.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa0680018f0 con 0x7fa07009ce50 2024-09-10T16:29:56.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:56.063 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-10T16:29:56.064 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): dump: 2024-09-10T16:29:56.064 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.064 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.064 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.064 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.064 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.064 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.064 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.064 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.064 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.064 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.064 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.065 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.065 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.065 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.065 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.065 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:29:56.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3397610391 0 0) 0x7fa070125e60 con 0x7fa0700a3860 2024-09-10T16:29:56.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa05c003530 con 0x7fa0700a3860 2024-09-10T16:29:56.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa0640014a0 con 0x7fa0700a3860 2024-09-10T16:29:56.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:56.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-10T16:29:56.065 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient(hunting): dump: 2024-09-10T16:29:56.065 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.066 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.066 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.066 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.066 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.066 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.066 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.066 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.066 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.066 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.066 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.066 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.066 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.066 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.066 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.067 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2649190662 0 0) 0x7fa0700a7670 con 0x7fa07009ce50 2024-09-10T16:29:56.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 >> v1:172.21.15.189:6791/0 conn(0x7fa0700a3860 legacy=0x7fa0701d2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 >> v1:172.21.15.81:6791/0 conn(0x7fa0700a4350 legacy=0x7fa0701d6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:29:56.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 monclient: found mon.f 2024-09-10T16:29:56.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:56.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.189:6789/0 2024-09-10T16:29:56.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0701281c0 con 0x7fa07009ce50 2024-09-10T16:29:56.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient: _finish_auth 0 2024-09-10T16:29:56.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:29:56.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:56.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa078266640 5 monclient: authenticate success, global_id 4114 2024-09-10T16:29:56.067 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa078266640 10 monclient: _renew_subs 2024-09-10T16:29:56.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa078266640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.189:6789/0 2024-09-10T16:29:56.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa078266640 1 -- 172.21.15.189:0/2546399709 --> v1:172.21.15.189:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa0701269c0 con 0x7fa07009ce50 2024-09-10T16:29:56.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa078266640 10 monclient: _renew_subs 2024-09-10T16:29:56.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa078266640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.189:6789/0 2024-09-10T16:29:56.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa078266640 1 -- 172.21.15.189:0/2546399709 --> v1:172.21.15.189:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa070134070 con 0x7fa07009ce50 2024-09-10T16:29:56.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 <== mon.1 v1:172.21.15.189:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa068001d20 con 0x7fa07009ce50 2024-09-10T16:29:56.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:56.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 <== mon.1 v1:172.21.15.189:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa068004de0 con 0x7fa07009ce50 2024-09-10T16:29:56.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06ffff640 4 set_mon_vals no callback set 2024-09-10T16:29:56.068 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:29:56.069 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient: dump: 2024-09-10T16:29:56.069 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.069 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.069 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.069 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.069 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.069 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.069 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.069 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.069 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.069 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.069 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.069 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.069 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.070 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.070 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.070 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.070 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 <== mon.1 v1:172.21.15.189:6789/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7fa068005310 con 0x7fa07009ce50 2024-09-10T16:29:56.070 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 <== mon.1 v1:172.21.15.189:6789/0 8 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (unknown 557161162 0 0) 0x7fa0680069f0 con 0x7fa07009ce50 2024-09-10T16:29:56.070 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa078266640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.070 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa078266640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.070 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa078266640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.189:6789/0 2024-09-10T16:29:56.070 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa078266640 1 -- 172.21.15.189:0/2546399709 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa050005090 con 0x7fa07009ce50 2024-09-10T16:29:56.071 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 <== mon.1 v1:172.21.15.189:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7fa0680057e0 con 0x7fa07009ce50 2024-09-10T16:29:56.071 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.071 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.050+0000 7fa06e7fc640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:29:56.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.126+0000 7fa078266640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "b0e4a6b2-56e9-4f68-8dc0-998d3dec5bc9", "id": 1}] 2024-09-10T16:29:56.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.126+0000 7fa078266640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "b0e4a6b2-56e9-4f68-8dc0-998d3dec5bc9", "id": 1}] 2024-09-10T16:29:56.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.126+0000 7fa078266640 10 monclient: _send_mon_message to mon.f at v1:172.21.15.189:6789/0 2024-09-10T16:29:56.127 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.126+0000 7fa078266640 1 -- 172.21.15.189:0/2546399709 --> v1:172.21.15.189:6789/0 -- mon_command({"prefix": "osd new", "uuid": "b0e4a6b2-56e9-4f68-8dc0-998d3dec5bc9", "id": 1} v 0) -- 0x7fa050005380 con 0x7fa07009ce50 2024-09-10T16:29:56.139 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.138+0000 7fa06e7fc640 1 -- 172.21.15.189:0/2546399709 <== mon.1 v1:172.21.15.189:6789/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b0e4a6b2-56e9-4f68-8dc0-998d3dec5bc9", "id": 1}]=0 v4) ==== 112+0+2 (unknown 1029376678 0 940483276) 0x7fa068005b10 con 0x7fa07009ce50 2024-09-10T16:29:56.139 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.138+0000 7fa06e7fc640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "b0e4a6b2-56e9-4f68-8dc0-998d3dec5bc9", "id": 1}] 2024-09-10T16:29:56.139 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.138+0000 7fa06e7fc640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:29:56.139 INFO:teuthology.orchestra.run.smithi189.stdout:1 2024-09-10T16:29:56.140 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.138+0000 7fa078266640 10 monclient: shutdown 2024-09-10T16:29:56.140 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.138+0000 7fa078266640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:56.140 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.138+0000 7fa078266640 1 -- 172.21.15.189:0/2546399709 >> v1:172.21.15.189:6789/0 conn(0x7fa07009ce50 legacy=0x7fa070133790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.140 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.138+0000 7fa078266640 1 -- 172.21.15.189:0/2546399709 shutdown_connections 2024-09-10T16:29:56.141 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.138+0000 7fa078266640 1 -- 172.21.15.189:0/2546399709 >> 172.21.15.189:0/2546399709 conn(0x7fa0700a8450 msgr2=0x7fa070134b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:56.141 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.138+0000 7fa078266640 1 -- 172.21.15.189:0/2546399709 shutdown_connections 2024-09-10T16:29:56.141 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.138+0000 7fa078266640 1 -- 172.21.15.189:0/2546399709 wait complete. 2024-09-10T16:29:56.156 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new 8021ac53-8498-4069-92a8-a6477fab55b2 2 2024-09-10T16:29:56.268 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.266+0000 7f078cd5d640 10 monclient: get_monmap_and_config 2024-09-10T16:29:56.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.266+0000 7f078cd5d640 10 monclient: build_initial_monmap 2024-09-10T16:29:56.269 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.266+0000 7f078cd5d640 10 monclient: monmap: 2024-09-10T16:29:56.269 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 0 2024-09-10T16:29:56.269 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.269 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:56.270604+0000 2024-09-10T16:29:56.269 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:56.270604+0000 2024-09-10T16:29:56.269 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:56.269 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.269 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:56.269 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:56.269 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:56.270 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:56.270 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:56.270 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:56.270 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:56.270 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:56.270 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:56.270 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 1 Processor -- start 2024-09-10T16:29:56.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 1 -- start start 2024-09-10T16:29:56.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 10 monclient: init 2024-09-10T16:29:56.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:56.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 10 monclient: _add_conns ranks=[3,5,6,7,0,2,8,1,4] 2024-09-10T16:29:56.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 10 monclient(hunting): picked mon.noname-g con 0x7f0788139270 addr v1:172.21.15.189:6790/0 2024-09-10T16:29:56.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 10 monclient(hunting): picked mon.noname-h con 0x7f07880743b0 addr v1:172.21.15.189:6791/0 2024-09-10T16:29:56.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 10 monclient(hunting): picked mon.noname-d con 0x7f078813f970 addr v1:172.21.15.81:6792/0 2024-09-10T16:29:56.275 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f078806f6a0 con 0x7f0788139270 2024-09-10T16:29:56.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07880a44b0 con 0x7f07880743b0 2024-09-10T16:29:56.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f078806f420 con 0x7f078813f970 2024-09-10T16:29:56.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:56.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 10 monclient(hunting): authenticate will time out at 959.561037s 2024-09-10T16:29:56.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078659c640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f0788139270 0x7f0788139650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:42656/0 (socket says 172.21.15.189:42656) 2024-09-10T16:29:56.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078659c640 1 -- 172.21.15.189:0/2238966886 learned_addr learned my addr 172.21.15.189:0/2238966886 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-10T16:29:56.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 1 -- 172.21.15.189:0/2238966886 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2512790485 0 0) 0x7f0778001120 con 0x7f0788139270 2024-09-10T16:29:56.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient(hunting): my global_id is 4125 2024-09-10T16:29:56.276 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 1 -- 172.21.15.189:0/2238966886 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0770003530 con 0x7f0788139270 2024-09-10T16:29:56.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 1 -- 172.21.15.189:0/2238966886 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3965757554 0 0) 0x7f07880a44b0 con 0x7f07880743b0 2024-09-10T16:29:56.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient(hunting): my global_id is 4136 2024-09-10T16:29:56.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 1 -- 172.21.15.189:0/2238966886 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0778001120 con 0x7f07880743b0 2024-09-10T16:29:56.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 1 -- 172.21.15.189:0/2238966886 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4275431541 0 0) 0x7f0770003530 con 0x7f0788139270 2024-09-10T16:29:56.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 1 -- 172.21.15.189:0/2238966886 >> v1:172.21.15.81:6792/0 conn(0x7f078813f970 legacy=0x7f0788141d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 1 -- 172.21.15.189:0/2238966886 >> v1:172.21.15.189:6791/0 conn(0x7f07880743b0 legacy=0x7f078813e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient: _finish_hunting 0 2024-09-10T16:29:56.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 1 monclient: found mon.noname-g 2024-09-10T16:29:56.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:56.277 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.189:6790/0 2024-09-10T16:29:56.278 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 1 -- 172.21.15.189:0/2238966886 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0788139d60 con 0x7f0788139270 2024-09-10T16:29:56.278 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient: _finish_auth 0 2024-09-10T16:29:56.278 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient: _check_auth_tickets 2024-09-10T16:29:56.278 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:56.278 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 1 -- 172.21.15.189:0/2238966886 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0778001a10 con 0x7f0788139270 2024-09-10T16:29:56.278 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 5 monclient: authenticate success, global_id 4125 2024-09-10T16:29:56.278 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:29:56.278 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.278 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-10T16:29:56.278 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient: dump: 2024-09-10T16:29:56.278 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.278 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.278 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.278 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.279 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.279 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.279 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.279 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.279 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.279 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.279 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.279 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.279 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.279 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.279 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.279 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:29:56.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 1 -- 172.21.15.189:0/2238966886 <== mon.3 v1:172.21.15.189:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0778001c30 con 0x7f0788139270 2024-09-10T16:29:56.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:56.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 10 monclient: get_monmap_and_config success 2024-09-10T16:29:56.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 4 set_mon_vals no callback set 2024-09-10T16:29:56.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 1 -- 172.21.15.189:0/2238966886 <== mon.3 v1:172.21.15.189:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0778004bf0 con 0x7f0788139270 2024-09-10T16:29:56.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:29:56.280 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078559a640 10 monclient: dump: 2024-09-10T16:29:56.280 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.280 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.280 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.280 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.281 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.281 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.281 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.281 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.281 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.281 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.281 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.281 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.281 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.281 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.281 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.281 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.281 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 10 monclient: shutdown 2024-09-10T16:29:56.281 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:56.282 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 1 -- 172.21.15.189:0/2238966886 >> v1:172.21.15.189:6790/0 conn(0x7f0788139270 legacy=0x7f0788139650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.282 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 1 -- 172.21.15.189:0/2238966886 shutdown_connections 2024-09-10T16:29:56.282 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 1 -- 172.21.15.189:0/2238966886 >> 172.21.15.189:0/2238966886 conn(0x7f07880a9e30 msgr2=0x7f0788071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:56.282 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 1 -- 172.21.15.189:0/2238966886 shutdown_connections 2024-09-10T16:29:56.282 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 1 -- 172.21.15.189:0/2238966886 wait complete. 2024-09-10T16:29:56.282 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 10 monclient: build_initial_monmap 2024-09-10T16:29:56.282 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 10 monclient: monmap: 2024-09-10T16:29:56.282 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 0 2024-09-10T16:29:56.282 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:29:56.282 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 0.000000 2024-09-10T16:29:56.282 INFO:teuthology.orchestra.run.smithi189.stderr:created 0.000000 2024-09-10T16:29:56.282 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 1 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 1 Processor -- start 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 1 -- start start 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.270+0000 7f078cd5d640 10 monclient: init 2024-09-10T16:29:56.283 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:56.284 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 10 monclient: _add_conns ranks=[4,2,5,8,7,3,0,6,1] 2024-09-10T16:29:56.284 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 10 monclient(hunting): picked mon.noname-c con 0x7f07880743b0 addr v1:172.21.15.81:6791/0 2024-09-10T16:29:56.284 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 10 monclient(hunting): picked mon.noname-b con 0x7f0788139270 addr v1:172.21.15.81:6790/0 2024-09-10T16:29:56.284 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 10 monclient(hunting): picked mon.noname-h con 0x7f078813f970 addr v1:172.21.15.189:6791/0 2024-09-10T16:29:56.284 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f078813f580 con 0x7f0788139270 2024-09-10T16:29:56.284 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0788123260 con 0x7f07880743b0 2024-09-10T16:29:56.284 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0788120ca0 con 0x7f078813f970 2024-09-10T16:29:56.284 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:56.284 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 10 monclient(hunting): authenticate will time out at 959.564182s 2024-09-10T16:29:56.284 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0786d9d640 1 --1- >> v1:172.21.15.189:6791/0 conn(0x7f078813f970 0x7f07881d5d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6791/0 says I am v1:172.21.15.189:56766/0 (socket says 172.21.15.189:56766) 2024-09-10T16:29:56.284 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0786d9d640 1 -- 172.21.15.189:0/957805084 learned_addr learned my addr 172.21.15.189:0/957805084 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-10T16:29:56.284 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2504851194 0 0) 0x7f077c001aa0 con 0x7f0788139270 2024-09-10T16:29:56.284 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient(hunting): my global_id is 4124 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0768003530 con 0x7f0788139270 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 775273109 0 0) 0x7f0768003530 con 0x7f0788139270 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f077c001aa0 con 0x7f0788139270 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f077c001790 con 0x7f0788139270 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient(hunting): dump: 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.285 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.286 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.286 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.286 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.286 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.286 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.286 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.286 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.286 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.286 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.286 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.286 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.286 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:29:56.286 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3170479770 0 0) 0x7f077c001aa0 con 0x7f0788139270 2024-09-10T16:29:56.286 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 >> v1:172.21.15.189:6791/0 conn(0x7f078813f970 legacy=0x7f07881d5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 >> v1:172.21.15.81:6791/0 conn(0x7f07880743b0 legacy=0x7f078811fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:29:56.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 1 monclient: found mon.b 2024-09-10T16:29:56.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:56.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:29:56.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0788123540 con 0x7f0788139270 2024-09-10T16:29:56.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient: _finish_auth 0 2024-09-10T16:29:56.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:29:56.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:56.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 5 monclient: authenticate success, global_id 4124 2024-09-10T16:29:56.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 10 monclient: _renew_subs 2024-09-10T16:29:56.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:29:56.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 1 -- 172.21.15.189:0/957805084 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0788122f80 con 0x7f0788139270 2024-09-10T16:29:56.287 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 10 monclient: _renew_subs 2024-09-10T16:29:56.288 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:29:56.288 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 1 -- 172.21.15.189:0/957805084 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f07881d7470 con 0x7f0788139270 2024-09-10T16:29:56.289 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f077c0038b0 con 0x7f0788139270 2024-09-10T16:29:56.289 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:56.289 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f077c003da0 con 0x7f0788139270 2024-09-10T16:29:56.289 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.289 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0784d99640 4 set_mon_vals no callback set 2024-09-10T16:29:56.289 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:29:56.289 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 10 monclient: dump: 2024-09-10T16:29:56.289 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.289 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.289 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.289 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.290 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.290 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.290 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.290 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.290 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.290 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.290 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.290 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.290 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.290 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.290 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.290 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.290 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f077c004310 con 0x7f0788139270 2024-09-10T16:29:56.291 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.291 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (unknown 2370394313 0 0) 0x7f077c004a20 con 0x7f0788139270 2024-09-10T16:29:56.291 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.291 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:29:56.291 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.274+0000 7f078cd5d640 1 -- 172.21.15.189:0/957805084 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f076c005090 con 0x7f0788139270 2024-09-10T16:29:56.291 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.290+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7f078813f580 con 0x7f0788139270 2024-09-10T16:29:56.291 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.290+0000 7f0776ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.291 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.290+0000 7f0776ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:29:56.361 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.362+0000 7f078cd5d640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "8021ac53-8498-4069-92a8-a6477fab55b2", "id": 2}] 2024-09-10T16:29:56.361 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.362+0000 7f078cd5d640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "8021ac53-8498-4069-92a8-a6477fab55b2", "id": 2}] 2024-09-10T16:29:56.361 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.362+0000 7f078cd5d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:29:56.362 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.362+0000 7f078cd5d640 1 -- 172.21.15.189:0/957805084 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "osd new", "uuid": "8021ac53-8498-4069-92a8-a6477fab55b2", "id": 2} v 0) -- 0x7f076c005380 con 0x7f0788139270 2024-09-10T16:29:56.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.362+0000 7f0776ffd640 1 -- 172.21.15.189:0/957805084 <== mon.2 v1:172.21.15.81:6790/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8021ac53-8498-4069-92a8-a6477fab55b2", "id": 2}]=0 v5) ==== 112+0+2 (unknown 2826538973 0 216599125) 0x7f077c0047a0 con 0x7f0788139270 2024-09-10T16:29:56.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.366+0000 7f0776ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "8021ac53-8498-4069-92a8-a6477fab55b2", "id": 2}] 2024-09-10T16:29:56.365 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.366+0000 7f0776ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:29:56.365 INFO:teuthology.orchestra.run.smithi189.stdout:2 2024-09-10T16:29:56.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.366+0000 7f078cd5d640 10 monclient: shutdown 2024-09-10T16:29:56.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.366+0000 7f078cd5d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:56.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.366+0000 7f078cd5d640 1 -- 172.21.15.189:0/957805084 >> v1:172.21.15.81:6790/0 conn(0x7f0788139270 legacy=0x7f0788120590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.366+0000 7f078cd5d640 1 -- 172.21.15.189:0/957805084 shutdown_connections 2024-09-10T16:29:56.366 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.366+0000 7f078cd5d640 1 -- 172.21.15.189:0/957805084 >> 172.21.15.189:0/957805084 conn(0x7f07880a9e30 msgr2=0x7f07880a6c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:56.367 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.366+0000 7f078cd5d640 1 -- 172.21.15.189:0/957805084 shutdown_connections 2024-09-10T16:29:56.367 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.366+0000 7f078cd5d640 1 -- 172.21.15.189:0/957805084 wait complete. 2024-09-10T16:29:56.383 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new c098399b-faef-460a-b448-a1c4ba227a5b 3 2024-09-10T16:29:56.487 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 10 monclient: get_monmap_and_config 2024-09-10T16:29:56.487 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 10 monclient: build_initial_monmap 2024-09-10T16:29:56.487 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 10 monclient: monmap: 2024-09-10T16:29:56.487 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 0 2024-09-10T16:29:56.488 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.488 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:56.489151+0000 2024-09-10T16:29:56.488 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:56.489151+0000 2024-09-10T16:29:56.488 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:56.488 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.488 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:56.488 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:56.489 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:56.489 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:56.489 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:56.489 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:56.489 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:56.489 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:56.489 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:56.489 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.497 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 1 Processor -- start 2024-09-10T16:29:56.497 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 1 -- start start 2024-09-10T16:29:56.497 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 10 monclient: init 2024-09-10T16:29:56.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:56.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 10 monclient: _add_conns ranks=[4,7,0,2,6,8,3,1,5] 2024-09-10T16:29:56.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 10 monclient(hunting): picked mon.noname-c con 0x7ff038068960 addr v1:172.21.15.81:6791/0 2024-09-10T16:29:56.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 10 monclient(hunting): picked mon.noname-i con 0x7ff0380a0c50 addr v1:172.21.15.189:6792/0 2024-09-10T16:29:56.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 10 monclient(hunting): picked mon.noname-a con 0x7ff03813f7a0 addr v1:172.21.15.81:6789/0 2024-09-10T16:29:56.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff03809c0f0 con 0x7ff03813f7a0 2024-09-10T16:29:56.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0380a04e0 con 0x7ff038068960 2024-09-10T16:29:56.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff0380a07c0 con 0x7ff0380a0c50 2024-09-10T16:29:56.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:56.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff03e114640 10 monclient(hunting): authenticate will time out at 959.779430s 2024-09-10T16:29:56.498 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff02ffff640 1 --1- >> v1:172.21.15.189:6792/0 conn(0x7ff0380a0c50 0x7ff0380a36f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6792/0 says I am v1:172.21.15.189:36642/0 (socket says 172.21.15.189:36642) 2024-09-10T16:29:56.499 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff02ffff640 1 -- 172.21.15.189:0/2727042215 learned_addr learned my addr 172.21.15.189:0/2727042215 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-10T16:29:56.499 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff036ffd640 1 -- 172.21.15.189:0/2727042215 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3675322505 0 0) 0x7ff0380a07c0 con 0x7ff0380a0c50 2024-09-10T16:29:56.499 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff036ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.499 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff036ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.499 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff036ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.499 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff036ffd640 10 monclient(hunting): my global_id is 4138 2024-09-10T16:29:56.499 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.486+0000 7ff036ffd640 1 -- 172.21.15.189:0/2727042215 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff024003530 con 0x7ff0380a0c50 2024-09-10T16:29:56.499 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 1 -- 172.21.15.189:0/2727042215 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3438618261 0 0) 0x7ff024003530 con 0x7ff0380a0c50 2024-09-10T16:29:56.499 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 1 -- 172.21.15.189:0/2727042215 >> v1:172.21.15.81:6791/0 conn(0x7ff038068960 legacy=0x7ff0380a2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.499 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 1 -- 172.21.15.189:0/2727042215 >> v1:172.21.15.81:6789/0 conn(0x7ff03813f7a0 legacy=0x7ff038141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.499 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:29:56.499 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 1 monclient: found mon.noname-i 2024-09-10T16:29:56.499 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:56.500 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.189:6792/0 2024-09-10T16:29:56.500 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 1 -- 172.21.15.189:0/2727042215 --> v1:172.21.15.189:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0380a3e00 con 0x7ff0380a0c50 2024-09-10T16:29:56.500 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 10 monclient: _finish_auth 0 2024-09-10T16:29:56.500 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:29:56.500 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:56.500 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 5 monclient: authenticate success, global_id 4138 2024-09-10T16:29:56.500 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 1 -- 172.21.15.189:0/2727042215 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff020001840 con 0x7ff0380a0c50 2024-09-10T16:29:56.500 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.500 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-10T16:29:56.500 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 10 monclient: dump: 2024-09-10T16:29:56.500 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.500 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.501 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.501 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.501 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.501 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.501 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.501 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.501 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.501 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.501 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.501 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.501 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.501 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.501 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.502 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.502 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:29:56.502 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 1 -- 172.21.15.189:0/2727042215 <== mon.7 v1:172.21.15.189:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff020001a60 con 0x7ff0380a0c50 2024-09-10T16:29:56.502 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:56.502 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 1 -- 172.21.15.189:0/2727042215 <== mon.7 v1:172.21.15.189:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff020004bf0 con 0x7ff0380a0c50 2024-09-10T16:29:56.502 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.502 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:29:56.502 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff036ffd640 10 monclient: dump: 2024-09-10T16:29:56.502 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.502 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.502 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.502 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.503 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.503 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.503 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.503 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.503 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.503 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.503 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.503 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.503 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.504 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.504 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.504 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.504 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient: get_monmap_and_config success 2024-09-10T16:29:56.504 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 4 set_mon_vals no callback set 2024-09-10T16:29:56.504 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient: shutdown 2024-09-10T16:29:56.504 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:56.504 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 1 -- 172.21.15.189:0/2727042215 >> v1:172.21.15.189:6792/0 conn(0x7ff0380a0c50 legacy=0x7ff0380a36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.504 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 1 -- 172.21.15.189:0/2727042215 shutdown_connections 2024-09-10T16:29:56.504 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 1 -- 172.21.15.189:0/2727042215 >> 172.21.15.189:0/2727042215 conn(0x7ff0380a87b0 msgr2=0x7ff0380a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:56.504 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 1 -- 172.21.15.189:0/2727042215 shutdown_connections 2024-09-10T16:29:56.504 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 1 -- 172.21.15.189:0/2727042215 wait complete. 2024-09-10T16:29:56.504 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient: build_initial_monmap 2024-09-10T16:29:56.505 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient: monmap: 2024-09-10T16:29:56.505 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 0 2024-09-10T16:29:56.505 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:29:56.505 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 0.000000 2024-09-10T16:29:56.505 INFO:teuthology.orchestra.run.smithi189.stderr:created 0.000000 2024-09-10T16:29:56.505 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:56.505 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 1 2024-09-10T16:29:56.505 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:56.505 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:56.505 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:56.505 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:56.505 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:56.506 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:56.506 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:56.506 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:56.506 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:56.506 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 1 Processor -- start 2024-09-10T16:29:56.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 1 -- start start 2024-09-10T16:29:56.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient: init 2024-09-10T16:29:56.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:56.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient: _add_conns ranks=[4,7,8,2,5,1,0,3,6] 2024-09-10T16:29:56.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient(hunting): picked mon.noname-c con 0x7ff038068960 addr v1:172.21.15.81:6791/0 2024-09-10T16:29:56.506 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient(hunting): picked mon.noname-i con 0x7ff0380a0c50 addr v1:172.21.15.189:6792/0 2024-09-10T16:29:56.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient(hunting): picked mon.noname-e con 0x7ff03813f7a0 addr v1:172.21.15.81:6793/0 2024-09-10T16:29:56.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff038097af0 con 0x7ff038068960 2024-09-10T16:29:56.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff038097290 con 0x7ff0380a0c50 2024-09-10T16:29:56.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff03809e690 con 0x7ff03813f7a0 2024-09-10T16:29:56.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:56.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient(hunting): authenticate will time out at 959.782342s 2024-09-10T16:29:56.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff02ffff640 1 --1- >> v1:172.21.15.189:6792/0 conn(0x7ff0380a0c50 0x7ff0381d2950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6792/0 says I am v1:172.21.15.189:36654/0 (socket says 172.21.15.189:36654) 2024-09-10T16:29:56.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff02ffff640 1 -- 172.21.15.189:0/4184326478 learned_addr learned my addr 172.21.15.189:0/4184326478 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-10T16:29:56.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2960651149 0 0) 0x7ff038097290 con 0x7ff0380a0c50 2024-09-10T16:29:56.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.507 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient(hunting): my global_id is 4147 2024-09-10T16:29:56.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff018003560 con 0x7ff0380a0c50 2024-09-10T16:29:56.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3839416280 0 0) 0x7ff018003560 con 0x7ff0380a0c50 2024-09-10T16:29:56.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff038097290 con 0x7ff0380a0c50 2024-09-10T16:29:56.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff020004b30 con 0x7ff0380a0c50 2024-09-10T16:29:56.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:56.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-10T16:29:56.508 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient(hunting): dump: 2024-09-10T16:29:56.508 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.508 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.508 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.508 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.508 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.508 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.509 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.509 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.509 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.509 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.509 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.509 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.509 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.509 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.509 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.509 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.509 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:29:56.509 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3311067264 0 0) 0x7ff038097290 con 0x7ff0380a0c50 2024-09-10T16:29:56.509 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 >> v1:172.21.15.81:6793/0 conn(0x7ff03813f7a0 legacy=0x7ff0381d6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.509 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 >> v1:172.21.15.81:6791/0 conn(0x7ff038068960 legacy=0x7ff03809a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:29:56.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 1 monclient: found mon.i 2024-09-10T16:29:56.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:56.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:29:56.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 --> v1:172.21.15.189:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0380a69c0 con 0x7ff0380a0c50 2024-09-10T16:29:56.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient: _finish_auth 0 2024-09-10T16:29:56.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:29:56.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:56.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 5 monclient: authenticate success, global_id 4147 2024-09-10T16:29:56.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient: _renew_subs 2024-09-10T16:29:56.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:29:56.510 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 1 -- 172.21.15.189:0/4184326478 --> v1:172.21.15.189:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff038097810 con 0x7ff0380a0c50 2024-09-10T16:29:56.511 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient: _renew_subs 2024-09-10T16:29:56.511 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:29:56.511 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 1 -- 172.21.15.189:0/4184326478 --> v1:172.21.15.189:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7ff03809ac50 con 0x7ff0380a0c50 2024-09-10T16:29:56.511 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 <== mon.7 v1:172.21.15.189:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff020001200 con 0x7ff0380a0c50 2024-09-10T16:29:56.511 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:56.511 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 <== mon.7 v1:172.21.15.189:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff020001a40 con 0x7ff0380a0c50 2024-09-10T16:29:56.511 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.511 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff0367fc640 4 set_mon_vals no callback set 2024-09-10T16:29:56.511 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:29:56.511 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 10 monclient: dump: 2024-09-10T16:29:56.511 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.511 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.511 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.511 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.512 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.512 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.512 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.512 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.512 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.512 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.512 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.512 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.512 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.512 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.513 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.513 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 <== mon.7 v1:172.21.15.189:6792/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7ff020005640 con 0x7ff0380a0c50 2024-09-10T16:29:56.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 <== mon.7 v1:172.21.15.189:6792/0 8 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (unknown 2078702472 0 0) 0x7ff020006d40 con 0x7ff0380a0c50 2024-09-10T16:29:56.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:29:56.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.490+0000 7ff03e114640 1 -- 172.21.15.189:0/4184326478 --> v1:172.21.15.189:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff01c005090 con 0x7ff0380a0c50 2024-09-10T16:29:56.513 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.494+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 <== mon.7 v1:172.21.15.189:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7ff0200068b0 con 0x7ff0380a0c50 2024-09-10T16:29:56.514 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.494+0000 7ff034ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.514 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.494+0000 7ff034ff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:29:56.566 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.566+0000 7ff03e114640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "c098399b-faef-460a-b448-a1c4ba227a5b", "id": 3}] 2024-09-10T16:29:56.566 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.566+0000 7ff03e114640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "c098399b-faef-460a-b448-a1c4ba227a5b", "id": 3}] 2024-09-10T16:29:56.566 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.566+0000 7ff03e114640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:29:56.566 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.566+0000 7ff03e114640 1 -- 172.21.15.189:0/4184326478 --> v1:172.21.15.189:6792/0 -- mon_command({"prefix": "osd new", "uuid": "c098399b-faef-460a-b448-a1c4ba227a5b", "id": 3} v 0) -- 0x7ff01c005380 con 0x7ff0380a0c50 2024-09-10T16:29:56.572 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.570+0000 7ff034ff9640 1 -- 172.21.15.189:0/4184326478 <== mon.7 v1:172.21.15.189:6792/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c098399b-faef-460a-b448-a1c4ba227a5b", "id": 3}]=0 v6) ==== 112+0+2 (unknown 1091453580 0 525046306) 0x7ff020005b60 con 0x7ff0380a0c50 2024-09-10T16:29:56.572 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.570+0000 7ff034ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "c098399b-faef-460a-b448-a1c4ba227a5b", "id": 3}] 2024-09-10T16:29:56.572 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.570+0000 7ff034ff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:29:56.573 INFO:teuthology.orchestra.run.smithi189.stdout:3 2024-09-10T16:29:56.573 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.574+0000 7ff03e114640 10 monclient: shutdown 2024-09-10T16:29:56.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.574+0000 7ff03e114640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:56.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.574+0000 7ff03e114640 1 -- 172.21.15.189:0/4184326478 >> v1:172.21.15.189:6792/0 conn(0x7ff0380a0c50 legacy=0x7ff0381d2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.574+0000 7ff03e114640 1 -- 172.21.15.189:0/4184326478 shutdown_connections 2024-09-10T16:29:56.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.574+0000 7ff03e114640 1 -- 172.21.15.189:0/4184326478 >> 172.21.15.189:0/4184326478 conn(0x7ff0380a87b0 msgr2=0x7ff0380a5070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:56.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.574+0000 7ff03e114640 1 -- 172.21.15.189:0/4184326478 shutdown_connections 2024-09-10T16:29:56.574 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.574+0000 7ff03e114640 1 -- 172.21.15.189:0/4184326478 wait complete. 2024-09-10T16:29:56.589 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new f9ea0631-7d1d-4b3a-9806-684dfc66c44e 4 2024-09-10T16:29:56.703 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.702+0000 7f5fc10e8640 10 monclient: get_monmap_and_config 2024-09-10T16:29:56.703 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.702+0000 7f5fc10e8640 10 monclient: build_initial_monmap 2024-09-10T16:29:56.703 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.702+0000 7f5fc10e8640 10 monclient: monmap: 2024-09-10T16:29:56.703 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 0 2024-09-10T16:29:56.703 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.703 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:56.704955+0000 2024-09-10T16:29:56.703 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:56.704955+0000 2024-09-10T16:29:56.704 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:56.704 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.704 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:56.704 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:56.704 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:56.704 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:56.704 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:56.704 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:56.704 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:56.704 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:56.704 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:56.704 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.710 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.702+0000 7f5fc10e8640 1 Processor -- start 2024-09-10T16:29:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.702+0000 7f5fc10e8640 1 -- start start 2024-09-10T16:29:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.702+0000 7f5fc10e8640 10 monclient: init 2024-09-10T16:29:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.702+0000 7f5fc10e8640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.702+0000 7f5fc10e8640 10 monclient: _add_conns ranks=[6,1,5,3,0,2,7,4,8] 2024-09-10T16:29:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.702+0000 7f5fc10e8640 10 monclient(hunting): picked mon.noname-d con 0x7f5fbc0a7690 addr v1:172.21.15.81:6792/0 2024-09-10T16:29:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.702+0000 7f5fc10e8640 10 monclient(hunting): picked mon.noname-f con 0x7f5fbc068be0 addr v1:172.21.15.189:6789/0 2024-09-10T16:29:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient(hunting): picked mon.noname-h con 0x7f5fbc0a0e20 addr v1:172.21.15.189:6791/0 2024-09-10T16:29:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fbc0a1de0 con 0x7f5fbc068be0 2024-09-10T16:29:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fbc0a1540 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fbc0a6060 con 0x7f5fbc0a7690 2024-09-10T16:29:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:56.711 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient(hunting): authenticate will time out at 959.996081s 2024-09-10T16:29:56.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fba59c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f5fbc068be0 0x7f5fbc13e430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.189:33904/0 (socket says 172.21.15.189:33904) 2024-09-10T16:29:56.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fba59c640 1 -- 172.21.15.189:0/977393903 learned_addr learned my addr 172.21.15.189:0/977393903 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-10T16:29:56.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fbb59e640 1 --1- >> v1:172.21.15.189:6791/0 conn(0x7f5fbc0a0e20 0x7f5fbc141b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6791/0 says I am v1:172.21.15.189:56780/0 (socket says 172.21.15.189:56780) 2024-09-10T16:29:56.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 1 -- 172.21.15.189:0/977393903 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 937830545 0 0) 0x7f5fbc0a1de0 con 0x7f5fbc068be0 2024-09-10T16:29:56.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient(hunting): my global_id is 4123 2024-09-10T16:29:56.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 1 -- 172.21.15.189:0/977393903 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fa4003530 con 0x7f5fbc068be0 2024-09-10T16:29:56.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 1 -- 172.21.15.189:0/977393903 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207160043 0 0) 0x7f5fbc0a1540 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.712 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient(hunting): my global_id is 4145 2024-09-10T16:29:56.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 1 -- 172.21.15.189:0/977393903 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fbc0a1de0 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 1 -- 172.21.15.189:0/977393903 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1693930447 0 0) 0x7f5fa4003530 con 0x7f5fbc068be0 2024-09-10T16:29:56.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 1 -- 172.21.15.189:0/977393903 >> v1:172.21.15.81:6792/0 conn(0x7f5fbc0a7690 legacy=0x7f5fbc0a7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 1 -- 172.21.15.189:0/977393903 >> v1:172.21.15.189:6791/0 conn(0x7f5fbc0a0e20 legacy=0x7f5fbc141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient: _finish_hunting 0 2024-09-10T16:29:56.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 1 monclient: found mon.noname-f 2024-09-10T16:29:56.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:56.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.189:6789/0 2024-09-10T16:29:56.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 1 -- 172.21.15.189:0/977393903 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fbc0a8180 con 0x7f5fbc068be0 2024-09-10T16:29:56.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient: _finish_auth 0 2024-09-10T16:29:56.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient: _check_auth_tickets 2024-09-10T16:29:56.713 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:56.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 1 -- 172.21.15.189:0/977393903 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5fb0001860 con 0x7f5fbc068be0 2024-09-10T16:29:56.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 5 monclient: authenticate success, global_id 4123 2024-09-10T16:29:56.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:29:56.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-10T16:29:56.714 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient: dump: 2024-09-10T16:29:56.714 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.714 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.714 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.714 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.714 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.714 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.714 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.714 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.715 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.715 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.715 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.715 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.715 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.715 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.715 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.715 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.715 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:29:56.715 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 1 -- 172.21.15.189:0/977393903 <== mon.1 v1:172.21.15.189:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5fb0001a80 con 0x7f5fbc068be0 2024-09-10T16:29:56.715 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:56.715 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient: get_monmap_and_config success 2024-09-10T16:29:56.715 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 4 set_mon_vals no callback set 2024-09-10T16:29:56.715 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 1 -- 172.21.15.189:0/977393903 <== mon.1 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5fb0004bf0 con 0x7f5fbc068be0 2024-09-10T16:29:56.716 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.716 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:29:56.716 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fb9d9b640 10 monclient: dump: 2024-09-10T16:29:56.716 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.716 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.716 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.716 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.716 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.716 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.716 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.716 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.716 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.717 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.717 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.717 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.717 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.717 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.717 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.717 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient: shutdown 2024-09-10T16:29:56.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:56.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 1 -- 172.21.15.189:0/977393903 >> v1:172.21.15.189:6789/0 conn(0x7f5fbc068be0 legacy=0x7f5fbc13e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 1 -- 172.21.15.189:0/977393903 shutdown_connections 2024-09-10T16:29:56.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 1 -- 172.21.15.189:0/977393903 >> 172.21.15.189:0/977393903 conn(0x7f5fbc0a5280 msgr2=0x7f5fbc0a5660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:56.717 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 1 -- 172.21.15.189:0/977393903 shutdown_connections 2024-09-10T16:29:56.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 1 -- 172.21.15.189:0/977393903 wait complete. 2024-09-10T16:29:56.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient: build_initial_monmap 2024-09-10T16:29:56.718 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient: monmap: 2024-09-10T16:29:56.718 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 0 2024-09-10T16:29:56.718 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:29:56.718 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 0.000000 2024-09-10T16:29:56.718 INFO:teuthology.orchestra.run.smithi189.stderr:created 0.000000 2024-09-10T16:29:56.718 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:56.718 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 1 2024-09-10T16:29:56.718 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:56.718 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:56.718 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:56.718 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:56.718 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:56.719 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:56.719 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:56.719 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:56.719 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:56.719 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 1 Processor -- start 2024-09-10T16:29:56.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 1 -- start start 2024-09-10T16:29:56.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient: init 2024-09-10T16:29:56.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:56.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient: _add_conns ranks=[2,5,3,6,8,7,1,4,0] 2024-09-10T16:29:56.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient(hunting): picked mon.noname-b con 0x7f5fbc068be0 addr v1:172.21.15.81:6790/0 2024-09-10T16:29:56.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient(hunting): picked mon.noname-h con 0x7f5fbc0a0e20 addr v1:172.21.15.189:6791/0 2024-09-10T16:29:56.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient(hunting): picked mon.noname-g con 0x7f5fbc0a7690 addr v1:172.21.15.189:6790/0 2024-09-10T16:29:56.719 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fbc1282a0 con 0x7f5fbc068be0 2024-09-10T16:29:56.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fbc1296d0 con 0x7f5fbc0a7690 2024-09-10T16:29:56.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fbc0a7160 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:56.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fc10e8640 10 monclient(hunting): authenticate will time out at 959.999327s 2024-09-10T16:29:56.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fba59c640 1 --1- >> v1:172.21.15.189:6791/0 conn(0x7f5fbc0a0e20 0x7f5fbc126370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6791/0 says I am v1:172.21.15.189:56788/0 (socket says 172.21.15.189:56788) 2024-09-10T16:29:56.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fba59c640 1 -- 172.21.15.189:0/509244231 learned_addr learned my addr 172.21.15.189:0/509244231 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-10T16:29:56.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fbb59e640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f5fbc0a7690 0x7f5fbc1d61c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.189:42658/0 (socket says 172.21.15.189:42658) 2024-09-10T16:29:56.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2593903964 0 0) 0x7f5fbc0a7160 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 10 monclient(hunting): my global_id is 4154 2024-09-10T16:29:56.720 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fa8003530 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.721 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3985617316 0 0) 0x7f5fbc1296d0 con 0x7f5fbc0a7690 2024-09-10T16:29:56.721 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.721 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.721 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.721 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 10 monclient(hunting): my global_id is 4134 2024-09-10T16:29:56.721 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fbc0a7160 con 0x7f5fbc0a7690 2024-09-10T16:29:56.721 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3240222634 0 0) 0x7f5fa8003530 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.721 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5fbc1296d0 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.721 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5fb0004b30 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.721 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:56.721 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-10T16:29:56.721 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.706+0000 7f5fa37fe640 10 monclient(hunting): dump: 2024-09-10T16:29:56.721 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.722 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.722 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.722 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.722 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.722 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.722 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.722 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.722 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.722 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.722 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.722 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.722 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.722 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.722 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.723 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:29:56.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1281890904 0 0) 0x7f5fbc0a7160 con 0x7f5fbc0a7690 2024-09-10T16:29:56.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5fa8003530 con 0x7f5fbc0a7690 2024-09-10T16:29:56.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5fb4001730 con 0x7f5fbc0a7690 2024-09-10T16:29:56.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:56.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-10T16:29:56.723 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient(hunting): dump: 2024-09-10T16:29:56.724 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.724 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.724 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.724 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.724 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.724 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.724 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.724 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.724 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.724 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.724 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.724 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.724 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.725 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.725 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.725 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2747192182 0 0) 0x7f5fbc1282a0 con 0x7f5fbc068be0 2024-09-10T16:29:56.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient(hunting): my global_id is 4133 2024-09-10T16:29:56.725 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5fbc0a7160 con 0x7f5fbc068be0 2024-09-10T16:29:56.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2718659511 0 0) 0x7f5fbc1296d0 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 >> v1:172.21.15.189:6790/0 conn(0x7f5fbc0a7690 legacy=0x7f5fbc1d61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 >> v1:172.21.15.81:6790/0 conn(0x7f5fbc068be0 legacy=0x7f5fbc125c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient: _finish_hunting 0 2024-09-10T16:29:56.726 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 monclient: found mon.h 2024-09-10T16:29:56.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:56.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.189:6791/0 2024-09-10T16:29:56.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 --> v1:172.21.15.189:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fbc0736c0 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient: _finish_auth 0 2024-09-10T16:29:56.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient: _check_auth_tickets 2024-09-10T16:29:56.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:56.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fc10e8640 5 monclient: authenticate success, global_id 4154 2024-09-10T16:29:56.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fc10e8640 10 monclient: _renew_subs 2024-09-10T16:29:56.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fc10e8640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.189:6791/0 2024-09-10T16:29:56.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fc10e8640 1 -- 172.21.15.189:0/509244231 --> v1:172.21.15.189:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5fbc073120 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fc10e8640 10 monclient: _renew_subs 2024-09-10T16:29:56.728 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fc10e8640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.189:6791/0 2024-09-10T16:29:56.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fc10e8640 1 -- 172.21.15.189:0/509244231 --> v1:172.21.15.189:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f5fbc1293f0 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 <== mon.5 v1:172.21.15.189:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5fb0004e30 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:56.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 <== mon.5 v1:172.21.15.189:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5fb0001a60 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:29:56.729 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient: dump: 2024-09-10T16:29:56.729 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.729 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.729 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.729 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.729 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.729 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.730 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.730 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.730 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.730 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.730 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.730 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.730 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.730 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.730 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.730 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.730 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 <== mon.5 v1:172.21.15.189:6791/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f5fb00056b0 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.730 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 <== mon.5 v1:172.21.15.189:6791/0 8 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (unknown 3390798336 0 0) 0x7f5fb0006d40 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.730 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fb959a640 4 set_mon_vals no callback set 2024-09-10T16:29:56.731 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fc10e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.731 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fc10e8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.731 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fc10e8640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.189:6791/0 2024-09-10T16:29:56.731 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fc10e8640 1 -- 172.21.15.189:0/509244231 --> v1:172.21.15.189:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f9c005090 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.731 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 <== mon.5 v1:172.21.15.189:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7f5fb0006830 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.731 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.731 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.710+0000 7f5fa37fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:29:56.783 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.782+0000 7f5fc10e8640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "f9ea0631-7d1d-4b3a-9806-684dfc66c44e", "id": 4}] 2024-09-10T16:29:56.783 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.782+0000 7f5fc10e8640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "f9ea0631-7d1d-4b3a-9806-684dfc66c44e", "id": 4}] 2024-09-10T16:29:56.783 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.782+0000 7f5fc10e8640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.189:6791/0 2024-09-10T16:29:56.783 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.782+0000 7f5fc10e8640 1 -- 172.21.15.189:0/509244231 --> v1:172.21.15.189:6791/0 -- mon_command({"prefix": "osd new", "uuid": "f9ea0631-7d1d-4b3a-9806-684dfc66c44e", "id": 4} v 0) -- 0x7f5f9c005380 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.792 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.790+0000 7f5fa37fe640 1 -- 172.21.15.189:0/509244231 <== mon.5 v1:172.21.15.189:6791/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "f9ea0631-7d1d-4b3a-9806-684dfc66c44e", "id": 4}]=0 v7) ==== 112+0+2 (unknown 2199239696 0 1697012583) 0x7f5fb0005a90 con 0x7f5fbc0a0e20 2024-09-10T16:29:56.792 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.790+0000 7f5fa37fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "f9ea0631-7d1d-4b3a-9806-684dfc66c44e", "id": 4}] 2024-09-10T16:29:56.792 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.790+0000 7f5fa37fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:29:56.792 INFO:teuthology.orchestra.run.smithi189.stdout:4 2024-09-10T16:29:56.793 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.794+0000 7f5fc10e8640 10 monclient: shutdown 2024-09-10T16:29:56.793 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.794+0000 7f5fc10e8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:56.793 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.794+0000 7f5fc10e8640 1 -- 172.21.15.189:0/509244231 >> v1:172.21.15.189:6791/0 conn(0x7f5fbc0a0e20 legacy=0x7f5fbc126370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.794+0000 7f5fc10e8640 1 -- 172.21.15.189:0/509244231 shutdown_connections 2024-09-10T16:29:56.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.794+0000 7f5fc10e8640 1 -- 172.21.15.189:0/509244231 >> 172.21.15.189:0/509244231 conn(0x7f5fbc0a5280 msgr2=0x7f5fbc1428c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:56.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.794+0000 7f5fc10e8640 1 -- 172.21.15.189:0/509244231 shutdown_connections 2024-09-10T16:29:56.794 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.794+0000 7f5fc10e8640 1 -- 172.21.15.189:0/509244231 wait complete. 2024-09-10T16:29:56.810 DEBUG:teuthology.orchestra.run.smithi189:> sudo ceph --cluster ceph osd new e32e3250-fe69-4ef0-8553-974e89bf80e3 5 2024-09-10T16:29:56.923 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 10 monclient: get_monmap_and_config 2024-09-10T16:29:56.923 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 10 monclient: build_initial_monmap 2024-09-10T16:29:56.923 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 10 monclient: monmap: 2024-09-10T16:29:56.923 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 0 2024-09-10T16:29:56.923 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.923 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:56.924783+0000 2024-09-10T16:29:56.923 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:56.924783+0000 2024-09-10T16:29:56.923 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:56.923 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.923 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:56.924 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:56.924 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:56.924 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:56.924 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:56.924 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:56.924 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:56.924 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:56.924 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:56.924 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.926 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 1 Processor -- start 2024-09-10T16:29:56.926 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 1 -- start start 2024-09-10T16:29:56.926 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 10 monclient: init 2024-09-10T16:29:56.927 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:56.927 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 10 monclient: _add_conns ranks=[4,8,5,6,1,2,7,0,3] 2024-09-10T16:29:56.927 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 10 monclient(hunting): picked mon.noname-c con 0x7f3da8139300 addr v1:172.21.15.81:6791/0 2024-09-10T16:29:56.927 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 10 monclient(hunting): picked mon.noname-e con 0x7f3da80743b0 addr v1:172.21.15.81:6793/0 2024-09-10T16:29:56.928 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 10 monclient(hunting): picked mon.noname-h con 0x7f3da813f970 addr v1:172.21.15.189:6791/0 2024-09-10T16:29:56.928 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da806f6a0 con 0x7f3da8139300 2024-09-10T16:29:56.928 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da80a44b0 con 0x7f3da813f970 2024-09-10T16:29:56.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da8139df0 con 0x7f3da80743b0 2024-09-10T16:29:56.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:56.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dae798640 10 monclient(hunting): authenticate will time out at 960.215357s 2024-09-10T16:29:56.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dacd35640 1 --1- >> v1:172.21.15.189:6791/0 conn(0x7f3da813f970 0x7f3da8141d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6791/0 says I am v1:172.21.15.189:56798/0 (socket says 172.21.15.189:56798) 2024-09-10T16:29:56.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3dacd35640 1 -- 172.21.15.189:0/3523555205 learned_addr learned my addr 172.21.15.189:0/3523555205 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-10T16:29:56.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3da6ffd640 1 -- 172.21.15.189:0/3523555205 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2434813286 0 0) 0x7f3da80a44b0 con 0x7f3da813f970 2024-09-10T16:29:56.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3da6ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3da6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3da6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3da6ffd640 10 monclient(hunting): my global_id is 4163 2024-09-10T16:29:56.929 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3da6ffd640 1 -- 172.21.15.189:0/3523555205 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d90003530 con 0x7f3da813f970 2024-09-10T16:29:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.922+0000 7f3da6ffd640 1 -- 172.21.15.189:0/3523555205 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 100086260 0 0) 0x7f3d90003530 con 0x7f3da813f970 2024-09-10T16:29:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 1 -- 172.21.15.189:0/3523555205 >> v1:172.21.15.81:6793/0 conn(0x7f3da80743b0 legacy=0x7f3da813e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 1 -- 172.21.15.189:0/3523555205 >> v1:172.21.15.81:6791/0 conn(0x7f3da8139300 legacy=0x7f3da81396e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:29:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 1 monclient: found mon.noname-h 2024-09-10T16:29:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.189:6791/0 2024-09-10T16:29:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 1 -- 172.21.15.189:0/3523555205 --> v1:172.21.15.189:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da806f420 con 0x7f3da813f970 2024-09-10T16:29:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 10 monclient: _finish_auth 0 2024-09-10T16:29:56.932 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:29:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 1 -- 172.21.15.189:0/3523555205 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3da0001bc0 con 0x7f3da813f970 2024-09-10T16:29:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 5 monclient: authenticate success, global_id 4163 2024-09-10T16:29:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:29:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-10T16:29:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 10 monclient: dump: 2024-09-10T16:29:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.933 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.934 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:29:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 1 -- 172.21.15.189:0/3523555205 <== mon.5 v1:172.21.15.189:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3da0001de0 con 0x7f3da813f970 2024-09-10T16:29:56.934 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 10 monclient: get_monmap_and_config success 2024-09-10T16:29:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 4 set_mon_vals no callback set 2024-09-10T16:29:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 1 -- 172.21.15.189:0/3523555205 <== mon.5 v1:172.21.15.189:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3da0004f70 con 0x7f3da813f970 2024-09-10T16:29:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:29:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da6ffd640 10 monclient: dump: 2024-09-10T16:29:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.935 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.936 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.936 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.936 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.936 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.936 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.936 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.936 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.936 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.936 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 10 monclient: shutdown 2024-09-10T16:29:56.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:56.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 1 -- 172.21.15.189:0/3523555205 >> v1:172.21.15.189:6791/0 conn(0x7f3da813f970 legacy=0x7f3da8141d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 1 -- 172.21.15.189:0/3523555205 shutdown_connections 2024-09-10T16:29:56.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 1 -- 172.21.15.189:0/3523555205 >> 172.21.15.189:0/3523555205 conn(0x7f3da80a9e30 msgr2=0x7f3da8071c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:56.940 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 1 -- 172.21.15.189:0/3523555205 shutdown_connections 2024-09-10T16:29:56.941 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 1 -- 172.21.15.189:0/3523555205 wait complete. 2024-09-10T16:29:56.941 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 10 monclient: build_initial_monmap 2024-09-10T16:29:56.941 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 10 monclient: monmap: 2024-09-10T16:29:56.941 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 0 2024-09-10T16:29:56.941 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:29:56.941 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 0.000000 2024-09-10T16:29:56.941 INFO:teuthology.orchestra.run.smithi189.stderr:created 0.000000 2024-09-10T16:29:56.941 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:56.941 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 1 2024-09-10T16:29:56.941 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:56.941 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:56.941 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:56.942 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:56.942 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:56.942 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:56.942 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:56.942 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:56.942 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:56.942 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 1 Processor -- start 2024-09-10T16:29:56.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 1 -- start start 2024-09-10T16:29:56.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 10 monclient: init 2024-09-10T16:29:56.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:56.942 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 10 monclient: _add_conns ranks=[2,6,7,0,8,5,3,1,4] 2024-09-10T16:29:56.943 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 10 monclient(hunting): picked mon.noname-b con 0x7f3da80743b0 addr v1:172.21.15.81:6790/0 2024-09-10T16:29:56.943 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 10 monclient(hunting): picked mon.noname-d con 0x7f3da8139300 addr v1:172.21.15.81:6792/0 2024-09-10T16:29:56.943 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 10 monclient(hunting): picked mon.noname-i con 0x7f3da813f970 addr v1:172.21.15.189:6792/0 2024-09-10T16:29:56.943 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da813f660 con 0x7f3da80743b0 2024-09-10T16:29:56.943 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da8071b80 con 0x7f3da8139300 2024-09-10T16:29:56.943 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3da8122fa0 con 0x7f3da813f970 2024-09-10T16:29:56.943 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:56.943 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 10 monclient(hunting): authenticate will time out at 960.218991s 2024-09-10T16:29:56.943 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dacd35640 1 --1- >> v1:172.21.15.189:6792/0 conn(0x7f3da813f970 0x7f3da81d5d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6792/0 says I am v1:172.21.15.189:36664/0 (socket says 172.21.15.189:36664) 2024-09-10T16:29:56.943 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dacd35640 1 -- 172.21.15.189:0/1838946513 learned_addr learned my addr 172.21.15.189:0/1838946513 (peer_addr_for_me v1:172.21.15.189:0/0) 2024-09-10T16:29:56.943 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2472630624 0 0) 0x7f3da8122fa0 con 0x7f3da813f970 2024-09-10T16:29:56.943 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.943 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.944 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.944 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): my global_id is 4156 2024-09-10T16:29:56.944 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d94003560 con 0x7f3da813f970 2024-09-10T16:29:56.944 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2494968985 0 0) 0x7f3d94003560 con 0x7f3da813f970 2024-09-10T16:29:56.944 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3da8122fa0 con 0x7f3da813f970 2024-09-10T16:29:56.944 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3da0004eb0 con 0x7f3da813f970 2024-09-10T16:29:56.944 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:56.944 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-10T16:29:56.944 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): dump: 2024-09-10T16:29:56.944 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.944 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.944 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.945 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.945 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.945 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.945 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.945 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.945 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.945 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.945 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.945 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.945 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.945 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.945 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.945 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:29:56.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1207714968 0 0) 0x7f3d98001130 con 0x7f3da80743b0 2024-09-10T16:29:56.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): my global_id is 4142 2024-09-10T16:29:56.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d94003560 con 0x7f3da80743b0 2024-09-10T16:29:56.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4166451970 0 0) 0x7f3da8139df0 con 0x7f3da8139300 2024-09-10T16:29:56.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:29:56.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:56.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:56.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient(hunting): my global_id is 4146 2024-09-10T16:29:56.946 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d98001130 con 0x7f3da8139300 2024-09-10T16:29:56.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3770595745 0 0) 0x7f3da8122fa0 con 0x7f3da813f970 2024-09-10T16:29:56.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 >> v1:172.21.15.81:6792/0 conn(0x7f3da8139300 legacy=0x7f3da81ce200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 >> v1:172.21.15.81:6790/0 conn(0x7f3da80743b0 legacy=0x7f3da81cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:56.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:29:56.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 1 monclient: found mon.i 2024-09-10T16:29:56.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:56.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:29:56.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 --> v1:172.21.15.189:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3da8123280 con 0x7f3da813f970 2024-09-10T16:29:56.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient: _finish_auth 0 2024-09-10T16:29:56.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:29:56.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3da4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:56.947 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 5 monclient: authenticate success, global_id 4156 2024-09-10T16:29:56.948 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 10 monclient: _renew_subs 2024-09-10T16:29:56.948 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:29:56.948 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.926+0000 7f3dae798640 1 -- 172.21.15.189:0/1838946513 --> v1:172.21.15.189:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3da81ce910 con 0x7f3da813f970 2024-09-10T16:29:56.948 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3dae798640 10 monclient: _renew_subs 2024-09-10T16:29:56.948 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3dae798640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:29:56.948 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3dae798640 1 -- 172.21.15.189:0/1838946513 --> v1:172.21.15.189:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f3da8121ff0 con 0x7f3da813f970 2024-09-10T16:29:56.948 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 <== mon.7 v1:172.21.15.189:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3da0001dc0 con 0x7f3da813f970 2024-09-10T16:29:56.948 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3da4ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:56.948 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 <== mon.7 v1:172.21.15.189:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3da0001430 con 0x7f3da813f970 2024-09-10T16:29:56.948 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3da4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:56.948 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3da67fc640 4 set_mon_vals no callback set 2024-09-10T16:29:56.948 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3da4ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:29:56.948 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3da4ff9640 10 monclient: dump: 2024-09-10T16:29:56.949 INFO:teuthology.orchestra.run.smithi189.stderr:epoch 1 2024-09-10T16:29:56.949 INFO:teuthology.orchestra.run.smithi189.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:56.949 INFO:teuthology.orchestra.run.smithi189.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.949 INFO:teuthology.orchestra.run.smithi189.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:56.949 INFO:teuthology.orchestra.run.smithi189.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:56.949 INFO:teuthology.orchestra.run.smithi189.stderr:election_strategy: 3 2024-09-10T16:29:56.949 INFO:teuthology.orchestra.run.smithi189.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:56.949 INFO:teuthology.orchestra.run.smithi189.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:56.949 INFO:teuthology.orchestra.run.smithi189.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:56.949 INFO:teuthology.orchestra.run.smithi189.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:56.949 INFO:teuthology.orchestra.run.smithi189.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:56.949 INFO:teuthology.orchestra.run.smithi189.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:56.949 INFO:teuthology.orchestra.run.smithi189.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:56.950 INFO:teuthology.orchestra.run.smithi189.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:56.950 INFO:teuthology.orchestra.run.smithi189.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:56.950 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:29:56.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 <== mon.7 v1:172.21.15.189:6792/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7f3da0005900 con 0x7f3da813f970 2024-09-10T16:29:56.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 <== mon.7 v1:172.21.15.189:6792/0 8 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (unknown 1736262907 0 0) 0x7f3da0006170 con 0x7f3da813f970 2024-09-10T16:29:56.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3dae798640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3dae798640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3dae798640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:29:56.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3dae798640 1 -- 172.21.15.189:0/1838946513 --> v1:172.21.15.189:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d88005090 con 0x7f3da813f970 2024-09-10T16:29:56.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 <== mon.7 v1:172.21.15.189:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7f3da0006460 con 0x7f3da813f970 2024-09-10T16:29:56.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3da4ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:56.950 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:56.930+0000 7f3da4ff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:29:57.001 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:57.002+0000 7f3dae798640 10 start_mon_command cmd=[{"prefix": "osd new", "uuid": "e32e3250-fe69-4ef0-8553-974e89bf80e3", "id": 5}] 2024-09-10T16:29:57.002 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:57.002+0000 7f3dae798640 10 monclient: _send_command 2 [{"prefix": "osd new", "uuid": "e32e3250-fe69-4ef0-8553-974e89bf80e3", "id": 5}] 2024-09-10T16:29:57.002 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:57.002+0000 7f3dae798640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:29:57.002 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:57.002+0000 7f3dae798640 1 -- 172.21.15.189:0/1838946513 --> v1:172.21.15.189:6792/0 -- mon_command({"prefix": "osd new", "uuid": "e32e3250-fe69-4ef0-8553-974e89bf80e3", "id": 5} v 0) -- 0x7f3d88005380 con 0x7f3da813f970 2024-09-10T16:29:57.008 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:57.006+0000 7f3da4ff9640 1 -- 172.21.15.189:0/1838946513 <== mon.7 v1:172.21.15.189:6792/0 10 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e32e3250-fe69-4ef0-8553-974e89bf80e3", "id": 5}]=0 v8) ==== 112+0+2 (unknown 1592541110 0 1988412176) 0x7f3da0005bf0 con 0x7f3da813f970 2024-09-10T16:29:57.008 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:57.006+0000 7f3da4ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd new", "uuid": "e32e3250-fe69-4ef0-8553-974e89bf80e3", "id": 5}] 2024-09-10T16:29:57.008 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:57.006+0000 7f3da4ff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:29:57.008 INFO:teuthology.orchestra.run.smithi189.stdout:5 2024-09-10T16:29:57.009 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:57.010+0000 7f3dae798640 10 monclient: shutdown 2024-09-10T16:29:57.009 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:57.010+0000 7f3dae798640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:57.009 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:57.010+0000 7f3dae798640 1 -- 172.21.15.189:0/1838946513 >> v1:172.21.15.189:6792/0 conn(0x7f3da813f970 legacy=0x7f3da81d5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:57.009 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:57.010+0000 7f3dae798640 1 -- 172.21.15.189:0/1838946513 shutdown_connections 2024-09-10T16:29:57.009 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:57.010+0000 7f3dae798640 1 -- 172.21.15.189:0/1838946513 >> 172.21.15.189:0/1838946513 conn(0x7f3da80a9e30 msgr2=0x7f3da8072f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:57.009 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:57.010+0000 7f3dae798640 1 -- 172.21.15.189:0/1838946513 shutdown_connections 2024-09-10T16:29:57.009 INFO:teuthology.orchestra.run.smithi189.stderr:2024-09-10T16:29:57.010+0000 7f3dae798640 1 -- 172.21.15.189:0/1838946513 wait complete. 2024-09-10T16:29:57.023 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-10T16:29:57.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-10T16:29:57.026 INFO:tasks.ceph.osd.0:Started 2024-09-10T16:29:57.026 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-10T16:29:57.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-10T16:29:57.029 INFO:tasks.ceph.osd.1:Started 2024-09-10T16:29:57.029 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-10T16:29:57.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-10T16:29:57.032 INFO:tasks.ceph.osd.2:Started 2024-09-10T16:29:57.032 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-10T16:29:57.032 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-10T16:29:57.034 INFO:tasks.ceph.osd.3:Started 2024-09-10T16:29:57.034 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-10T16:29:57.035 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-10T16:29:57.037 INFO:tasks.ceph.osd.4:Started 2024-09-10T16:29:57.037 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-10T16:29:57.037 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-10T16:29:57.039 INFO:tasks.ceph.osd.5:Started 2024-09-10T16:29:57.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T16:29:57.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.155+0000 7fcf5a77d640 10 monclient: get_monmap_and_config 2024-09-10T16:29:57.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.155+0000 7fcf5a77d640 10 monclient: build_initial_monmap 2024-09-10T16:29:57.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.155+0000 7fcf5a77d640 10 monclient: monmap: 2024-09-10T16:29:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:29:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:57.160894+0000 2024-09-10T16:29:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:57.160894+0000 2024-09-10T16:29:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:57.160 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:57.161 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.155+0000 7fcf5a77d640 1 Processor -- start 2024-09-10T16:29:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.155+0000 7fcf5a77d640 1 -- start start 2024-09-10T16:29:57.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.155+0000 7fcf5a77d640 10 monclient: init 2024-09-10T16:29:57.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.155+0000 7fcf5a77d640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:57.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.155+0000 7fcf5a77d640 10 monclient: _add_conns ranks=[5,1,4,7,8,6,2,3,0] 2024-09-10T16:29:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.155+0000 7fcf5a77d640 10 monclient(hunting): picked mon.noname-h con 0x7fcf5409ca10 addr v1:172.21.15.189:6791/0 2024-09-10T16:29:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.155+0000 7fcf5a77d640 10 monclient(hunting): picked mon.noname-f con 0x7fcf540a56e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:29:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.155+0000 7fcf5a77d640 10 monclient(hunting): picked mon.noname-c con 0x7fcf540a5b00 addr v1:172.21.15.81:6791/0 2024-09-10T16:29:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf541362b0 con 0x7fcf540a56e0 2024-09-10T16:29:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf540a80b0 con 0x7fcf540a5b00 2024-09-10T16:29:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf5409de70 con 0x7fcf5409ca10 2024-09-10T16:29:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 10 monclient(hunting): authenticate will time out at 964.560054s 2024-09-10T16:29:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf58d1a640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fcf540a5b00 0x7fcf54141650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:44628/0 (socket says 172.21.15.81:44628) 2024-09-10T16:29:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf58d1a640 1 -- 172.21.15.81:0/2207790141 learned_addr learned my addr 172.21.15.81:0/2207790141 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:29:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 1 -- 172.21.15.81:0/2207790141 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 682145498 0 0) 0x7fcf540a80b0 con 0x7fcf540a5b00 2024-09-10T16:29:57.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient(hunting): _negotiate 2024-09-10T16:29:57.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:57.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:57.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient(hunting): my global_id is 4189 2024-09-10T16:29:57.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 1 -- 172.21.15.81:0/2207790141 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf34003530 con 0x7fcf540a5b00 2024-09-10T16:29:57.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 1 -- 172.21.15.81:0/2207790141 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3311750496 0 0) 0x7fcf541362b0 con 0x7fcf540a56e0 2024-09-10T16:29:57.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient(hunting): _negotiate 2024-09-10T16:29:57.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:57.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:57.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient(hunting): my global_id is 4168 2024-09-10T16:29:57.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 1 -- 172.21.15.81:0/2207790141 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf540a80b0 con 0x7fcf540a56e0 2024-09-10T16:29:57.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 1 -- 172.21.15.81:0/2207790141 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 626350470 0 0) 0x7fcf5409de70 con 0x7fcf5409ca10 2024-09-10T16:29:57.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient(hunting): _negotiate 2024-09-10T16:29:57.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient(hunting): my global_id is 4172 2024-09-10T16:29:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 1 -- 172.21.15.81:0/2207790141 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf541362b0 con 0x7fcf5409ca10 2024-09-10T16:29:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 1 -- 172.21.15.81:0/2207790141 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 849253982 0 0) 0x7fcf34003530 con 0x7fcf540a5b00 2024-09-10T16:29:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 1 -- 172.21.15.81:0/2207790141 >> v1:172.21.15.189:6791/0 conn(0x7fcf5409ca10 legacy=0x7fcf54135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 1 -- 172.21.15.81:0/2207790141 >> v1:172.21.15.189:6789/0 conn(0x7fcf540a56e0 legacy=0x7fcf5413df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient: _finish_hunting 0 2024-09-10T16:29:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 1 monclient: found mon.noname-c 2024-09-10T16:29:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:29:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 1 -- 172.21.15.81:0/2207790141 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf5409e150 con 0x7fcf540a5b00 2024-09-10T16:29:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient: _finish_auth 0 2024-09-10T16:29:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient: _check_auth_tickets 2024-09-10T16:29:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 1 -- 172.21.15.81:0/2207790141 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcf4c001bc0 con 0x7fcf540a5b00 2024-09-10T16:29:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:29:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient: dump: 2024-09-10T16:29:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:29:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:57.171 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:57.172 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:57.172 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:57.172 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:57.172 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:57.172 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:57.172 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:57.172 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:57.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 5 monclient: authenticate success, global_id 4189 2024-09-10T16:29:57.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:29:57.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 1 -- 172.21.15.81:0/2207790141 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcf4c001de0 con 0x7fcf540a5b00 2024-09-10T16:29:57.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:57.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 1 -- 172.21.15.81:0/2207790141 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcf4c004f70 con 0x7fcf540a5b00 2024-09-10T16:29:57.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:57.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:29:57.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf537fe640 10 monclient: dump: 2024-09-10T16:29:57.173 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:29:57.173 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:57.173 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.173 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.173 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:57.173 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:57.173 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:57.173 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:57.173 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:57.173 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:57.173 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:57.173 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:57.174 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 10 monclient: get_monmap_and_config success 2024-09-10T16:29:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 4 set_mon_vals no callback set 2024-09-10T16:29:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 10 monclient: shutdown 2024-09-10T16:29:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 1 -- 172.21.15.81:0/2207790141 >> v1:172.21.15.81:6791/0 conn(0x7fcf540a5b00 legacy=0x7fcf54141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 1 -- 172.21.15.81:0/2207790141 shutdown_connections 2024-09-10T16:29:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 1 -- 172.21.15.81:0/2207790141 >> 172.21.15.81:0/2207790141 conn(0x7fcf5406dc90 msgr2=0x7fcf540ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 1 -- 172.21.15.81:0/2207790141 shutdown_connections 2024-09-10T16:29:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 1 -- 172.21.15.81:0/2207790141 wait complete. 2024-09-10T16:29:57.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 10 monclient: build_initial_monmap 2024-09-10T16:29:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 10 monclient: monmap: 2024-09-10T16:29:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:29:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:29:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:29:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:29:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:29:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:57.175 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:57.176 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 1 Processor -- start 2024-09-10T16:29:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 1 -- start start 2024-09-10T16:29:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 10 monclient: init 2024-09-10T16:29:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 10 monclient: _add_conns ranks=[4,1,6,3,8,7,0,2,5] 2024-09-10T16:29:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 10 monclient(hunting): picked mon.noname-c con 0x7fcf5409ca10 addr v1:172.21.15.81:6791/0 2024-09-10T16:29:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 10 monclient(hunting): picked mon.noname-f con 0x7fcf540a56e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:29:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 10 monclient(hunting): picked mon.noname-d con 0x7fcf540a5b00 addr v1:172.21.15.81:6792/0 2024-09-10T16:29:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf54131e60 con 0x7fcf540a56e0 2024-09-10T16:29:57.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf5412f7b0 con 0x7fcf5409ca10 2024-09-10T16:29:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcf54132140 con 0x7fcf540a5b00 2024-09-10T16:29:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf5a77d640 10 monclient(hunting): authenticate will time out at 964.563087s 2024-09-10T16:29:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf53fff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fcf5409ca10 0x7fcf5412e990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:44644/0 (socket says 172.21.15.81:44644) 2024-09-10T16:29:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf53fff640 1 -- 172.21.15.81:0/3211009914 learned_addr learned my addr 172.21.15.81:0/3211009914 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:29:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 285337238 0 0) 0x7fcf5412f7b0 con 0x7fcf5409ca10 2024-09-10T16:29:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): _negotiate 2024-09-10T16:29:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): my global_id is 4198 2024-09-10T16:29:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf38003530 con 0x7fcf5409ca10 2024-09-10T16:29:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3354575272 0 0) 0x7fcf54132140 con 0x7fcf540a5b00 2024-09-10T16:29:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): _negotiate 2024-09-10T16:29:57.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): my global_id is 4173 2024-09-10T16:29:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf5412f7b0 con 0x7fcf540a5b00 2024-09-10T16:29:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3233734085 0 0) 0x7fcf54131e60 con 0x7fcf540a56e0 2024-09-10T16:29:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): _negotiate 2024-09-10T16:29:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): my global_id is 4177 2024-09-10T16:29:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcf54132140 con 0x7fcf540a56e0 2024-09-10T16:29:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 249553337 0 0) 0x7fcf38003530 con 0x7fcf5409ca10 2024-09-10T16:29:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf54131e60 con 0x7fcf5409ca10 2024-09-10T16:29:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcf44001b60 con 0x7fcf5409ca10 2024-09-10T16:29:57.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:29:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): dump: 2024-09-10T16:29:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:29:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:57.179 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:57.180 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:29:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 289470972 0 0) 0x7fcf5412f7b0 con 0x7fcf540a5b00 2024-09-10T16:29:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf38003530 con 0x7fcf540a5b00 2024-09-10T16:29:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcf4c0013b0 con 0x7fcf540a5b00 2024-09-10T16:29:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-10T16:29:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): dump: 2024-09-10T16:29:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:29:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:57.180 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:57.181 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:57.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2737507220 0 0) 0x7fcf54132140 con 0x7fcf540a56e0 2024-09-10T16:29:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcf5412f7b0 con 0x7fcf540a56e0 2024-09-10T16:29:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcf3c001a20 con 0x7fcf540a56e0 2024-09-10T16:29:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-10T16:29:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient(hunting): dump: 2024-09-10T16:29:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:29:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:57.182 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:57.183 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 954729627 0 0) 0x7fcf54131e60 con 0x7fcf5409ca10 2024-09-10T16:29:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 >> v1:172.21.15.81:6792/0 conn(0x7fcf540a5b00 legacy=0x7fcf541d5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 >> v1:172.21.15.189:6789/0 conn(0x7fcf540a56e0 legacy=0x7fcf5412f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient: _finish_hunting 0 2024-09-10T16:29:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 monclient: found mon.c 2024-09-10T16:29:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:57.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:29:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.159+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf540aa550 con 0x7fcf5409ca10 2024-09-10T16:29:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf517fa640 10 monclient: _finish_auth 0 2024-09-10T16:29:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf517fa640 10 monclient: _check_auth_tickets 2024-09-10T16:29:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf517fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf5a77d640 5 monclient: authenticate success, global_id 4198 2024-09-10T16:29:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf5a77d640 10 monclient: _renew_subs 2024-09-10T16:29:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf5a77d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:29:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf5a77d640 1 -- 172.21.15.81:0/3211009914 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcf540aaa80 con 0x7fcf5409ca10 2024-09-10T16:29:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf5a77d640 10 monclient: _renew_subs 2024-09-10T16:29:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf5a77d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:29:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf5a77d640 1 -- 172.21.15.81:0/3211009914 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fcf541307a0 con 0x7fcf5409ca10 2024-09-10T16:29:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcf440038d0 con 0x7fcf5409ca10 2024-09-10T16:29:57.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf517fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcf44003e00 con 0x7fcf5409ca10 2024-09-10T16:29:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf517fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf52ffd640 4 set_mon_vals no callback set 2024-09-10T16:29:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf517fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:29:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf517fa640 10 monclient: dump: 2024-09-10T16:29:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:29:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:57.185 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:57.186 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:29:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7fcf440057d0 con 0x7fcf5409ca10 2024-09-10T16:29:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (unknown 2027165750 0 0) 0x7fcf44006c70 con 0x7fcf5409ca10 2024-09-10T16:29:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf5a77d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf5a77d640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf5a77d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:29:57.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf5a77d640 1 -- 172.21.15.81:0/3211009914 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf2c005090 con 0x7fcf5409ca10 2024-09-10T16:29:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7fcf44006680 con 0x7fcf5409ca10 2024-09-10T16:29:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf517fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:57.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.163+0000 7fcf517fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:29:57.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.227+0000 7fcf5a77d640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:29:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.227+0000 7fcf5a77d640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:29:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.227+0000 7fcf5a77d640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:29:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.227+0000 7fcf5a77d640 1 -- 172.21.15.81:0/3211009914 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcf2c005380 con 0x7fcf5409ca10 2024-09-10T16:29:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.227+0000 7fcf517fa640 1 -- 172.21.15.81:0/3211009914 <== mon.4 v1:172.21.15.81:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (unknown 150273500 0 4159202484) 0x7fcf440068e0 con 0x7fcf5409ca10 2024-09-10T16:29:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.227+0000 7fcf517fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:29:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.227+0000 7fcf517fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:29:57.231 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:29:57.231 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":8,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","created":"2024-09-10T16:29:55.164545+0000","modified":"2024-09-10T16:29:57.004838+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T16:29:57.004838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c68b183d-5af0-4465-bf0b-1b1410e7a5c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b0e4a6b2-56e9-4f68-8dc0-998d3dec5bc9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8021ac53-8498-4069-92a8-a6477fab55b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c098399b-faef-460a-b448-a1c4ba227a5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f9ea0631-7d1d-4b3a-9806-684dfc66c44e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e32e3250-fe69-4ef0-8553-974e89bf80e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T16:29:57.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.227+0000 7fcf5a77d640 10 monclient: shutdown 2024-09-10T16:29:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.227+0000 7fcf5a77d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.227+0000 7fcf5a77d640 1 -- 172.21.15.81:0/3211009914 >> v1:172.21.15.81:6791/0 conn(0x7fcf5409ca10 legacy=0x7fcf5412e990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.227+0000 7fcf5a77d640 1 -- 172.21.15.81:0/3211009914 shutdown_connections 2024-09-10T16:29:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.227+0000 7fcf5a77d640 1 -- 172.21.15.81:0/3211009914 >> 172.21.15.81:0/3211009914 conn(0x7fcf5406dc90 msgr2=0x7fcf5412a340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.227+0000 7fcf5a77d640 1 -- 172.21.15.81:0/3211009914 shutdown_connections 2024-09-10T16:29:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:29:57.227+0000 7fcf5a77d640 1 -- 172.21.15.81:0/3211009914 wait complete. 2024-09-10T16:29:57.247 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-10T16:29:57.247 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-10T16:29:57.852 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T16:29:57.971 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.967+0000 7ff81954f640 10 monclient: get_monmap_and_config 2024-09-10T16:29:57.971 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.967+0000 7ff81954f640 10 monclient: build_initial_monmap 2024-09-10T16:29:57.971 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.967+0000 7ff81954f640 10 monclient: monmap: 2024-09-10T16:29:57.971 INFO:teuthology.misc.health.smithi081.stderr:epoch 0 2024-09-10T16:29:57.971 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:57.971 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:57.973005+0000 2024-09-10T16:29:57.972 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:57.973005+0000 2024-09-10T16:29:57.972 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:57.972 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:57.972 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:57.972 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:57.972 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:57.972 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:57.972 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:57.972 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:57.972 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:57.972 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:57.972 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:57.972 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:29:57.979 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.967+0000 7ff81954f640 1 Processor -- start 2024-09-10T16:29:57.979 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.967+0000 7ff81954f640 1 -- start start 2024-09-10T16:29:57.979 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.967+0000 7ff81954f640 10 monclient: init 2024-09-10T16:29:57.980 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:57.980 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient: _add_conns ranks=[6,1,7,2,8,3,0,5,4] 2024-09-10T16:29:57.980 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient(hunting): picked mon.noname-d con 0x7ff8140a5b90 addr v1:172.21.15.81:6792/0 2024-09-10T16:29:57.980 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient(hunting): picked mon.noname-f con 0x7ff81409e150 addr v1:172.21.15.189:6789/0 2024-09-10T16:29:57.980 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient(hunting): picked mon.noname-i con 0x7ff8140a6680 addr v1:172.21.15.189:6792/0 2024-09-10T16:29:57.980 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff81409d770 con 0x7ff81409e150 2024-09-10T16:29:57.980 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8140a7280 con 0x7ff8140a5b90 2024-09-10T16:29:57.980 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff81409ced0 con 0x7ff8140a6680 2024-09-10T16:29:57.980 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:57.980 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient(hunting): authenticate will time out at 965.372522s 2024-09-10T16:29:57.980 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff812ffd640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7ff8140a5b90 0x7ff8140a5f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:35136/0 (socket says 172.21.15.81:35136) 2024-09-10T16:29:57.981 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff812ffd640 1 -- 172.21.15.81:0/1514089596 learned_addr learned my addr 172.21.15.81:0/1514089596 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:29:57.981 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 1 -- 172.21.15.81:0/1514089596 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1545302087 0 0) 0x7ff8140a7280 con 0x7ff8140a5b90 2024-09-10T16:29:57.981 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:29:57.981 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:57.981 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:57.981 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient(hunting): my global_id is 4182 2024-09-10T16:29:57.981 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 1 -- 172.21.15.81:0/1514089596 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff7fc003530 con 0x7ff8140a5b90 2024-09-10T16:29:57.981 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 1 -- 172.21.15.81:0/1514089596 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098768804 0 0) 0x7ff81409ced0 con 0x7ff8140a6680 2024-09-10T16:29:57.981 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:29:57.981 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:57.981 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:57.981 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient(hunting): my global_id is 4183 2024-09-10T16:29:57.981 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 1 -- 172.21.15.81:0/1514089596 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8140a7280 con 0x7ff8140a6680 2024-09-10T16:29:57.982 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 1 -- 172.21.15.81:0/1514089596 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 184773520 0 0) 0x7ff7fc003530 con 0x7ff8140a5b90 2024-09-10T16:29:57.982 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 1 -- 172.21.15.81:0/1514089596 >> v1:172.21.15.189:6792/0 conn(0x7ff8140a6680 legacy=0x7ff814141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:57.982 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 1 -- 172.21.15.81:0/1514089596 >> v1:172.21.15.189:6789/0 conn(0x7ff81409e150 legacy=0x7ff81413de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:57.982 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:29:57.982 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 1 monclient: found mon.noname-d 2024-09-10T16:29:57.982 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:57.982 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:29:57.982 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 1 -- 172.21.15.81:0/1514089596 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81406f320 con 0x7ff8140a5b90 2024-09-10T16:29:57.982 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient: _finish_auth 0 2024-09-10T16:29:57.982 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:29:57.982 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:57.982 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 1 -- 172.21.15.81:0/1514089596 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff808001840 con 0x7ff8140a5b90 2024-09-10T16:29:57.982 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:57.983 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:29:57.983 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient: dump: 2024-09-10T16:29:57.983 INFO:teuthology.misc.health.smithi081.stderr:epoch 1 2024-09-10T16:29:57.983 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:57.983 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.983 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.983 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:57.983 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:57.983 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:57.983 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:57.983 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:57.983 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:57.983 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:57.984 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:57.984 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:57.984 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:57.984 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:57.984 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:29:57.984 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 5 monclient: authenticate success, global_id 4182 2024-09-10T16:29:57.984 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:29:57.984 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 1 -- 172.21.15.81:0/1514089596 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8080019e0 con 0x7ff8140a5b90 2024-09-10T16:29:57.984 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:57.984 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient: get_monmap_and_config success 2024-09-10T16:29:57.984 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 4 set_mon_vals no callback set 2024-09-10T16:29:57.984 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 1 -- 172.21.15.81:0/1514089596 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff808004bf0 con 0x7ff8140a5b90 2024-09-10T16:29:57.984 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff811ffb640 10 monclient: dump: 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:epoch 1 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:57.985 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:57.986 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:57.986 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:57.986 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:29:57.986 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient: shutdown 2024-09-10T16:29:57.986 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:57.986 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 1 -- 172.21.15.81:0/1514089596 >> v1:172.21.15.81:6792/0 conn(0x7ff8140a5b90 legacy=0x7ff8140a5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:57.986 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 1 -- 172.21.15.81:0/1514089596 shutdown_connections 2024-09-10T16:29:57.986 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 1 -- 172.21.15.81:0/1514089596 >> 172.21.15.81:0/1514089596 conn(0x7ff8140a7e60 msgr2=0x7ff8140a8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:57.986 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 1 -- 172.21.15.81:0/1514089596 shutdown_connections 2024-09-10T16:29:57.986 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 1 -- 172.21.15.81:0/1514089596 wait complete. 2024-09-10T16:29:57.986 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient: build_initial_monmap 2024-09-10T16:29:57.986 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient: monmap: 2024-09-10T16:29:57.986 INFO:teuthology.misc.health.smithi081.stderr:epoch 0 2024-09-10T16:29:57.986 INFO:teuthology.misc.health.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr:last_changed 0.000000 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr:created 0.000000 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 1 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:29:57.987 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 1 Processor -- start 2024-09-10T16:29:57.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 1 -- start start 2024-09-10T16:29:57.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient: init 2024-09-10T16:29:57.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient: _reopen_session rank -1 2024-09-10T16:29:57.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient: _add_conns ranks=[3,8,4,7,1,5,2,6,0] 2024-09-10T16:29:57.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient(hunting): picked mon.noname-g con 0x7ff81409e150 addr v1:172.21.15.189:6790/0 2024-09-10T16:29:57.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient(hunting): picked mon.noname-e con 0x7ff8140a5b90 addr v1:172.21.15.81:6793/0 2024-09-10T16:29:57.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient(hunting): picked mon.noname-c con 0x7ff8140a6680 addr v1:172.21.15.81:6791/0 2024-09-10T16:29:57.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff81406ea00 con 0x7ff81409e150 2024-09-10T16:29:57.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff814128db0 con 0x7ff8140a6680 2024-09-10T16:29:57.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff814126a50 con 0x7ff8140a5b90 2024-09-10T16:29:57.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient(hunting): _renew_subs 2024-09-10T16:29:57.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff81954f640 10 monclient(hunting): authenticate will time out at 965.375652s 2024-09-10T16:29:57.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff8127fc640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7ff8140a5b90 0x7ff8141d26a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:39996/0 (socket says 172.21.15.81:39996) 2024-09-10T16:29:57.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff8127fc640 1 -- 172.21.15.81:0/3090772675 learned_addr learned my addr 172.21.15.81:0/3090772675 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:29:57.989 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.971+0000 7ff8137fe640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7ff8140a6680 0x7ff8141d5dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:44646/0 (socket says 172.21.15.81:44646) 2024-09-10T16:29:57.989 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2774030674 0 0) 0x7ff814126a50 con 0x7ff8140a5b90 2024-09-10T16:29:57.989 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:29:57.989 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:57.989 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:57.989 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): my global_id is 4139 2024-09-10T16:29:57.989 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff800003530 con 0x7ff8140a5b90 2024-09-10T16:29:57.989 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 576589116 0 0) 0x7ff814128db0 con 0x7ff8140a6680 2024-09-10T16:29:57.990 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:29:57.990 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:57.990 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:57.990 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): my global_id is 4207 2024-09-10T16:29:57.990 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff814126a50 con 0x7ff8140a6680 2024-09-10T16:29:57.990 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2502292937 0 0) 0x7ff81406f320 con 0x7ff81409e150 2024-09-10T16:29:57.990 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:29:57.990 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:29:57.990 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:29:57.990 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): my global_id is 4152 2024-09-10T16:29:57.990 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff814128db0 con 0x7ff81409e150 2024-09-10T16:29:57.990 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 143384048 0 0) 0x7ff800003530 con 0x7ff8140a5b90 2024-09-10T16:29:57.991 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff81406f320 con 0x7ff8140a5b90 2024-09-10T16:29:57.991 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 348180076 0 0) 0x7ff814126a50 con 0x7ff8140a6680 2024-09-10T16:29:57.991 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff800003530 con 0x7ff8140a6680 2024-09-10T16:29:57.991 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff804001af0 con 0x7ff8140a5b90 2024-09-10T16:29:57.991 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:57.991 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:29:57.991 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): dump: 2024-09-10T16:29:57.991 INFO:teuthology.misc.health.smithi081.stderr:epoch 1 2024-09-10T16:29:57.991 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:57.991 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.991 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.991 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:57.992 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:57.992 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:57.992 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:57.992 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:57.992 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:57.992 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:57.992 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:57.992 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:57.992 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:57.992 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:57.992 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:29:57.992 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:29:57.992 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff80c001d00 con 0x7ff8140a6680 2024-09-10T16:29:57.993 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:29:57.993 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-10T16:29:57.993 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient(hunting): dump: 2024-09-10T16:29:57.993 INFO:teuthology.misc.health.smithi081.stderr:epoch 1 2024-09-10T16:29:57.993 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:57.993 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.993 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.993 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:57.993 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:57.993 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:57.993 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:57.993 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:57.993 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:57.994 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:57.994 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:57.994 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:57.994 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:57.994 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:57.994 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:29:57.994 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1348220047 0 0) 0x7ff81406f320 con 0x7ff8140a5b90 2024-09-10T16:29:57.994 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 >> v1:172.21.15.81:6791/0 conn(0x7ff8140a6680 legacy=0x7ff8141d5dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:57.994 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 >> v1:172.21.15.189:6790/0 conn(0x7ff81409e150 legacy=0x7ff814141450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:57.994 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:29:57.994 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 monclient: found mon.e 2024-09-10T16:29:57.995 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:29:57.995 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:29:57.995 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff814128510 con 0x7ff8140a5b90 2024-09-10T16:29:57.995 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient: _finish_auth 0 2024-09-10T16:29:57.995 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:29:57.995 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:29:57.995 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff81954f640 5 monclient: authenticate success, global_id 4139 2024-09-10T16:29:57.995 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff81954f640 10 monclient: _renew_subs 2024-09-10T16:29:57.995 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff81954f640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:29:57.995 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff81954f640 1 -- 172.21.15.81:0/3090772675 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff814141b60 con 0x7ff8140a5b90 2024-09-10T16:29:57.995 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff81954f640 10 monclient: _renew_subs 2024-09-10T16:29:57.995 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff81954f640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:29:57.995 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff81954f640 1 -- 172.21.15.81:0/3090772675 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7ff814127780 con 0x7ff8140a5b90 2024-09-10T16:29:57.996 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8040038d0 con 0x7ff8140a5b90 2024-09-10T16:29:57.996 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:29:57.996 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff804001c90 con 0x7ff8140a5b90 2024-09-10T16:29:57.996 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:29:57.996 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff8117fa640 4 set_mon_vals no callback set 2024-09-10T16:29:57.996 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:29:57.996 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 10 monclient: dump: 2024-09-10T16:29:57.996 INFO:teuthology.misc.health.smithi081.stderr:epoch 1 2024-09-10T16:29:57.996 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:29:57.996 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.996 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:29:57.996 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:29:57.997 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:29:57.997 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:29:57.997 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:29:57.997 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:29:57.997 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:29:57.997 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:29:57.997 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:29:57.997 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:29:57.997 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:29:57.997 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:29:57.997 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:29:57.997 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 1) ==== 807+0+0 (unknown 3189685207 0 0) 0x7ff804004250 con 0x7ff8140a5b90 2024-09-10T16:29:57.997 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (unknown 2027165750 0 0) 0x7ff804006d00 con 0x7ff8140a5b90 2024-09-10T16:29:57.998 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff81954f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:57.998 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff81954f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:57.998 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff81954f640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:29:57.998 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.975+0000 7ff81954f640 1 -- 172.21.15.81:0/3090772675 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7f4005090 con 0x7ff8140a5b90 2024-09-10T16:29:57.998 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.991+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 <== mon.8 v1:172.21.15.81:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (unknown 1092875540 0 1702466736) 0x7ff804005f40 con 0x7ff8140a5b90 2024-09-10T16:29:57.998 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.991+0000 7ff7fb7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:29:57.998 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:57.991+0000 7ff7fb7fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:29:58.053 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:58.051+0000 7ff81954f640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:29:58.053 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:58.051+0000 7ff81954f640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:29:58.053 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:58.051+0000 7ff81954f640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:29:58.053 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:58.051+0000 7ff81954f640 1 -- 172.21.15.81:0/3090772675 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff7f4005380 con 0x7ff8140a5b90 2024-09-10T16:29:58.054 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:58.051+0000 7ff7fb7fe640 1 -- 172.21.15.81:0/3090772675 <== mon.8 v1:172.21.15.81:6793/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) ==== 74+0+5605 (unknown 150273500 0 4159202484) 0x7ff804006710 con 0x7ff8140a5b90 2024-09-10T16:29:58.054 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:58.051+0000 7ff7fb7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:29:58.054 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:58.051+0000 7ff7fb7fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:29:58.054 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-10T16:29:58.054 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":8,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","created":"2024-09-10T16:29:55.164545+0000","modified":"2024-09-10T16:29:57.004838+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T16:29:57.004838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c68b183d-5af0-4465-bf0b-1b1410e7a5c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b0e4a6b2-56e9-4f68-8dc0-998d3dec5bc9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8021ac53-8498-4069-92a8-a6477fab55b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c098399b-faef-460a-b448-a1c4ba227a5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f9ea0631-7d1d-4b3a-9806-684dfc66c44e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e32e3250-fe69-4ef0-8553-974e89bf80e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T16:29:58.055 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:58.051+0000 7ff81954f640 10 monclient: shutdown 2024-09-10T16:29:58.055 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:58.051+0000 7ff81954f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:29:58.055 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:58.051+0000 7ff81954f640 1 -- 172.21.15.81:0/3090772675 >> v1:172.21.15.81:6793/0 conn(0x7ff8140a5b90 legacy=0x7ff8141d26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:29:58.055 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:58.051+0000 7ff81954f640 1 -- 172.21.15.81:0/3090772675 shutdown_connections 2024-09-10T16:29:58.056 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:58.051+0000 7ff81954f640 1 -- 172.21.15.81:0/3090772675 >> 172.21.15.81:0/3090772675 conn(0x7ff8140a7e60 msgr2=0x7ff8140a45a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:29:58.056 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:58.051+0000 7ff81954f640 1 -- 172.21.15.81:0/3090772675 shutdown_connections 2024-09-10T16:29:58.056 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:29:58.051+0000 7ff81954f640 1 -- 172.21.15.81:0/3090772675 wait complete. 2024-09-10T16:29:58.069 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-09-10T16:29:58.340 INFO:tasks.ceph.mgr.x.smithi189.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-10T16:29:58.340 INFO:tasks.ceph.mgr.x.smithi189.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-10T16:29:58.340 INFO:tasks.ceph.mgr.x.smithi189.stderr: from numpy import show_config as show_numpy_config 2024-09-10T16:29:58.362 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-10T16:29:58.359+0000 7fc3e67317c0 -1 Falling back to public interface 2024-09-10T16:29:58.374 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-09-10T16:29:58.374+0000 7f08333b07c0 -1 Falling back to public interface 2024-09-10T16:29:58.377 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-10T16:29:58.375+0000 7f2cf39197c0 -1 Falling back to public interface 2024-09-10T16:29:58.394 INFO:tasks.ceph.osd.3.smithi189.stderr:2024-09-10T16:29:58.394+0000 7fe7e7e6a7c0 -1 Falling back to public interface 2024-09-10T16:29:58.397 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-10T16:29:58.395+0000 7fd90c80a7c0 -1 Falling back to public interface 2024-09-10T16:29:58.438 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-09-10T16:29:58.438+0000 7f3c68d017c0 -1 Falling back to public interface 2024-09-10T16:30:01.294 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-09-10T16:30:01.294+0000 7f7938e20640 -1 mgr.server handle_report got status from non-daemon mon.h 2024-09-10T16:30:01.297 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-09-10T16:30:01.298+0000 7f7938e20640 -1 mgr.server handle_report got status from non-daemon mon.e 2024-09-10T16:30:01.297 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-09-10T16:30:01.298+0000 7f7938e20640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-10T16:30:01.298 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-09-10T16:30:01.298+0000 7f7938e20640 -1 mgr.server handle_report got status from non-daemon mon.f 2024-09-10T16:30:01.298 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-09-10T16:30:01.298+0000 7f7938e20640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-10T16:30:01.298 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-09-10T16:30:01.298+0000 7f7938e20640 -1 mgr.server handle_report got status from non-daemon mon.d 2024-09-10T16:30:01.298 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-09-10T16:30:01.298+0000 7f7938e20640 -1 mgr.server handle_report got status from non-daemon mon.i 2024-09-10T16:30:01.301 INFO:tasks.ceph.mgr.x.smithi189.stderr:2024-09-10T16:30:01.302+0000 7f7938e20640 -1 mgr.server handle_report got status from non-daemon mon.g 2024-09-10T16:30:02.456 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-10T16:30:02.451+0000 7f2cf39197c0 -1 osd.2 0 log_to_monitors true 2024-09-10T16:30:02.537 INFO:tasks.ceph.osd.3.smithi189.stderr:2024-09-10T16:30:02.538+0000 7fe7e7e6a7c0 -1 osd.3 0 log_to_monitors true 2024-09-10T16:30:02.544 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-10T16:30:02.539+0000 7fd90c80a7c0 -1 osd.0 0 log_to_monitors true 2024-09-10T16:30:02.561 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-09-10T16:30:02.562+0000 7f3c68d017c0 -1 osd.4 0 log_to_monitors true 2024-09-10T16:30:02.655 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-09-10T16:30:02.654+0000 7f08333b07c0 -1 osd.5 0 log_to_monitors true 2024-09-10T16:30:02.677 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-10T16:30:02.675+0000 7fc3e67317c0 -1 osd.1 0 log_to_monitors true 2024-09-10T16:30:04.333 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-10T16:30:04.331+0000 7fc3e26da640 -1 osd.1 0 waiting for initial osdmap 2024-09-10T16:30:04.340 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-10T16:30:04.335+0000 7fc3de514640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T16:30:04.675 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T16:30:04.791 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.787+0000 7f11244d2640 10 monclient: get_monmap_and_config 2024-09-10T16:30:04.791 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.787+0000 7f11244d2640 10 monclient: build_initial_monmap 2024-09-10T16:30:04.791 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.787+0000 7f11244d2640 10 monclient: monmap: 2024-09-10T16:30:04.791 INFO:teuthology.misc.health.smithi081.stderr:epoch 0 2024-09-10T16:30:04.791 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:04.791 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:30:04.792614+0000 2024-09-10T16:30:04.791 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:30:04.792614+0000 2024-09-10T16:30:04.791 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:04.791 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:04.791 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:04.791 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:04.792 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:04.792 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:04.792 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:04.792 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:04.792 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:04.792 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:04.792 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:04.792 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:30:04.793 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.787+0000 7f11244d2640 1 Processor -- start 2024-09-10T16:30:04.793 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.787+0000 7f11244d2640 1 -- start start 2024-09-10T16:30:04.793 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.787+0000 7f11244d2640 10 monclient: init 2024-09-10T16:30:04.798 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:04.798 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient: _add_conns ranks=[5,1,8,2,0,3,4,7,6] 2024-09-10T16:30:04.798 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient(hunting): picked mon.noname-h con 0x7f111c0a5b90 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:04.798 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient(hunting): picked mon.noname-f con 0x7f111c09e150 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:04.798 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient(hunting): picked mon.noname-e con 0x7f111c0a6680 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:04.799 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f111c09d770 con 0x7f111c09e150 2024-09-10T16:30:04.799 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f111c0a7280 con 0x7f111c0a5b90 2024-09-10T16:30:04.799 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f111c09ced0 con 0x7f111c0a6680 2024-09-10T16:30:04.799 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:04.799 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient(hunting): authenticate will time out at 972.192169s 2024-09-10T16:30:04.799 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1122a6f640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f111c0a6680 0x7f111c141540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:36558/0 (socket says 172.21.15.81:36558) 2024-09-10T16:30:04.799 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1122a6f640 1 -- 172.21.15.81:0/2960211167 learned_addr learned my addr 172.21.15.81:0/2960211167 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:04.799 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 1 -- 172.21.15.81:0/2960211167 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2114861660 0 0) 0x7f111c09ced0 con 0x7f111c0a6680 2024-09-10T16:30:04.799 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient(hunting): _negotiate 2024-09-10T16:30:04.799 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:04.799 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:04.799 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient(hunting): my global_id is 4175 2024-09-10T16:30:04.800 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 1 -- 172.21.15.81:0/2960211167 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1108003530 con 0x7f111c0a6680 2024-09-10T16:30:04.800 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 1 -- 172.21.15.81:0/2960211167 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2082619845 0 0) 0x7f111c0a7280 con 0x7f111c0a5b90 2024-09-10T16:30:04.800 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient(hunting): _negotiate 2024-09-10T16:30:04.800 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:04.800 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:04.800 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient(hunting): my global_id is 4208 2024-09-10T16:30:04.800 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 1 -- 172.21.15.81:0/2960211167 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f111c09ced0 con 0x7f111c0a5b90 2024-09-10T16:30:04.800 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 1 -- 172.21.15.81:0/2960211167 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2999620711 0 0) 0x7f1108003530 con 0x7f111c0a6680 2024-09-10T16:30:04.800 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 1 -- 172.21.15.81:0/2960211167 >> v1:172.21.15.189:6791/0 conn(0x7f111c0a5b90 legacy=0x7f111c0a5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:04.800 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 1 -- 172.21.15.81:0/2960211167 >> v1:172.21.15.189:6789/0 conn(0x7f111c09e150 legacy=0x7f111c13de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:04.800 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient: _finish_hunting 0 2024-09-10T16:30:04.800 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 1 monclient: found mon.noname-e 2024-09-10T16:30:04.801 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:04.801 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:30:04.801 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 1 -- 172.21.15.81:0/2960211167 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c06f320 con 0x7f111c0a6680 2024-09-10T16:30:04.801 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient: _finish_auth 0 2024-09-10T16:30:04.801 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient: _check_auth_tickets 2024-09-10T16:30:04.801 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:04.801 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 1 -- 172.21.15.81:0/2960211167 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1114001bc0 con 0x7f111c0a6680 2024-09-10T16:30:04.801 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:04.801 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:04.801 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient: dump: 2024-09-10T16:30:04.801 INFO:teuthology.misc.health.smithi081.stderr:epoch 1 2024-09-10T16:30:04.801 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:04.801 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:04.802 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:04.802 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:04.802 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:04.802 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:04.802 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:04.802 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:04.802 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:04.803 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:04.803 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:04.803 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:04.803 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:04.803 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:04.803 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:30:04.803 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 1 -- 172.21.15.81:0/2960211167 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1114001de0 con 0x7f111c0a6680 2024-09-10T16:30:04.803 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:04.803 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 1 -- 172.21.15.81:0/2960211167 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1114004f70 con 0x7f111c0a6680 2024-09-10T16:30:04.803 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:04.803 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:04.803 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112126c640 10 monclient: dump: 2024-09-10T16:30:04.803 INFO:teuthology.misc.health.smithi081.stderr:epoch 1 2024-09-10T16:30:04.804 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:04.804 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:04.804 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:04.804 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:04.804 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:04.804 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:04.804 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:04.804 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:04.804 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:04.804 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:04.804 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:04.804 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:04.805 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:04.805 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:04.805 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:30:04.805 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 5 monclient: authenticate success, global_id 4175 2024-09-10T16:30:04.805 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:04.805 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 4 set_mon_vals no callback set 2024-09-10T16:30:04.805 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient: shutdown 2024-09-10T16:30:04.805 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:04.805 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 1 -- 172.21.15.81:0/2960211167 >> v1:172.21.15.81:6793/0 conn(0x7f111c0a6680 legacy=0x7f111c141540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:04.805 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 1 -- 172.21.15.81:0/2960211167 shutdown_connections 2024-09-10T16:30:04.805 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 1 -- 172.21.15.81:0/2960211167 >> 172.21.15.81:0/2960211167 conn(0x7f111c0a7e60 msgr2=0x7f111c0a8270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:04.805 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 1 -- 172.21.15.81:0/2960211167 shutdown_connections 2024-09-10T16:30:04.805 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 1 -- 172.21.15.81:0/2960211167 wait complete. 2024-09-10T16:30:04.805 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient: build_initial_monmap 2024-09-10T16:30:04.806 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient: monmap: 2024-09-10T16:30:04.806 INFO:teuthology.misc.health.smithi081.stderr:epoch 0 2024-09-10T16:30:04.806 INFO:teuthology.misc.health.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:04.806 INFO:teuthology.misc.health.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:04.806 INFO:teuthology.misc.health.smithi081.stderr:created 0.000000 2024-09-10T16:30:04.806 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:04.806 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:04.806 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:04.806 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:04.806 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:04.806 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:04.806 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:04.806 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:04.807 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:04.807 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:04.807 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:04.807 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:30:04.807 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 1 Processor -- start 2024-09-10T16:30:04.807 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 1 -- start start 2024-09-10T16:30:04.807 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient: init 2024-09-10T16:30:04.807 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:04.807 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient: _add_conns ranks=[7,0,4,8,5,3,2,1,6] 2024-09-10T16:30:04.807 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient(hunting): picked mon.noname-i con 0x7f111c09e150 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:04.807 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient(hunting): picked mon.noname-a con 0x7f111c0a5b90 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:04.807 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient(hunting): picked mon.noname-c con 0x7f111c0a6680 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:04.807 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f111c083ba0 con 0x7f111c0a5b90 2024-09-10T16:30:04.807 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f111c0a1b10 con 0x7f111c0a6680 2024-09-10T16:30:04.808 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f111c0a1ed0 con 0x7f111c09e150 2024-09-10T16:30:04.808 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:04.808 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f11244d2640 10 monclient(hunting): authenticate will time out at 972.195269s 2024-09-10T16:30:04.808 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1122a6f640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f111c0a6680 0x7f111c0817c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:37270/0 (socket says 172.21.15.81:37270) 2024-09-10T16:30:04.808 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1122a6f640 1 -- 172.21.15.81:0/2303688130 learned_addr learned my addr 172.21.15.81:0/2303688130 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:04.808 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f112226e640 1 --1- >> v1:172.21.15.189:6792/0 conn(0x7f111c09e150 0x7f111c0809a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6792/0 says I am v1:172.21.15.81:48706/0 (socket says 172.21.15.81:48706) 2024-09-10T16:30:04.808 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2017531930 0 0) 0x7f111c06f320 con 0x7f111c0a6680 2024-09-10T16:30:04.808 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1112ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:04.808 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1112ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:04.808 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1112ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:04.808 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1112ffd640 10 monclient(hunting): my global_id is 4288 2024-09-10T16:30:04.808 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1100003530 con 0x7f111c0a6680 2024-09-10T16:30:04.808 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 407868986 0 0) 0x7f111c083ba0 con 0x7f111c0a5b90 2024-09-10T16:30:04.809 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1112ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:04.809 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1112ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:04.809 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1112ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:04.809 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1112ffd640 10 monclient(hunting): my global_id is 4212 2024-09-10T16:30:04.809 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f111c06f320 con 0x7f111c0a5b90 2024-09-10T16:30:04.809 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.791+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3294178274 0 0) 0x7f111c0a1ed0 con 0x7f111c09e150 2024-09-10T16:30:04.809 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:04.809 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:04.809 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:04.809 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient(hunting): my global_id is 4219 2024-09-10T16:30:04.809 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f111c083ba0 con 0x7f111c09e150 2024-09-10T16:30:04.809 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2632279428 0 0) 0x7f1100003530 con 0x7f111c0a6680 2024-09-10T16:30:04.809 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f111c0a1ed0 con 0x7f111c0a6680 2024-09-10T16:30:04.810 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1114001f90 con 0x7f111c0a6680 2024-09-10T16:30:04.810 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:04.810 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:04.810 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:04.810 INFO:teuthology.misc.health.smithi081.stderr:epoch 1 2024-09-10T16:30:04.810 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:04.810 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:04.810 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:04.810 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:04.810 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:04.810 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:04.810 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:04.810 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:04.811 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:04.811 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:04.811 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:04.811 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:04.811 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:04.811 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:04.811 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:30:04.811 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:04.811 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1100487526 0 0) 0x7f111c06f320 con 0x7f111c0a5b90 2024-09-10T16:30:04.811 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1100003530 con 0x7f111c0a5b90 2024-09-10T16:30:04.811 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f110c0019d0 con 0x7f111c0a5b90 2024-09-10T16:30:04.811 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:04.811 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:04.811 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:04.812 INFO:teuthology.misc.health.smithi081.stderr:epoch 1 2024-09-10T16:30:04.812 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:04.812 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:04.812 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:04.812 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:04.812 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:04.812 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:04.812 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:04.812 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:04.812 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:04.812 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:04.812 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:04.812 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:04.813 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:04.813 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:04.813 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:30:04.813 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2981132502 0 0) 0x7f111c0a1ed0 con 0x7f111c0a6680 2024-09-10T16:30:04.813 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 >> v1:172.21.15.189:6792/0 conn(0x7f111c09e150 legacy=0x7f111c0809a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:04.813 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 >> v1:172.21.15.81:6789/0 conn(0x7f111c0a5b90 legacy=0x7f111c0810b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:04.813 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:04.813 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 monclient: found mon.c 2024-09-10T16:30:04.813 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:04.813 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:04.813 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f111c084700 con 0x7f111c0a6680 2024-09-10T16:30:04.813 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:04.813 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:04.813 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:04.814 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f11244d2640 5 monclient: authenticate success, global_id 4288 2024-09-10T16:30:04.814 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f11244d2640 10 monclient: _renew_subs 2024-09-10T16:30:04.814 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f11244d2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:04.814 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f11244d2640 1 -- 172.21.15.81:0/2303688130 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f111c1358f0 con 0x7f111c0a6680 2024-09-10T16:30:04.814 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1114005160 con 0x7f111c0a6680 2024-09-10T16:30:04.814 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:04.814 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1114005650 con 0x7f111c0a6680 2024-09-10T16:30:04.814 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:04.814 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:04.814 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1120a6b640 4 set_mon_vals no callback set 2024-09-10T16:30:04.814 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 10 monclient: dump: 2024-09-10T16:30:04.814 INFO:teuthology.misc.health.smithi081.stderr:epoch 1 2024-09-10T16:30:04.814 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:04.815 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:04.815 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:04.815 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:04.815 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:04.815 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:04.815 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:04.815 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:04.815 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:04.815 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:04.815 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:04.815 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:04.815 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:04.815 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:04.815 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:30:04.816 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f11244d2640 10 monclient: _renew_subs 2024-09-10T16:30:04.816 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f11244d2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:04.816 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f11244d2640 1 -- 172.21.15.81:0/2303688130 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f111c135e50 con 0x7f111c0a6680 2024-09-10T16:30:04.816 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f11244d2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:04.816 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f11244d2640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:04.816 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f11244d2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:04.816 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f11244d2640 1 -- 172.21.15.81:0/2303688130 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f111c06e990 con 0x7f111c0a6680 2024-09-10T16:30:04.816 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 4) ==== 48431+0+0 (unknown 1413894031 0 0) 0x7f1114001ca0 con 0x7f111c0a6680 2024-09-10T16:30:04.816 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(10..10 src has 1..10) ==== 1927+0+0 (unknown 4064879997 0 0) 0x7f111404a820 con 0x7f111c0a6680 2024-09-10T16:30:04.816 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.795+0000 7f112226e640 10 monclient: get_auth_request con 0x7f110003d6c0 auth_method 0 2024-09-10T16:30:04.817 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.799+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f111c0a1b10 con 0x7f111c0a6680 2024-09-10T16:30:04.817 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.799+0000 7f1112ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:04.817 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.799+0000 7f1112ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:04.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.983+0000 7f11244d2640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:04.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.983+0000 7f11244d2640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:04.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.983+0000 7f11244d2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:04.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.983+0000 7f11244d2640 1 -- 172.21.15.81:0/2303688130 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f111c08d6a0 con 0x7f111c0a6680 2024-09-10T16:30:04.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.987+0000 7f1112ffd640 1 -- 172.21.15.81:0/2303688130 <== mon.4 v1:172.21.15.81:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+5606 (unknown 4040575075 0 825308518) 0x7f1114016f10 con 0x7f111c0a6680 2024-09-10T16:30:04.988 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.987+0000 7f1112ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:04.989 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.987+0000 7f1112ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:04.989 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-10T16:30:04.989 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","created":"2024-09-10T16:29:55.164545+0000","modified":"2024-09-10T16:30:04.304370+0000","last_up_change":"0.000000","last_in_change":"2024-09-10T16:29:57.004838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"c68b183d-5af0-4465-bf0b-1b1410e7a5c3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b0e4a6b2-56e9-4f68-8dc0-998d3dec5bc9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"8021ac53-8498-4069-92a8-a6477fab55b2","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c098399b-faef-460a-b448-a1c4ba227a5b","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"f9ea0631-7d1d-4b3a-9806-684dfc66c44e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e32e3250-fe69-4ef0-8553-974e89bf80e3","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T16:30:04.991 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.987+0000 7f11244d2640 1 -- 172.21.15.81:0/2303688130 >> v1:172.21.15.189:6812/1108603242 conn(0x7f110003d6c0 legacy=0x7f110003fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:04.991 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.987+0000 7f11244d2640 10 monclient: shutdown 2024-09-10T16:30:04.991 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.987+0000 7f11244d2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:04.992 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.987+0000 7f11244d2640 1 -- 172.21.15.81:0/2303688130 >> v1:172.21.15.81:6791/0 conn(0x7f111c0a6680 legacy=0x7f111c0817c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:04.992 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.987+0000 7f11244d2640 1 -- 172.21.15.81:0/2303688130 shutdown_connections 2024-09-10T16:30:04.992 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.987+0000 7f11244d2640 1 -- 172.21.15.81:0/2303688130 >> 172.21.15.81:0/2303688130 conn(0x7f111c0a7e60 msgr2=0x7f111c1422a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:04.992 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.987+0000 7f11244d2640 1 -- 172.21.15.81:0/2303688130 shutdown_connections 2024-09-10T16:30:04.992 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:04.987+0000 7f11244d2640 1 -- 172.21.15.81:0/2303688130 wait complete. 2024-09-10T16:30:05.010 DEBUG:teuthology.misc:0 of 6 OSDs are up 2024-09-10T16:30:07.181 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-10T16:30:07.179+0000 7fd9087b3640 -1 osd.0 0 waiting for initial osdmap 2024-09-10T16:30:07.190 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-10T16:30:07.187+0000 7fd9005e5640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T16:30:07.196 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-10T16:30:07.195+0000 7f2cf00d4640 -1 osd.2 0 waiting for initial osdmap 2024-09-10T16:30:07.201 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-10T16:30:07.199+0000 7f2ce76f4640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T16:30:07.220 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-09-10T16:30:07.218+0000 7f082f359640 -1 osd.5 0 waiting for initial osdmap 2024-09-10T16:30:07.226 INFO:tasks.ceph.osd.5.smithi189.stderr:2024-09-10T16:30:07.226+0000 7f082718b640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T16:30:07.235 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-09-10T16:30:07.234+0000 7f3c654bc640 -1 osd.4 0 waiting for initial osdmap 2024-09-10T16:30:07.239 INFO:tasks.ceph.osd.4.smithi189.stderr:2024-09-10T16:30:07.238+0000 7f3c5cadc640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T16:30:07.323 INFO:tasks.ceph.osd.3.smithi189.stderr:2024-09-10T16:30:07.322+0000 7fe7e4625640 -1 osd.3 0 waiting for initial osdmap 2024-09-10T16:30:07.326 INFO:tasks.ceph.osd.3.smithi189.stderr:2024-09-10T16:30:07.326+0000 7fe7dbc45640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-10T16:30:11.615 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-10T16:30:11.735 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.731+0000 7ff55473e640 10 monclient: get_monmap_and_config 2024-09-10T16:30:11.736 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.731+0000 7ff55473e640 10 monclient: build_initial_monmap 2024-09-10T16:30:11.736 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.731+0000 7ff55473e640 10 monclient: monmap: 2024-09-10T16:30:11.736 INFO:teuthology.misc.health.smithi081.stderr:epoch 0 2024-09-10T16:30:11.736 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:11.736 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:30:11.737621+0000 2024-09-10T16:30:11.736 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:30:11.737621+0000 2024-09-10T16:30:11.736 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:11.736 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:11.736 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:11.736 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:11.736 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:11.737 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:11.737 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:11.737 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:11.737 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:11.737 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:11.737 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:11.737 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:30:11.743 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 1 Processor -- start 2024-09-10T16:30:11.743 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 1 -- start start 2024-09-10T16:30:11.743 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 10 monclient: init 2024-09-10T16:30:11.744 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:11.744 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 10 monclient: _add_conns ranks=[0,2,1,4,7,3,5,6,8] 2024-09-10T16:30:11.744 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 10 monclient(hunting): picked mon.noname-a con 0x7ff54c0a2130 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:11.744 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 10 monclient(hunting): picked mon.noname-b con 0x7ff54c0a17d0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:11.744 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 10 monclient(hunting): picked mon.noname-f con 0x7ff54c0a2510 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:11.744 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54c0a5770 con 0x7ff54c0a2130 2024-09-10T16:30:11.744 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54c0a0550 con 0x7ff54c0a2510 2024-09-10T16:30:11.744 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54c0a0830 con 0x7ff54c0a17d0 2024-09-10T16:30:11.744 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:11.744 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 10 monclient(hunting): authenticate will time out at 979.137126s 2024-09-10T16:30:11.744 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5524da640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff54c0a2130 0x7ff54c0744b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56826/0 (socket says 172.21.15.81:56826) 2024-09-10T16:30:11.744 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5524da640 1 -- 172.21.15.81:0/3137367644 learned_addr learned my addr 172.21.15.81:0/3137367644 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:11.744 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff551cd9640 1 --1- 172.21.15.81:0/3137367644 >> v1:172.21.15.81:6790/0 conn(0x7ff54c0a17d0 0x7ff54c074bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:47676/0 (socket says 172.21.15.81:47676) 2024-09-10T16:30:11.745 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 1 -- 172.21.15.81:0/3137367644 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1307782092 0 0) 0x7ff54c0a0830 con 0x7ff54c0a17d0 2024-09-10T16:30:11.745 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient(hunting): _negotiate 2024-09-10T16:30:11.745 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:11.745 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:11.745 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient(hunting): my global_id is 4205 2024-09-10T16:30:11.745 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 1 -- 172.21.15.81:0/3137367644 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff538003530 con 0x7ff54c0a17d0 2024-09-10T16:30:11.745 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 1 -- 172.21.15.81:0/3137367644 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2136678897 0 0) 0x7ff54c0a5770 con 0x7ff54c0a2130 2024-09-10T16:30:11.745 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient(hunting): _negotiate 2024-09-10T16:30:11.745 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:11.745 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:11.745 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient(hunting): my global_id is 4230 2024-09-10T16:30:11.745 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 1 -- 172.21.15.81:0/3137367644 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff54c0a0830 con 0x7ff54c0a2130 2024-09-10T16:30:11.745 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 1 -- 172.21.15.81:0/3137367644 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1471035103 0 0) 0x7ff54c0a0830 con 0x7ff54c0a2130 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 1 -- 172.21.15.81:0/3137367644 >> v1:172.21.15.81:6790/0 conn(0x7ff54c0a17d0 legacy=0x7ff54c074bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 1 -- 172.21.15.81:0/3137367644 >> v1:172.21.15.189:6789/0 conn(0x7ff54c0a2510 legacy=0x7ff54c141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient: _finish_hunting 0 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 1 monclient: found mon.noname-a 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 1 -- 172.21.15.81:0/3137367644 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54c0a29a0 con 0x7ff54c0a2130 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient: _finish_auth 0 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient: _check_auth_tickets 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 1 -- 172.21.15.81:0/3137367644 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff5480017a0 con 0x7ff54c0a2130 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 5 monclient: authenticate success, global_id 4230 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:11.746 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient: dump: 2024-09-10T16:30:11.747 INFO:teuthology.misc.health.smithi081.stderr:epoch 1 2024-09-10T16:30:11.747 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:11.747 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:11.747 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:11.747 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:11.747 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:11.747 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:11.747 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:11.747 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:11.747 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:11.747 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:11.747 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:11.747 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:11.747 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:11.748 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:11.748 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:30:11.748 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:11.748 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 1 -- 172.21.15.81:0/3137367644 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff548001940 con 0x7ff54c0a2130 2024-09-10T16:30:11.748 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:11.748 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:11.748 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 4 set_mon_vals no callback set 2024-09-10T16:30:11.748 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 1 -- 172.21.15.81:0/3137367644 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff5480048b0 con 0x7ff54c0a2130 2024-09-10T16:30:11.748 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:11.748 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:11.748 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff5514d8640 10 monclient: dump: 2024-09-10T16:30:11.748 INFO:teuthology.misc.health.smithi081.stderr:epoch 1 2024-09-10T16:30:11.748 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:11.749 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:11.749 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:11.749 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:11.749 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:11.749 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:11.749 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:11.749 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:11.749 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:11.749 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:11.749 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:11.749 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:11.749 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:11.749 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:11.750 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:30:11.750 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 10 monclient: shutdown 2024-09-10T16:30:11.750 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:11.750 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 1 -- 172.21.15.81:0/3137367644 >> v1:172.21.15.81:6789/0 conn(0x7ff54c0a2130 legacy=0x7ff54c0744b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:11.750 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 1 -- 172.21.15.81:0/3137367644 shutdown_connections 2024-09-10T16:30:11.750 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 1 -- 172.21.15.81:0/3137367644 >> 172.21.15.81:0/3137367644 conn(0x7ff54c0a5bf0 msgr2=0x7ff54c0a6000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:11.750 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 1 -- 172.21.15.81:0/3137367644 shutdown_connections 2024-09-10T16:30:11.750 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 1 -- 172.21.15.81:0/3137367644 wait complete. 2024-09-10T16:30:11.750 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 10 monclient: build_initial_monmap 2024-09-10T16:30:11.750 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 10 monclient: monmap: 2024-09-10T16:30:11.750 INFO:teuthology.misc.health.smithi081.stderr:epoch 0 2024-09-10T16:30:11.750 INFO:teuthology.misc.health.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:11.750 INFO:teuthology.misc.health.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:11.751 INFO:teuthology.misc.health.smithi081.stderr:created 0.000000 2024-09-10T16:30:11.751 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:11.751 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:11.751 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:11.751 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:11.751 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:11.751 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:11.751 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:11.751 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:11.751 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:11.751 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:11.751 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:11.751 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:30:11.751 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 1 Processor -- start 2024-09-10T16:30:11.752 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 1 -- start start 2024-09-10T16:30:11.752 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.735+0000 7ff55473e640 10 monclient: init 2024-09-10T16:30:11.752 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:11.752 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 10 monclient: _add_conns ranks=[1,8,5,2,3,7,0,4,6] 2024-09-10T16:30:11.752 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 10 monclient(hunting): picked mon.noname-f con 0x7ff54c0a17d0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:11.752 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 10 monclient(hunting): picked mon.noname-e con 0x7ff54c0a2130 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:11.752 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 10 monclient(hunting): picked mon.noname-h con 0x7ff54c0a2510 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:11.752 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54c13ec00 con 0x7ff54c0a17d0 2024-09-10T16:30:11.752 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54c09f5f0 con 0x7ff54c0a2510 2024-09-10T16:30:11.752 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff54c074dd0 con 0x7ff54c0a2130 2024-09-10T16:30:11.752 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:11.752 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 10 monclient(hunting): authenticate will time out at 979.140390s 2024-09-10T16:30:11.752 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff551cd9640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7ff54c0a2130 0x7ff54c1d26c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:36572/0 (socket says 172.21.15.81:36572) 2024-09-10T16:30:11.753 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff551cd9640 1 -- 172.21.15.81:0/1377905618 learned_addr learned my addr 172.21.15.81:0/1377905618 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:11.753 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 680355478 0 0) 0x7ff54c074dd0 con 0x7ff54c0a2130 2024-09-10T16:30:11.753 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:11.753 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:11.753 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:11.753 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): my global_id is 4202 2024-09-10T16:30:11.753 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff530003530 con 0x7ff54c0a2130 2024-09-10T16:30:11.753 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 851230527 0 0) 0x7ff530003530 con 0x7ff54c0a2130 2024-09-10T16:30:11.753 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff54c074dd0 con 0x7ff54c0a2130 2024-09-10T16:30:11.753 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff53c001660 con 0x7ff54c0a2130 2024-09-10T16:30:11.753 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:11.753 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:11.753 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:11.754 INFO:teuthology.misc.health.smithi081.stderr:epoch 1 2024-09-10T16:30:11.754 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:11.754 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:11.754 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:11.754 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:11.754 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:11.754 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:11.754 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:11.754 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:11.754 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:11.754 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:11.754 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:11.754 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:11.754 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:11.755 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:11.755 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:30:11.755 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:11.755 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 968698347 0 0) 0x7ff54c13ec00 con 0x7ff54c0a17d0 2024-09-10T16:30:11.755 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:11.755 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:11.755 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:11.755 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): my global_id is 4258 2024-09-10T16:30:11.755 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff530003530 con 0x7ff54c0a17d0 2024-09-10T16:30:11.755 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448945211 0 0) 0x7ff54c09f5f0 con 0x7ff54c0a2510 2024-09-10T16:30:11.755 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:11.755 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:11.755 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:11.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient(hunting): my global_id is 4226 2024-09-10T16:30:11.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff54c13ec00 con 0x7ff54c0a2510 2024-09-10T16:30:11.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2551394526 0 0) 0x7ff54c074dd0 con 0x7ff54c0a2130 2024-09-10T16:30:11.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 >> v1:172.21.15.189:6791/0 conn(0x7ff54c0a2510 legacy=0x7ff54c1d5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:11.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 >> v1:172.21.15.189:6789/0 conn(0x7ff54c0a17d0 legacy=0x7ff54c138f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:11.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:11.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 monclient: found mon.e 2024-09-10T16:30:11.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:11.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:11.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff54c13ff40 con 0x7ff54c0a2130 2024-09-10T16:30:11.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:11.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:11.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:11.756 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 5 monclient: authenticate success, global_id 4202 2024-09-10T16:30:11.757 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 10 monclient: _renew_subs 2024-09-10T16:30:11.757 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:11.757 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 1 -- 172.21.15.81:0/1377905618 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff54c13e740 con 0x7ff54c0a2130 2024-09-10T16:30:11.757 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 10 monclient: _renew_subs 2024-09-10T16:30:11.757 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:11.757 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 1 -- 172.21.15.81:0/1377905618 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7ff54c074620 con 0x7ff54c0a2130 2024-09-10T16:30:11.757 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff53c004aa0 con 0x7ff54c0a2130 2024-09-10T16:30:11.757 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:11.757 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff53c004f90 con 0x7ff54c0a2130 2024-09-10T16:30:11.757 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:11.757 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff550cd7640 4 set_mon_vals no callback set 2024-09-10T16:30:11.757 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:11.757 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 10 monclient: dump: 2024-09-10T16:30:11.758 INFO:teuthology.misc.health.smithi081.stderr:epoch 1 2024-09-10T16:30:11.758 INFO:teuthology.misc.health.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:11.758 INFO:teuthology.misc.health.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:11.758 INFO:teuthology.misc.health.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:11.758 INFO:teuthology.misc.health.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:11.758 INFO:teuthology.misc.health.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:11.758 INFO:teuthology.misc.health.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:11.758 INFO:teuthology.misc.health.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:11.758 INFO:teuthology.misc.health.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:11.758 INFO:teuthology.misc.health.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:11.758 INFO:teuthology.misc.health.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:11.758 INFO:teuthology.misc.health.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:11.758 INFO:teuthology.misc.health.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:11.758 INFO:teuthology.misc.health.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:11.759 INFO:teuthology.misc.health.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:11.759 INFO:teuthology.misc.health.smithi081.stderr: 2024-09-10T16:30:11.759 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:11.759 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:11.759 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:11.759 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff55473e640 1 -- 172.21.15.81:0/1377905618 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff534005090 con 0x7ff54c0a2130 2024-09-10T16:30:11.759 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7ff53c010ea0 con 0x7ff54c0a2130 2024-09-10T16:30:11.759 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(16..16 src has 1..16) ==== 3153+0+0 (unknown 2474672291 0 0) 0x7ff53c04ad90 con 0x7ff54c0a2130 2024-09-10T16:30:11.759 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.739+0000 7ff5524da640 10 monclient: get_auth_request con 0x7ff53003d230 auth_method 0 2024-09-10T16:30:11.760 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.743+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 <== mon.8 v1:172.21.15.81:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7ff53c016d50 con 0x7ff54c0a2130 2024-09-10T16:30:11.760 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.743+0000 7ff542ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:11.760 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.743+0000 7ff542ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:11.917 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.915+0000 7ff55473e640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:11.917 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.915+0000 7ff55473e640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:11.917 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.915+0000 7ff55473e640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:11.917 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.915+0000 7ff55473e640 1 -- 172.21.15.81:0/1377905618 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff534005380 con 0x7ff54c0a2130 2024-09-10T16:30:11.918 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.915+0000 7ff542ffd640 1 -- 172.21.15.81:0/1377905618 <== mon.8 v1:172.21.15.81:6793/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+9057 (unknown 1054498076 0 1498796717) 0x7ff53c016650 con 0x7ff54c0a2130 2024-09-10T16:30:11.918 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.915+0000 7ff542ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:11.918 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.915+0000 7ff542ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:11.918 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-10T16:30:11.918 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":16,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","created":"2024-09-10T16:29:55.164545+0000","modified":"2024-09-10T16:30:11.228145+0000","last_up_change":"2024-09-10T16:30:08.199951+0000","last_in_change":"2024-09-10T16:29:57.004838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T16:30:08.333238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c68b183d-5af0-4465-bf0b-1b1410e7a5c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6808","nonce":1659450435}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6809","nonce":1659450435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6811","nonce":1659450435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6810","nonce":1659450435}]},"public_addr":"172.21.15.81:6808/1659450435","cluster_addr":"172.21.15.81:6809/1659450435","heartbeat_back_addr":"172.21.15.81:6811/1659450435","heartbeat_front_addr":"172.21.15.81:6810/1659450435","state":["exists","up"]},{"osd":1,"uuid":"b0e4a6b2-56e9-4f68-8dc0-998d3dec5bc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6800","nonce":4086249229}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6801","nonce":4086249229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6803","nonce":4086249229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6802","nonce":4086249229}]},"public_addr":"172.21.15.81:6800/4086249229","cluster_addr":"172.21.15.81:6801/4086249229","heartbeat_back_addr":"172.21.15.81:6803/4086249229","heartbeat_front_addr":"172.21.15.81:6802/4086249229","state":["exists","up"]},{"osd":2,"uuid":"8021ac53-8498-4069-92a8-a6477fab55b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6804","nonce":2595021275}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6805","nonce":2595021275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6807","nonce":2595021275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6806","nonce":2595021275}]},"public_addr":"172.21.15.81:6804/2595021275","cluster_addr":"172.21.15.81:6805/2595021275","heartbeat_back_addr":"172.21.15.81:6807/2595021275","heartbeat_front_addr":"172.21.15.81:6806/2595021275","state":["exists","up"]},{"osd":3,"uuid":"c098399b-faef-460a-b448-a1c4ba227a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6804","nonce":3461775318}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6805","nonce":3461775318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6807","nonce":3461775318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6806","nonce":3461775318}]},"public_addr":"172.21.15.189:6804/3461775318","cluster_addr":"172.21.15.189:6805/3461775318","heartbeat_back_addr":"172.21.15.189:6807/3461775318","heartbeat_front_addr":"172.21.15.189:6806/3461775318","state":["exists","up"]},{"osd":4,"uuid":"f9ea0631-7d1d-4b3a-9806-684dfc66c44e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6808","nonce":1206180154}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6809","nonce":1206180154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6811","nonce":1206180154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6810","nonce":1206180154}]},"public_addr":"172.21.15.189:6808/1206180154","cluster_addr":"172.21.15.189:6809/1206180154","heartbeat_back_addr":"172.21.15.189:6811/1206180154","heartbeat_front_addr":"172.21.15.189:6810/1206180154","state":["exists","up"]},{"osd":5,"uuid":"e32e3250-fe69-4ef0-8553-974e89bf80e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6800","nonce":1814191784}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6801","nonce":1814191784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6803","nonce":1814191784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6802","nonce":1814191784}]},"public_addr":"172.21.15.189:6800/1814191784","cluster_addr":"172.21.15.189:6801/1814191784","heartbeat_back_addr":"172.21.15.189:6803/1814191784","heartbeat_front_addr":"172.21.15.189:6802/1814191784","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.542123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.718470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.484310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.507370+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.609326+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.643721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T16:30:11.921 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.919+0000 7ff55473e640 1 -- 172.21.15.81:0/1377905618 >> v1:172.21.15.189:6812/1108603242 conn(0x7ff53003d230 legacy=0x7ff53003f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:11.921 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.919+0000 7ff55473e640 10 monclient: shutdown 2024-09-10T16:30:11.921 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.919+0000 7ff55473e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:11.921 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.919+0000 7ff55473e640 1 -- 172.21.15.81:0/1377905618 >> v1:172.21.15.81:6793/0 conn(0x7ff54c0a2130 legacy=0x7ff54c1d26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:11.921 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.919+0000 7ff55473e640 1 -- 172.21.15.81:0/1377905618 shutdown_connections 2024-09-10T16:30:11.921 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.919+0000 7ff55473e640 1 -- 172.21.15.81:0/1377905618 >> 172.21.15.81:0/1377905618 conn(0x7ff54c0a5bf0 msgr2=0x7ff54c13bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:11.921 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.919+0000 7ff55473e640 1 -- 172.21.15.81:0/1377905618 shutdown_connections 2024-09-10T16:30:11.921 INFO:teuthology.misc.health.smithi081.stderr:2024-09-10T16:30:11.919+0000 7ff55473e640 1 -- 172.21.15.81:0/1377905618 wait complete. 2024-09-10T16:30:11.936 DEBUG:teuthology.misc:6 of 6 OSDs are up 2024-09-10T16:30:11.936 INFO:tasks.ceph:Creating RBD pool 2024-09-10T16:30:11.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-10T16:30:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 10 monclient: get_monmap_and_config 2024-09-10T16:30:12.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 10 monclient: build_initial_monmap 2024-09-10T16:30:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 10 monclient: monmap: 2024-09-10T16:30:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:12.054109+0000 2024-09-10T16:30:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:12.054109+0000 2024-09-10T16:30:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:12.053 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:12.054 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 1 Processor -- start 2024-09-10T16:30:12.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 1 -- start start 2024-09-10T16:30:12.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 10 monclient: init 2024-09-10T16:30:12.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:12.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 10 monclient: _add_conns ranks=[7,5,1,3,8,6,2,0,4] 2024-09-10T16:30:12.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 10 monclient(hunting): picked mon.noname-i con 0x7f1a2809b3c0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:12.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 10 monclient(hunting): picked mon.noname-h con 0x7f1a28138d20 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:12.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 10 monclient(hunting): picked mon.noname-f con 0x7f1a2813c830 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:12.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2809beb0 con 0x7f1a2813c830 2024-09-10T16:30:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a280a1020 con 0x7f1a28138d20 2024-09-10T16:30:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a280a15e0 con 0x7f1a2809b3c0 2024-09-10T16:30:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 10 monclient(hunting): authenticate will time out at 979.453607s 2024-09-10T16:30:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a25d9b640 1 --1- >> v1:172.21.15.189:6791/0 conn(0x7f1a28138d20 0x7f1a2813b110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6791/0 says I am v1:172.21.15.81:42172/0 (socket says 172.21.15.81:42172) 2024-09-10T16:30:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a25d9b640 1 -- 172.21.15.81:0/1351266226 learned_addr learned my addr 172.21.15.81:0/1351266226 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 1 -- 172.21.15.81:0/1351266226 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 130701489 0 0) 0x7f1a280a1020 con 0x7f1a28138d20 2024-09-10T16:30:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient(hunting): my global_id is 4235 2024-09-10T16:30:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 1 -- 172.21.15.81:0/1351266226 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a08003530 con 0x7f1a28138d20 2024-09-10T16:30:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 1 -- 172.21.15.81:0/1351266226 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1752667176 0 0) 0x7f1a2809beb0 con 0x7f1a2813c830 2024-09-10T16:30:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient(hunting): my global_id is 4267 2024-09-10T16:30:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 1 -- 172.21.15.81:0/1351266226 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a280a1020 con 0x7f1a2813c830 2024-09-10T16:30:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 1 -- 172.21.15.81:0/1351266226 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1757667621 0 0) 0x7f1a280a15e0 con 0x7f1a2809b3c0 2024-09-10T16:30:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient(hunting): my global_id is 4246 2024-09-10T16:30:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 1 -- 172.21.15.81:0/1351266226 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a2809beb0 con 0x7f1a2809b3c0 2024-09-10T16:30:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 1 -- 172.21.15.81:0/1351266226 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 464817405 0 0) 0x7f1a08003530 con 0x7f1a28138d20 2024-09-10T16:30:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 1 -- 172.21.15.81:0/1351266226 >> v1:172.21.15.189:6792/0 conn(0x7f1a2809b3c0 legacy=0x7f1a2809b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 1 -- 172.21.15.81:0/1351266226 >> v1:172.21.15.189:6789/0 conn(0x7f1a2813c830 legacy=0x7f1a2813ec20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient: _finish_hunting 0 2024-09-10T16:30:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 1 monclient: found mon.noname-h 2024-09-10T16:30:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.189:6791/0 2024-09-10T16:30:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 1 -- 172.21.15.81:0/1351266226 --> v1:172.21.15.189:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a280a18c0 con 0x7f1a28138d20 2024-09-10T16:30:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient: _finish_auth 0 2024-09-10T16:30:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient: _check_auth_tickets 2024-09-10T16:30:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 5 monclient: authenticate success, global_id 4235 2024-09-10T16:30:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 1 -- 172.21.15.81:0/1351266226 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1a10001840 con 0x7f1a28138d20 2024-09-10T16:30:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:12.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient: dump: 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:12.065 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 1 -- 172.21.15.81:0/1351266226 <== mon.5 v1:172.21.15.189:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a100019e0 con 0x7f1a28138d20 2024-09-10T16:30:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 4 set_mon_vals no callback set 2024-09-10T16:30:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 1 -- 172.21.15.81:0/1351266226 <== mon.5 v1:172.21.15.189:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1a10004bf0 con 0x7f1a28138d20 2024-09-10T16:30:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:30:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2559a640 10 monclient: dump: 2024-09-10T16:30:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:12.066 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 10 monclient: shutdown 2024-09-10T16:30:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.051+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1351266226 >> v1:172.21.15.189:6791/0 conn(0x7f1a28138d20 legacy=0x7f1a2813b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1351266226 shutdown_connections 2024-09-10T16:30:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1351266226 >> 172.21.15.81:0/1351266226 conn(0x7f1a280a87b0 msgr2=0x7f1a280a8bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1351266226 shutdown_connections 2024-09-10T16:30:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1351266226 wait complete. 2024-09-10T16:30:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient: build_initial_monmap 2024-09-10T16:30:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient: monmap: 2024-09-10T16:30:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:12.068 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:12.069 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 1 Processor -- start 2024-09-10T16:30:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 1 -- start start 2024-09-10T16:30:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient: init 2024-09-10T16:30:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient: _add_conns ranks=[8,0,7,1,2,5,4,3,6] 2024-09-10T16:30:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient(hunting): picked mon.noname-e con 0x7f1a2809b3c0 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient(hunting): picked mon.noname-a con 0x7f1a28138d20 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient(hunting): picked mon.noname-i con 0x7f1a2813c830 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2813c330 con 0x7f1a28138d20 2024-09-10T16:30:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2812df40 con 0x7f1a2813c830 2024-09-10T16:30:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2812e220 con 0x7f1a2809b3c0 2024-09-10T16:30:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient(hunting): authenticate will time out at 979.457733s 2024-09-10T16:30:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a25d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f1a28138d20 0x7f1a2809a770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:56842/0 (socket says 172.21.15.81:56842) 2024-09-10T16:30:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a25d9b640 1 -- 172.21.15.81:0/1720522287 learned_addr learned my addr 172.21.15.81:0/1720522287 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2659c640 1 --1- 172.21.15.81:0/1720522287 >> v1:172.21.15.81:6793/0 conn(0x7f1a2809b3c0 0x7f1a2809a060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:36576/0 (socket says 172.21.15.81:36576) 2024-09-10T16:30:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1135939199 0 0) 0x7f1a2812e220 con 0x7f1a2809b3c0 2024-09-10T16:30:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:12.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): my global_id is 4211 2024-09-10T16:30:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a0c003530 con 0x7f1a2809b3c0 2024-09-10T16:30:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 364568692 0 0) 0x7f1a280a18c0 con 0x7f1a28138d20 2024-09-10T16:30:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): my global_id is 4239 2024-09-10T16:30:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a2812e220 con 0x7f1a28138d20 2024-09-10T16:30:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 59174541 0 0) 0x7f1a0c003530 con 0x7f1a2809b3c0 2024-09-10T16:30:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a280a18c0 con 0x7f1a2809b3c0 2024-09-10T16:30:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4245978713 0 0) 0x7f1a2812df40 con 0x7f1a2813c830 2024-09-10T16:30:12.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): my global_id is 4255 2024-09-10T16:30:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a0c003530 con 0x7f1a2813c830 2024-09-10T16:30:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1a20001ea0 con 0x7f1a2809b3c0 2024-09-10T16:30:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): dump: 2024-09-10T16:30:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:12.072 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:12.073 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1397259289 0 0) 0x7f1a2812e220 con 0x7f1a28138d20 2024-09-10T16:30:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1a2812df40 con 0x7f1a28138d20 2024-09-10T16:30:12.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1a10001700 con 0x7f1a28138d20 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient(hunting): dump: 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:12.074 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:12.075 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 200969567 0 0) 0x7f1a280a18c0 con 0x7f1a2809b3c0 2024-09-10T16:30:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 >> v1:172.21.15.189:6792/0 conn(0x7f1a2813c830 legacy=0x7f1a281d5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 >> v1:172.21.15.81:6789/0 conn(0x7f1a28138d20 legacy=0x7f1a2809a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 monclient: found mon.e 2024-09-10T16:30:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2809ae80 con 0x7f1a2809b3c0 2024-09-10T16:30:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient: _finish_auth 0 2024-09-10T16:30:12.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 5 monclient: authenticate success, global_id 4211 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient: _renew_subs 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1720522287 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1a280a3cb0 con 0x7f1a2809b3c0 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient: _renew_subs 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1720522287 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f1a28073ee0 con 0x7f1a2809b3c0 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1a20003c50 con 0x7f1a2809b3c0 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1a20004180 con 0x7f1a2809b3c0 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a24d99640 4 set_mon_vals no callback set 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:12.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 10 monclient: dump: 2024-09-10T16:30:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:12.077 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:12.078 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1720522287 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a00005090 con 0x7f1a2809b3c0 2024-09-10T16:30:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.055+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f1a20004320 con 0x7f1a2809b3c0 2024-09-10T16:30:12.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.059+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(16..16 src has 1..16) ==== 3153+0+0 (unknown 2474672291 0 0) 0x7f1a2004af10 con 0x7f1a2809b3c0 2024-09-10T16:30:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.059+0000 7f1a25d9b640 10 monclient: get_auth_request con 0x7f1a0c03d830 auth_method 0 2024-09-10T16:30:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.063+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 <== mon.8 v1:172.21.15.81:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f1a20016ed0 con 0x7f1a2809b3c0 2024-09-10T16:30:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.063+0000 7f1a1effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:12.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.063+0000 7f1a1effd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:12.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.235+0000 7f1a2c8a1640 10 start_mon_command cmd=[{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-09-10T16:30:12.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.235+0000 7f1a2c8a1640 10 monclient: _send_command 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-09-10T16:30:12.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.235+0000 7f1a2c8a1640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:12.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.235+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1720522287 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f1a00005c50 con 0x7f1a2809b3c0 2024-09-10T16:30:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.307+0000 7f1a1effd640 1 -- 172.21.15.81:0/1720522287 <== mon.8 v1:172.21.15.81:6793/0 10 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v17) ==== 109+0+0 (unknown 1910661782 0 0) 0x7f1a200167d0 con 0x7f1a2809b3c0 2024-09-10T16:30:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.307+0000 7f1a1effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}] 2024-09-10T16:30:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.307+0000 7f1a1effd640 10 monclient: _finish_command 2 = system:0 pool 'rbd' created 2024-09-10T16:30:12.310 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'rbd' created 2024-09-10T16:30:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.311+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1720522287 >> v1:172.21.15.189:6812/1108603242 conn(0x7f1a0c03d830 legacy=0x7f1a0c03fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.311+0000 7f1a2c8a1640 10 monclient: shutdown 2024-09-10T16:30:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.311+0000 7f1a2c8a1640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.311+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1720522287 >> v1:172.21.15.81:6793/0 conn(0x7f1a2809b3c0 legacy=0x7f1a2809a060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.311+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1720522287 shutdown_connections 2024-09-10T16:30:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.311+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1720522287 >> 172.21.15.81:0/1720522287 conn(0x7f1a280a87b0 msgr2=0x7f1a2813b110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:12.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.311+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1720522287 shutdown_connections 2024-09-10T16:30:12.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.311+0000 7f1a2c8a1640 1 -- 172.21.15.81:0/1720522287 wait complete. 2024-09-10T16:30:12.332 DEBUG:teuthology.orchestra.run.smithi081:> rbd --cluster ceph pool init rbd 2024-09-10T16:30:12.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 10 monclient: get_monmap_and_config 2024-09-10T16:30:12.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 10 monclient: build_initial_monmap 2024-09-10T16:30:12.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 10 monclient: monmap: 2024-09-10T16:30:12.409 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:12.409 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:12.409 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:12.411177+0000 2024-09-10T16:30:12.409 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:12.411177+0000 2024-09-10T16:30:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:12.410 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:12.410 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 1 Processor -- start 2024-09-10T16:30:12.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 1 -- start start 2024-09-10T16:30:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 10 monclient: init 2024-09-10T16:30:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 10 monclient: _reopen_session rank -1 2024-09-10T16:30:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 10 monclient: _add_conns ranks=[7,3,2,6,5,4,1,0,8] 2024-09-10T16:30:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 10 monclient(hunting): picked mon.noname-i con 0x55d614d61dc0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 10 monclient(hunting): picked mon.noname-g con 0x55d614d6ab80 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 10 monclient(hunting): picked mon.noname-b con 0x55d614d621a0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d614bb4c80 con 0x55d614d621a0 2024-09-10T16:30:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d614d645c0 con 0x55d614d6ab80 2024-09-10T16:30:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d614d648a0 con 0x55d614d61dc0 2024-09-10T16:30:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 10 monclient(hunting): _renew_subs 2024-09-10T16:30:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e76b6c100 10 monclient(hunting): authenticate will time out at 979.811185s 2024-09-10T16:30:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e768d7640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x55d614d621a0 0x55d614e05090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:47682/0 (socket says 172.21.15.81:47682) 2024-09-10T16:30:12.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e768d7640 1 -- 172.21.15.81:0/3900293947 learned_addr learned my addr 172.21.15.81:0/3900293947 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e67fff640 1 -- 172.21.15.81:0/3900293947 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2715632498 0 0) 0x55d614bb4c80 con 0x55d614d621a0 2024-09-10T16:30:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e67fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e67fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e67fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e67fff640 10 monclient(hunting): my global_id is 4214 2024-09-10T16:30:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e67fff640 1 -- 172.21.15.81:0/3900293947 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e5c001e20 con 0x55d614d621a0 2024-09-10T16:30:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e67fff640 1 -- 172.21.15.81:0/3900293947 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 638691367 0 0) 0x7f4e5c001e20 con 0x55d614d621a0 2024-09-10T16:30:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.407+0000 7f4e67fff640 1 -- 172.21.15.81:0/3900293947 >> v1:172.21.15.189:6792/0 conn(0x55d614d61dc0 legacy=0x55d614d62730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 1 -- 172.21.15.81:0/3900293947 >> v1:172.21.15.189:6790/0 conn(0x55d614d6ab80 legacy=0x55d614d62e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 10 monclient: _finish_hunting 0 2024-09-10T16:30:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 1 monclient: found mon.noname-b 2024-09-10T16:30:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:30:12.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 1 -- 172.21.15.81:0/3900293947 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d614d6b000 con 0x55d614d621a0 2024-09-10T16:30:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 10 monclient: _finish_auth 0 2024-09-10T16:30:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 10 monclient: _check_auth_tickets 2024-09-10T16:30:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 1 -- 172.21.15.81:0/3900293947 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4e68001bc0 con 0x55d614d621a0 2024-09-10T16:30:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 5 monclient: authenticate success, global_id 4214 2024-09-10T16:30:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 10 monclient: dump: 2024-09-10T16:30:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.416 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:12.417 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:12.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 1 -- 172.21.15.81:0/3900293947 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e68001de0 con 0x55d614d621a0 2024-09-10T16:30:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 1 -- 172.21.15.81:0/3900293947 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4e68003860 con 0x55d614d621a0 2024-09-10T16:30:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e67fff640 10 monclient: dump: 2024-09-10T16:30:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:12.418 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:12.419 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient: get_monmap_and_config success 2024-09-10T16:30:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 4 set_mon_vals no callback set 2024-09-10T16:30:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient: shutdown 2024-09-10T16:30:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:12.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 1 -- 172.21.15.81:0/3900293947 >> v1:172.21.15.81:6790/0 conn(0x55d614d621a0 legacy=0x55d614e05090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 1 -- 172.21.15.81:0/3900293947 shutdown_connections 2024-09-10T16:30:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 1 -- 172.21.15.81:0/3900293947 >> 172.21.15.81:0/3900293947 conn(0x55d614d4bdc0 msgr2=0x55d614d4c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 1 -- 172.21.15.81:0/3900293947 shutdown_connections 2024-09-10T16:30:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 1 -- 172.21.15.81:0/3900293947 wait complete. 2024-09-10T16:30:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient: build_initial_monmap 2024-09-10T16:30:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient: monmap: 2024-09-10T16:30:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:12.420 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:12.421 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 1 Processor -- start 2024-09-10T16:30:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 1 -- start start 2024-09-10T16:30:12.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient: init 2024-09-10T16:30:12.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient: _reopen_session rank -1 2024-09-10T16:30:12.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient: _add_conns ranks=[6,4,0,7,1,5,2,3,8] 2024-09-10T16:30:12.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient(hunting): picked mon.noname-d con 0x55d614d61dc0 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:12.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient(hunting): picked mon.noname-c con 0x55d614d621a0 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:12.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient(hunting): picked mon.noname-a con 0x55d614d6ab80 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:12.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d614e0f590 con 0x55d614d6ab80 2024-09-10T16:30:12.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d614d65920 con 0x55d614d621a0 2024-09-10T16:30:12.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x55d614dea570 con 0x55d614d61dc0 2024-09-10T16:30:12.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient(hunting): _renew_subs 2024-09-10T16:30:12.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient(hunting): authenticate will time out at 979.814462s 2024-09-10T16:30:12.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e75675640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x55d614d61dc0 0x55d614e0e770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:50446/0 (socket says 172.21.15.81:50446) 2024-09-10T16:30:12.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e75675640 1 -- 172.21.15.81:0/2601583853 learned_addr learned my addr 172.21.15.81:0/2601583853 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:12.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e74e74640 1 --1- 172.21.15.81:0/2601583853 >> v1:172.21.15.81:6791/0 conn(0x55d614d621a0 0x55d614e0ee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:37280/0 (socket says 172.21.15.81:37280) 2024-09-10T16:30:12.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290588405 0 0) 0x55d614dea570 con 0x55d614d61dc0 2024-09-10T16:30:12.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:12.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:12.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:12.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): my global_id is 4236 2024-09-10T16:30:12.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e54001e20 con 0x55d614d61dc0 2024-09-10T16:30:12.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1809320242 0 0) 0x55d614e0f590 con 0x55d614d6ab80 2024-09-10T16:30:12.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:12.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:12.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:12.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): my global_id is 4248 2024-09-10T16:30:12.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55d614dea570 con 0x55d614d6ab80 2024-09-10T16:30:12.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 831257638 0 0) 0x55d614d65920 con 0x55d614d621a0 2024-09-10T16:30:12.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:12.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:12.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:12.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): my global_id is 4324 2024-09-10T16:30:12.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x55d614e0f590 con 0x55d614d621a0 2024-09-10T16:30:12.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1953823769 0 0) 0x55d614dea570 con 0x55d614d6ab80 2024-09-10T16:30:12.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55d614d65920 con 0x55d614d6ab80 2024-09-10T16:30:12.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 937379581 0 0) 0x7f4e54001e20 con 0x55d614d61dc0 2024-09-10T16:30:12.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x55d614dea570 con 0x55d614d61dc0 2024-09-10T16:30:12.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4e680037a0 con 0x55d614d6ab80 2024-09-10T16:30:12.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:12.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:12.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): dump: 2024-09-10T16:30:12.428 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:12.428 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:12.428 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.428 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.428 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:12.428 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:12.428 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:12.428 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:12.428 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:12.428 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:12.428 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:12.428 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:12.428 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:12.429 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:12.429 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:12.429 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:12.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4e6c001b00 con 0x55d614d61dc0 2024-09-10T16:30:12.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:12.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:12.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): dump: 2024-09-10T16:30:12.429 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:12.429 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:12.429 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.429 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.429 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:12.429 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:12.430 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:12.430 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:12.430 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:12.430 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:12.430 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:12.430 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:12.430 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:12.430 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:12.430 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:12.430 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3768853802 0 0) 0x55d614e0f590 con 0x55d614d621a0 2024-09-10T16:30:12.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e54001e20 con 0x55d614d621a0 2024-09-10T16:30:12.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4e60001980 con 0x55d614d621a0 2024-09-10T16:30:12.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:12.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:12.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient(hunting): dump: 2024-09-10T16:30:12.431 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:12.431 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:12.431 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.431 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.431 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:12.431 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:12.431 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:12.431 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:12.431 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:12.431 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:12.432 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:12.432 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:12.432 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:12.432 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:12.432 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:12.432 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 551942576 0 0) 0x55d614d65920 con 0x55d614d6ab80 2024-09-10T16:30:12.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 >> v1:172.21.15.81:6792/0 conn(0x55d614d61dc0 legacy=0x55d614e0e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:12.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 >> v1:172.21.15.81:6791/0 conn(0x55d614d621a0 legacy=0x55d614e0ee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:12.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient: _finish_hunting 0 2024-09-10T16:30:12.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 monclient: found mon.a 2024-09-10T16:30:12.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:12.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d614dead50 con 0x55d614d6ab80 2024-09-10T16:30:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient: _finish_auth 0 2024-09-10T16:30:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient: _check_auth_tickets 2024-09-10T16:30:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 5 monclient: authenticate success, global_id 4248 2024-09-10T16:30:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient: _renew_subs 2024-09-10T16:30:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x55d614deb030 con 0x55d614d6ab80 2024-09-10T16:30:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient: _renew_subs 2024-09-10T16:30:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:12.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x55d614dea000 con 0x55d614d6ab80 2024-09-10T16:30:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e680013b0 con 0x55d614d6ab80 2024-09-10T16:30:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4e68003e60 con 0x55d614d6ab80 2024-09-10T16:30:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e657fa640 10 monclient: dump: 2024-09-10T16:30:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:12.434 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:12.435 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:12.435 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:12.435 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:12.435 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:12.435 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:12.435 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:12.435 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:12.435 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:12.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.411+0000 7f4e677fe640 4 set_mon_vals no callback set 2024-09-10T16:30:12.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.415+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f4e6800fd70 con 0x55d614d6ab80 2024-09-10T16:30:12.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.415+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(17..17 src has 1..17) ==== 3495+0+0 (unknown 2758360416 0 0) 0x7f4e68049b40 con 0x55d614d6ab80 2024-09-10T16:30:12.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.415+0000 7f4e76b6c100 10 start_mon_command cmd=[{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-09-10T16:30:12.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.415+0000 7f4e76b6c100 10 monclient: _send_command 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-09-10T16:30:12.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.415+0000 7f4e76b6c100 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:12.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.415+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x55d614e180f0 con 0x55d614d6ab80 2024-09-10T16:30:12.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:12.415+0000 7f4e75675640 10 monclient: get_auth_request con 0x7f4e5403c2c0 auth_method 0 2024-09-10T16:30:13.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.307+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v18) ==== 141+0+0 (unknown 660702925 0 0) 0x7f4e68015a90 con 0x55d614d6ab80 2024-09-10T16:30:13.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.307+0000 7f4e657fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}] 2024-09-10T16:30:13.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.307+0000 7f4e657fa640 10 monclient: _finish_command 1 = system:0 enabled application 'rbd' on pool 'rbd' 2024-09-10T16:30:13.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.307+0000 7f4e76b6c100 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:13.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.307+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f4e68001de0 con 0x55d614d6ab80 2024-09-10T16:30:13.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.311+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 10 ==== mon_get_version_reply(handle=1 version=18) ==== 24+0+0 (unknown 77724187 0 0) 0x7f4e68015160 con 0x55d614d6ab80 2024-09-10T16:30:13.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.311+0000 7f4e657fa640 10 monclient: handle_get_version_reply finishing 1 version 18 2024-09-10T16:30:13.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.311+0000 7f4e677fe640 10 monclient: _renew_subs 2024-09-10T16:30:13.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.311+0000 7f4e677fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:13.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.311+0000 7f4e677fe640 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=18}) -- 0x7f4e4c002bd0 con 0x55d614d6ab80 2024-09-10T16:30:13.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.311+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 11 ==== osd_map(18..18 src has 1..18) ==== 674+0+0 (unknown 2029840736 0 0) 0x7f4e680489c0 con 0x55d614d6ab80 2024-09-10T16:30:13.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.311+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6800/4086249229 -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x55d614e1c790 con 0x55d614e18c80 2024-09-10T16:30:13.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.311+0000 7f4e74e74640 10 monclient: get_auth_request con 0x55d614e18c80 auth_method 0 2024-09-10T16:30:13.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.319+0000 7f4e74e74640 1 -- 172.21.15.81:0/2601583853 <== osd.1 v1:172.21.15.81:6800/4086249229 1 ==== osd_op_reply(1 rbd_trash [create] v18'1 uv1 ondisk = 0) ==== 153+0+0 (unknown 785457554 0 0) 0x7f4e600040c0 con 0x55d614e18c80 2024-09-10T16:30:13.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.323+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6808/1659450435 -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) -- 0x55d614e72e60 con 0x55d614e6f260 2024-09-10T16:30:13.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.323+0000 7f4e75675640 10 monclient: get_auth_request con 0x55d614e6f260 auth_method 0 2024-09-10T16:30:13.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.323+0000 7f4e75675640 1 -- 172.21.15.81:0/2601583853 <== osd.0 v1:172.21.15.81:6808/1659450435 1 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1898125418 0 0) 0x7f4e6c002700 con 0x55d614e6f260 2024-09-10T16:30:13.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.323+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6808/1659450435 -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e18) -- 0x55d614e6dcf0 con 0x55d614e6f260 2024-09-10T16:30:13.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.323+0000 7f4e75675640 1 -- 172.21.15.81:0/2601583853 <== osd.0 v1:172.21.15.81:6808/1659450435 2 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (unknown 1886642790 0 0) 0x7f4e6c002700 con 0x55d614e6f260 2024-09-10T16:30:13.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.323+0000 7f4e66ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:13.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:13.323+0000 7f4e66ffd640 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6789/0 -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f4e50001f10 con 0x55d614d6ab80 2024-09-10T16:30:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:14.319+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 12 ==== pool_op_reply(tid 4 (0) Success v19) ==== 55+0+0 (unknown 3590493641 0 0) 0x7f4e68015390 con 0x55d614d6ab80 2024-09-10T16:30:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:14.319+0000 7f4e657fa640 10 monclient: _renew_subs 2024-09-10T16:30:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:14.319+0000 7f4e657fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:14.319+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=19}) -- 0x55d614d65920 con 0x55d614d6ab80 2024-09-10T16:30:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:14.319+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 13 ==== osd_map(19..19 src has 1..19) ==== 626+0+0 (unknown 2043912511 0 0) 0x7f4e6801e3d0 con 0x55d614d6ab80 2024-09-10T16:30:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:14.319+0000 7f4e677fe640 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6808/1659450435 -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7f4e4c0058a0 con 0x55d614e6f260 2024-09-10T16:30:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:14.323+0000 7f4e75675640 1 -- 172.21.15.81:0/2601583853 <== osd.0 v1:172.21.15.81:6808/1659450435 3 ==== osd_op_reply(5 rbd_info [create,write 0~8] v19'1 uv1 ondisk = 0) ==== 194+0+0 (unknown 1570664900 0 0) 0x7f4e6c002700 con 0x55d614e6f260 2024-09-10T16:30:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:14.327+0000 7f4e66ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:14.327+0000 7f4e66ffd640 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6789/0 -- pool_op(delete unmanaged snap pool 2 tid 6 name v19) -- 0x7f4e50003380 con 0x55d614d6ab80 2024-09-10T16:30:15.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.331+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 14 ==== pool_op_reply(tid 6 (0) Success v20) ==== 43+0+0 (unknown 740721325 0 0) 0x7f4e6801e860 con 0x55d614d6ab80 2024-09-10T16:30:15.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.331+0000 7f4e657fa640 10 monclient: _renew_subs 2024-09-10T16:30:15.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.331+0000 7f4e657fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:15.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.331+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=20}) -- 0x55d614dea570 con 0x55d614d6ab80 2024-09-10T16:30:15.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.331+0000 7f4e657fa640 1 -- 172.21.15.81:0/2601583853 <== mon.0 v1:172.21.15.81:6789/0 15 ==== osd_map(20..20 src has 1..20) ==== 654+0+0 (unknown 2658963229 0 0) 0x7f4e6801e5d0 con 0x55d614d6ab80 2024-09-10T16:30:15.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.331+0000 7f4e677fe640 1 -- 172.21.15.81:0/2601583853 --> v1:172.21.15.81:6808/1659450435 -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e20) -- 0x7f4e4c005c80 con 0x55d614e6f260 2024-09-10T16:30:15.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.339+0000 7f4e75675640 1 -- 172.21.15.81:0/2601583853 <== osd.0 v1:172.21.15.81:6808/1659450435 4 ==== osd_op_reply(7 rbd_info [write 0~19] v20'2 uv2 ondisk = 0) ==== 152+0+0 (unknown 1721084249 0 0) 0x7f4e6c002700 con 0x55d614e6f260 2024-09-10T16:30:15.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.339+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 >> v1:172.21.15.81:6808/1659450435 conn(0x55d614e6f260 legacy=0x55d614e716f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.339+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 >> v1:172.21.15.81:6800/4086249229 conn(0x55d614e18c80 legacy=0x55d614e1b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.339+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 >> v1:172.21.15.189:6812/1108603242 conn(0x7f4e5403c2c0 legacy=0x7f4e5403e780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.339+0000 7f4e76b6c100 10 monclient: shutdown 2024-09-10T16:30:15.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.339+0000 7f4e76b6c100 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:15.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.339+0000 7f4e768d7640 1 -- 172.21.15.81:0/2601583853 reap_dead start 2024-09-10T16:30:15.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.339+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 >> v1:172.21.15.81:6789/0 conn(0x55d614d6ab80 legacy=0x55d614e169d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.343+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 shutdown_connections 2024-09-10T16:30:15.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.343+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 >> 172.21.15.81:0/2601583853 conn(0x55d614d4bdc0 msgr2=0x55d614d65b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:15.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.343+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 shutdown_connections 2024-09-10T16:30:15.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.343+0000 7f4e76b6c100 1 -- 172.21.15.81:0/2601583853 wait complete. 2024-09-10T16:30:15.352 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-10T16:30:15.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-10T16:30:15.353 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-10T16:30:15.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.479+0000 7f2e9af13640 10 monclient: get_monmap_and_config 2024-09-10T16:30:15.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.479+0000 7f2e9af13640 10 monclient: build_initial_monmap 2024-09-10T16:30:15.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.479+0000 7f2e9af13640 10 monclient: monmap: 2024-09-10T16:30:15.484 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:15.484 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:15.484 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:15.485646+0000 2024-09-10T16:30:15.484 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:15.485646+0000 2024-09-10T16:30:15.484 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:15.485 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:15.485 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 1 Processor -- start 2024-09-10T16:30:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 1 -- start start 2024-09-10T16:30:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 10 monclient: init 2024-09-10T16:30:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:15.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 10 monclient: _add_conns ranks=[0,2,6,8,4,3,7,1,5] 2024-09-10T16:30:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 10 monclient(hunting): picked mon.noname-a con 0x7f2e9406e990 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 10 monclient(hunting): picked mon.noname-b con 0x7f2e940a4600 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 10 monclient(hunting): picked mon.noname-d con 0x7f2e940a49e0 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e9406f7f0 con 0x7f2e9406e990 2024-09-10T16:30:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e940a5630 con 0x7f2e940a4600 2024-09-10T16:30:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e94070900 con 0x7f2e940a49e0 2024-09-10T16:30:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 10 monclient(hunting): authenticate will time out at 982.885339s 2024-09-10T16:30:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e98caf640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2e9406e990 0x7f2e940a3ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42992/0 (socket says 172.21.15.81:42992) 2024-09-10T16:30:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e98caf640 1 -- 172.21.15.81:0/1805546717 learned_addr learned my addr 172.21.15.81:0/1805546717 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 1 -- 172.21.15.81:0/1805546717 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3036134280 0 0) 0x7f2e94070900 con 0x7f2e940a49e0 2024-09-10T16:30:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:15.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient(hunting): my global_id is 4245 2024-09-10T16:30:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 1 -- 172.21.15.81:0/1805546717 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e80003530 con 0x7f2e940a49e0 2024-09-10T16:30:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 1 -- 172.21.15.81:0/1805546717 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4239478078 0 0) 0x7f2e84001120 con 0x7f2e9406e990 2024-09-10T16:30:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient(hunting): my global_id is 4257 2024-09-10T16:30:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 1 -- 172.21.15.81:0/1805546717 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e94070900 con 0x7f2e9406e990 2024-09-10T16:30:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 1 -- 172.21.15.81:0/1805546717 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1300914815 0 0) 0x7f2e940a5630 con 0x7f2e940a4600 2024-09-10T16:30:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:15.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient(hunting): my global_id is 4223 2024-09-10T16:30:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 1 -- 172.21.15.81:0/1805546717 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e84001120 con 0x7f2e940a4600 2024-09-10T16:30:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 1 -- 172.21.15.81:0/1805546717 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3120016280 0 0) 0x7f2e80003530 con 0x7f2e940a49e0 2024-09-10T16:30:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 1 -- 172.21.15.81:0/1805546717 >> v1:172.21.15.81:6790/0 conn(0x7f2e940a4600 legacy=0x7f2e9413e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 1 -- 172.21.15.81:0/1805546717 >> v1:172.21.15.81:6789/0 conn(0x7f2e9406e990 legacy=0x7f2e940a3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient: _finish_hunting 0 2024-09-10T16:30:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 1 monclient: found mon.noname-d 2024-09-10T16:30:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:30:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 1 -- 172.21.15.81:0/1805546717 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e94070630 con 0x7f2e940a49e0 2024-09-10T16:30:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient: _finish_auth 0 2024-09-10T16:30:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient: _check_auth_tickets 2024-09-10T16:30:15.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 1 -- 172.21.15.81:0/1805546717 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2e8c001770 con 0x7f2e940a49e0 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient: dump: 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:15.495 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:15.496 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 5 monclient: authenticate success, global_id 4245 2024-09-10T16:30:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 1 -- 172.21.15.81:0/1805546717 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e8c001910 con 0x7f2e940a49e0 2024-09-10T16:30:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 4 set_mon_vals no callback set 2024-09-10T16:30:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 1 -- 172.21.15.81:0/1805546717 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2e8c003960 con 0x7f2e940a49e0 2024-09-10T16:30:15.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e937fe640 10 monclient: dump: 2024-09-10T16:30:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:15.497 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:15.498 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 10 monclient: shutdown 2024-09-10T16:30:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 1 -- 172.21.15.81:0/1805546717 >> v1:172.21.15.81:6792/0 conn(0x7f2e940a49e0 legacy=0x7f2e94141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 1 -- 172.21.15.81:0/1805546717 shutdown_connections 2024-09-10T16:30:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 1 -- 172.21.15.81:0/1805546717 >> 172.21.15.81:0/1805546717 conn(0x7f2e940a94f0 msgr2=0x7f2e940a9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:15.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 1 -- 172.21.15.81:0/1805546717 shutdown_connections 2024-09-10T16:30:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 1 -- 172.21.15.81:0/1805546717 wait complete. 2024-09-10T16:30:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 10 monclient: build_initial_monmap 2024-09-10T16:30:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 10 monclient: monmap: 2024-09-10T16:30:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:15.499 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:15.500 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.483+0000 7f2e9af13640 1 Processor -- start 2024-09-10T16:30:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 1 -- start start 2024-09-10T16:30:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 monclient: init 2024-09-10T16:30:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 monclient: _add_conns ranks=[3,0,8,6,1,4,2,7,5] 2024-09-10T16:30:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 monclient(hunting): picked mon.noname-g con 0x7f2e9406e990 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 monclient(hunting): picked mon.noname-a con 0x7f2e940a4600 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:15.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 monclient(hunting): picked mon.noname-e con 0x7f2e940a49e0 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e94126ef0 con 0x7f2e940a4600 2024-09-10T16:30:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e941289b0 con 0x7f2e9406e990 2024-09-10T16:30:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2e94128c90 con 0x7f2e940a49e0 2024-09-10T16:30:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 monclient(hunting): authenticate will time out at 982.888509s 2024-09-10T16:30:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e93fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2e940a4600 0x7f2e941d2840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43004/0 (socket says 172.21.15.81:43004) 2024-09-10T16:30:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e93fff640 1 -- 172.21.15.81:0/2702597374 learned_addr learned my addr 172.21.15.81:0/2702597374 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2796556607 0 0) 0x7f2e94126ef0 con 0x7f2e940a4600 2024-09-10T16:30:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:15.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): my global_id is 4266 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e74003530 con 0x7f2e940a4600 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2879925290 0 0) 0x7f2e94128c90 con 0x7f2e940a49e0 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): my global_id is 4220 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e94126ef0 con 0x7f2e940a49e0 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 642932141 0 0) 0x7f2e74003530 con 0x7f2e940a4600 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e94128c90 con 0x7f2e940a4600 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2e7c001f20 con 0x7f2e940a4600 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): dump: 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:15.504 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2737163570 0 0) 0x7f2e94126ef0 con 0x7f2e940a49e0 2024-09-10T16:30:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2e74003530 con 0x7f2e940a49e0 2024-09-10T16:30:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2e8c003940 con 0x7f2e940a49e0 2024-09-10T16:30:15.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): dump: 2024-09-10T16:30:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:15.506 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1008523041 0 0) 0x7f2e941289b0 con 0x7f2e9406e990 2024-09-10T16:30:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient(hunting): my global_id is 4206 2024-09-10T16:30:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2e94126ef0 con 0x7f2e9406e990 2024-09-10T16:30:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 522262591 0 0) 0x7f2e74003530 con 0x7f2e940a49e0 2024-09-10T16:30:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 >> v1:172.21.15.189:6790/0 conn(0x7f2e9406e990 legacy=0x7f2e941418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 >> v1:172.21.15.81:6789/0 conn(0x7f2e940a4600 legacy=0x7f2e941d2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient: _finish_hunting 0 2024-09-10T16:30:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 monclient: found mon.e 2024-09-10T16:30:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e94142000 con 0x7f2e940a49e0 2024-09-10T16:30:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient: _finish_auth 0 2024-09-10T16:30:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient: _check_auth_tickets 2024-09-10T16:30:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 5 monclient: authenticate success, global_id 4220 2024-09-10T16:30:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 monclient: _renew_subs 2024-09-10T16:30:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 1 -- 172.21.15.81:0/2702597374 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2e941269b0 con 0x7f2e940a49e0 2024-09-10T16:30:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 monclient: _renew_subs 2024-09-10T16:30:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 1 -- 172.21.15.81:0/2702597374 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f2e94127c20 con 0x7f2e940a49e0 2024-09-10T16:30:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2e8c001090 con 0x7f2e940a49e0 2024-09-10T16:30:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2e8c003c20 con 0x7f2e940a49e0 2024-09-10T16:30:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e92ffd640 4 set_mon_vals no callback set 2024-09-10T16:30:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 10 monclient: dump: 2024-09-10T16:30:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:15.509 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f2e8c00fb30 con 0x7f2e940a49e0 2024-09-10T16:30:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e9af13640 1 -- 172.21.15.81:0/2702597374 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2e78005090 con 0x7f2e940a49e0 2024-09-10T16:30:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f2e8c049940 con 0x7f2e940a49e0 2024-09-10T16:30:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.487+0000 7f2e98caf640 10 monclient: get_auth_request con 0x7f2e7403d690 auth_method 0 2024-09-10T16:30:15.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.491+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 <== mon.8 v1:172.21.15.81:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f2e8c015890 con 0x7f2e940a49e0 2024-09-10T16:30:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.491+0000 7f2e917fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.491+0000 7f2e917fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.663+0000 7f2e9af13640 10 start_mon_command cmd=[{"prefix": "config log", "num": 1, "format": "json"}] 2024-09-10T16:30:15.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.663+0000 7f2e9af13640 10 monclient: _send_command 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2024-09-10T16:30:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.663+0000 7f2e9af13640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.663+0000 7f2e9af13640 1 -- 172.21.15.81:0/2702597374 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f2e78005380 con 0x7f2e940a49e0 2024-09-10T16:30:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.663+0000 7f2e917fa640 1 -- 172.21.15.81:0/2702597374 <== mon.8 v1:172.21.15.81:6793/0 10 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v6) ==== 86+0+159 (unknown 2698850854 0 3137209546) 0x7f2e8c015190 con 0x7f2e940a49e0 2024-09-10T16:30:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.663+0000 7f2e917fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config log", "num": 1, "format": "json"}] 2024-09-10T16:30:15.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.663+0000 7f2e917fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:15.667 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:30:15.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.667+0000 7f2e9af13640 1 -- 172.21.15.81:0/2702597374 >> v1:172.21.15.189:6812/1108603242 conn(0x7f2e7403d690 legacy=0x7f2e7403fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.667+0000 7f2e9af13640 10 monclient: shutdown 2024-09-10T16:30:15.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.667+0000 7f2e9af13640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:15.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.667+0000 7f2e9af13640 1 -- 172.21.15.81:0/2702597374 >> v1:172.21.15.81:6793/0 conn(0x7f2e940a49e0 legacy=0x7f2e941d5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.667+0000 7f2e9af13640 1 -- 172.21.15.81:0/2702597374 shutdown_connections 2024-09-10T16:30:15.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.667+0000 7f2e9af13640 1 -- 172.21.15.81:0/2702597374 >> 172.21.15.81:0/2702597374 conn(0x7f2e940a94f0 msgr2=0x7f2e940a2d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:15.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.667+0000 7f2e9af13640 1 -- 172.21.15.81:0/2702597374 shutdown_connections 2024-09-10T16:30:15.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.667+0000 7f2e9af13640 1 -- 172.21.15.81:0/2702597374 wait complete. 2024-09-10T16:30:15.685 INFO:teuthology.orchestra.run.smithi081.stdout:[{"version":6,"timestamp":"2024-09-10T16:30:07.325293+0000","name":"","changes":[{"name":"osd.3/osd_mclock_max_capacity_iops_ssd","new_value":"5448.104102"}]}] 2024-09-10T16:30:15.685 INFO:tasks.ceph_manager:config epoch is 6 2024-09-10T16:30:15.686 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-10T16:30:15.686 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-10T16:30:15.686 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-10T16:30:15.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.795+0000 7fb417184640 10 monclient: get_monmap_and_config 2024-09-10T16:30:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.795+0000 7fb417184640 10 monclient: build_initial_monmap 2024-09-10T16:30:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.795+0000 7fb417184640 10 monclient: monmap: 2024-09-10T16:30:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:15.800747+0000 2024-09-10T16:30:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:15.800747+0000 2024-09-10T16:30:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:15.799 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:15.800 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:15.800 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:15.800 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:15.800 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:15.800 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:15.800 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.795+0000 7fb417184640 1 Processor -- start 2024-09-10T16:30:15.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.795+0000 7fb417184640 1 -- start start 2024-09-10T16:30:15.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.795+0000 7fb417184640 10 monclient: init 2024-09-10T16:30:15.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:15.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient: _add_conns ranks=[2,0,3,4,6,1,8,5,7] 2024-09-10T16:30:15.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient(hunting): picked mon.noname-b con 0x7fb4100a5510 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:15.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient(hunting): picked mon.noname-a con 0x7fb410135bf0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient(hunting): picked mon.noname-g con 0x7fb410136060 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb41009d7e0 con 0x7fb410135bf0 2024-09-10T16:30:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb41009dac0 con 0x7fb4100a5510 2024-09-10T16:30:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb41009dda0 con 0x7fb410136060 2024-09-10T16:30:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient(hunting): authenticate will time out at 983.200199s 2024-09-10T16:30:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb410135bf0 0x7fb41013de30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43008/0 (socket says 172.21.15.81:43008) 2024-09-10T16:30:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40ffff640 1 -- 172.21.15.81:0/440477276 learned_addr learned my addr 172.21.15.81:0/440477276 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb414f20640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fb4100a5510 0x7fb4100a58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38458/0 (socket says 172.21.15.81:38458) 2024-09-10T16:30:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 1 -- 172.21.15.81:0/440477276 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4149415245 0 0) 0x7fb41009d7e0 con 0x7fb410135bf0 2024-09-10T16:30:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:15.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient(hunting): my global_id is 4275 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 1 -- 172.21.15.81:0/440477276 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3f8003530 con 0x7fb410135bf0 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 1 -- 172.21.15.81:0/440477276 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089125579 0 0) 0x7fb41009dac0 con 0x7fb4100a5510 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient(hunting): my global_id is 4232 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 1 -- 172.21.15.81:0/440477276 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb41009d7e0 con 0x7fb4100a5510 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 1 -- 172.21.15.81:0/440477276 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 818211337 0 0) 0x7fb3f8003530 con 0x7fb410135bf0 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 1 -- 172.21.15.81:0/440477276 >> v1:172.21.15.189:6790/0 conn(0x7fb410136060 legacy=0x7fb410141560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 1 -- 172.21.15.81:0/440477276 >> v1:172.21.15.81:6790/0 conn(0x7fb4100a5510 legacy=0x7fb4100a58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 1 monclient: found mon.noname-a 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:30:15.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 1 -- 172.21.15.81:0/440477276 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb41009cca0 con 0x7fb410135bf0 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient: _finish_auth 0 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 1 -- 172.21.15.81:0/440477276 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb404001840 con 0x7fb410135bf0 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 5 monclient: authenticate success, global_id 4275 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient: dump: 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:15.809 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 1 -- 172.21.15.81:0/440477276 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb404001a60 con 0x7fb410135bf0 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 1 -- 172.21.15.81:0/440477276 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb404001d50 con 0x7fb410135bf0 2024-09-10T16:30:15.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 4 set_mon_vals no callback set 2024-09-10T16:30:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40f7fe640 10 monclient: dump: 2024-09-10T16:30:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:15.811 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:15.812 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient: shutdown 2024-09-10T16:30:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 1 -- 172.21.15.81:0/440477276 >> v1:172.21.15.81:6789/0 conn(0x7fb410135bf0 legacy=0x7fb41013de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 1 -- 172.21.15.81:0/440477276 shutdown_connections 2024-09-10T16:30:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 1 -- 172.21.15.81:0/440477276 >> 172.21.15.81:0/440477276 conn(0x7fb41006dae0 msgr2=0x7fb4100ab8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 1 -- 172.21.15.81:0/440477276 shutdown_connections 2024-09-10T16:30:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 1 -- 172.21.15.81:0/440477276 wait complete. 2024-09-10T16:30:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient: build_initial_monmap 2024-09-10T16:30:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient: monmap: 2024-09-10T16:30:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:15.813 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:15.814 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 1 Processor -- start 2024-09-10T16:30:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 1 -- start start 2024-09-10T16:30:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient: init 2024-09-10T16:30:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:15.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient: _add_conns ranks=[6,0,2,4,1,3,8,7,5] 2024-09-10T16:30:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient(hunting): picked mon.noname-d con 0x7fb4100a5510 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient(hunting): picked mon.noname-a con 0x7fb410135bf0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient(hunting): picked mon.noname-b con 0x7fb410136060 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4101ca990 con 0x7fb410135bf0 2024-09-10T16:30:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4100a04a0 con 0x7fb410136060 2024-09-10T16:30:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb410132e40 con 0x7fb4100a5510 2024-09-10T16:30:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb417184640 10 monclient(hunting): authenticate will time out at 983.203424s 2024-09-10T16:30:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40ffff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb410135bf0 0x7fb4101d27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43014/0 (socket says 172.21.15.81:43014) 2024-09-10T16:30:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40ffff640 1 -- 172.21.15.81:0/587431194 learned_addr learned my addr 172.21.15.81:0/587431194 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1183366360 0 0) 0x7fb41009cca0 con 0x7fb410135bf0 2024-09-10T16:30:15.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 10 monclient(hunting): my global_id is 4284 2024-09-10T16:30:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb3fc003530 con 0x7fb410135bf0 2024-09-10T16:30:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1031500068 0 0) 0x7fb4100a04a0 con 0x7fb410136060 2024-09-10T16:30:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 10 monclient(hunting): my global_id is 4241 2024-09-10T16:30:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb41009cca0 con 0x7fb410136060 2024-09-10T16:30:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1565555344 0 0) 0x7fb410132e40 con 0x7fb4100a5510 2024-09-10T16:30:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:15.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 10 monclient(hunting): my global_id is 4254 2024-09-10T16:30:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.799+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb4100a04a0 con 0x7fb4100a5510 2024-09-10T16:30:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3830604103 0 0) 0x7fb3fc003530 con 0x7fb410135bf0 2024-09-10T16:30:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb410132e40 con 0x7fb410135bf0 2024-09-10T16:30:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb404001800 con 0x7fb410135bf0 2024-09-10T16:30:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient(hunting): dump: 2024-09-10T16:30:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:15.817 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:15.818 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3354806256 0 0) 0x7fb4100a04a0 con 0x7fb4100a5510 2024-09-10T16:30:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb3fc003530 con 0x7fb4100a5510 2024-09-10T16:30:15.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb400001470 con 0x7fb4100a5510 2024-09-10T16:30:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient(hunting): dump: 2024-09-10T16:30:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:15.819 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2057234629 0 0) 0x7fb41009cca0 con 0x7fb410136060 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb4100a04a0 con 0x7fb410136060 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb408001c40 con 0x7fb410136060 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient(hunting): dump: 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.820 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:15.821 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:15.821 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1760503414 0 0) 0x7fb410132e40 con 0x7fb410135bf0 2024-09-10T16:30:15.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 >> v1:172.21.15.81:6792/0 conn(0x7fb4100a5510 legacy=0x7fb4100a4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 >> v1:172.21.15.81:6790/0 conn(0x7fb410136060 legacy=0x7fb4101d5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:15.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient: _finish_hunting 0 2024-09-10T16:30:15.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 monclient: found mon.a 2024-09-10T16:30:15.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:15.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:15.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4100a8ee0 con 0x7fb410135bf0 2024-09-10T16:30:15.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient: _finish_auth 0 2024-09-10T16:30:15.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient: _check_auth_tickets 2024-09-10T16:30:15.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb417184640 5 monclient: authenticate success, global_id 4284 2024-09-10T16:30:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb417184640 10 monclient: _renew_subs 2024-09-10T16:30:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb417184640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb417184640 1 -- 172.21.15.81:0/587431194 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb4100a64f0 con 0x7fb410135bf0 2024-09-10T16:30:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb417184640 10 monclient: _renew_subs 2024-09-10T16:30:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb417184640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb417184640 1 -- 172.21.15.81:0/587431194 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb41009eea0 con 0x7fb410135bf0 2024-09-10T16:30:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb404001a20 con 0x7fb410135bf0 2024-09-10T16:30:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb404001c50 con 0x7fb410135bf0 2024-09-10T16:30:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40effd640 4 set_mon_vals no callback set 2024-09-10T16:30:15.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 10 monclient: dump: 2024-09-10T16:30:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:15.824 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:15.825 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb417184640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb417184640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb417184640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb417184640 1 -- 172.21.15.81:0/587431194 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3f0005090 con 0x7fb410135bf0 2024-09-10T16:30:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fb404011070 con 0x7fb410135bf0 2024-09-10T16:30:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7fb40404ae50 con 0x7fb410135bf0 2024-09-10T16:30:15.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.803+0000 7fb414f20640 10 monclient: get_auth_request con 0x7fb3fc03da50 auth_method 0 2024-09-10T16:30:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.807+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7fb4101ca990 con 0x7fb410135bf0 2024-09-10T16:30:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.807+0000 7fb40d7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:15.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:15.807+0000 7fb40d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:16.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.003+0000 7fb417184640 10 start_mon_command cmd=[{"prefix": "mgr dump", "format": "json"}] 2024-09-10T16:30:16.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.003+0000 7fb417184640 10 monclient: _send_command 2 [{"prefix": "mgr dump", "format": "json"}] 2024-09-10T16:30:16.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.003+0000 7fb417184640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:16.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.003+0000 7fb417184640 1 -- 172.21.15.81:0/587431194 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fb3f0005380 con 0x7fb410135bf0 2024-09-10T16:30:16.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.007+0000 7fb40d7fa640 1 -- 172.21.15.81:0/587431194 <== mon.0 v1:172.21.15.81:6789/0 10 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+93155 (unknown 481731318 0 386143650) 0x7fb404016e70 con 0x7fb410135bf0 2024-09-10T16:30:16.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.007+0000 7fb40d7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mgr dump", "format": "json"}] 2024-09-10T16:30:16.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.007+0000 7fb40d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:16.011 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:30:16.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.007+0000 7fb417184640 1 -- 172.21.15.81:0/587431194 >> v1:172.21.15.189:6812/1108603242 conn(0x7fb3fc03da50 legacy=0x7fb3fc03ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.007+0000 7fb417184640 10 monclient: shutdown 2024-09-10T16:30:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.007+0000 7fb417184640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.007+0000 7fb417184640 1 -- 172.21.15.81:0/587431194 >> v1:172.21.15.81:6789/0 conn(0x7fb410135bf0 legacy=0x7fb4101d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.011+0000 7fb417184640 1 -- 172.21.15.81:0/587431194 shutdown_connections 2024-09-10T16:30:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.011+0000 7fb417184640 1 -- 172.21.15.81:0/587431194 >> 172.21.15.81:0/587431194 conn(0x7fb41006dae0 msgr2=0x7fb41012c120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.011+0000 7fb417184640 1 -- 172.21.15.81:0/587431194 shutdown_connections 2024-09-10T16:30:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.011+0000 7fb417184640 1 -- 172.21.15.81:0/587431194 wait complete. 2024-09-10T16:30:16.028 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"flags":0,"active_gid":4118,"active_name":"x","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6812","nonce":1108603242}]},"active_addr":"172.21.15.189:6812/1108603242","active_change":"2024-09-10T16:30:00.273714+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.189:0","nonce":1069156864}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.189:0","nonce":1989519423}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.189:0","nonce":3449059383}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.189:0","nonce":3896732642}]}]} 2024-09-10T16:30:16.030 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-10T16:30:16.030 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-10T16:30:16.030 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T16:30:16.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.147+0000 7f7065f8e640 10 monclient: get_monmap_and_config 2024-09-10T16:30:16.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.147+0000 7f7065f8e640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.147+0000 7f7065f8e640 10 monclient: monmap: 2024-09-10T16:30:16.151 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.151 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.151 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:16.153030+0000 2024-09-10T16:30:16.152 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:16.153030+0000 2024-09-10T16:30:16.152 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.152 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.152 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.152 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.152 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.152 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.152 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.152 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.152 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.152 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.152 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.152 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 1 Processor -- start 2024-09-10T16:30:16.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 1 -- start start 2024-09-10T16:30:16.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient: init 2024-09-10T16:30:16.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient: _add_conns ranks=[5,2,7,8,4,1,0,6,3] 2024-09-10T16:30:16.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient(hunting): picked mon.noname-h con 0x7f70600a3ef0 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:16.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient(hunting): picked mon.noname-b con 0x7f7060073d20 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:16.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient(hunting): picked mon.noname-i con 0x7f70600a49e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:16.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7060073870 con 0x7f7060073d20 2024-09-10T16:30:16.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70600a5630 con 0x7f70600a3ef0 2024-09-10T16:30:16.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7060073590 con 0x7f70600a49e0 2024-09-10T16:30:16.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient(hunting): authenticate will time out at 983.553083s 2024-09-10T16:30:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705effd640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f7060073d20 0x7f706013c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38472/0 (socket says 172.21.15.81:38472) 2024-09-10T16:30:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705effd640 1 -- 172.21.15.81:0/2639138288 learned_addr learned my addr 172.21.15.81:0/2639138288 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 1 -- 172.21.15.81:0/2639138288 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 418595612 0 0) 0x7f7060073870 con 0x7f7060073d20 2024-09-10T16:30:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient(hunting): my global_id is 4250 2024-09-10T16:30:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 1 -- 172.21.15.81:0/2639138288 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7048003530 con 0x7f7060073d20 2024-09-10T16:30:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 1 -- 172.21.15.81:0/2639138288 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1314084512 0 0) 0x7f7048003530 con 0x7f7060073d20 2024-09-10T16:30:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 1 -- 172.21.15.81:0/2639138288 >> v1:172.21.15.189:6792/0 conn(0x7f70600a49e0 legacy=0x7f706013f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 1 -- 172.21.15.81:0/2639138288 >> v1:172.21.15.189:6791/0 conn(0x7f70600a3ef0 legacy=0x7f70600a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 1 monclient: found mon.noname-b 2024-09-10T16:30:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 1 -- 172.21.15.81:0/2639138288 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70600a5870 con 0x7f7060073d20 2024-09-10T16:30:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 1 -- 172.21.15.81:0/2639138288 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7054001840 con 0x7f7060073d20 2024-09-10T16:30:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient: dump: 2024-09-10T16:30:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.162 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.162 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.162 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.162 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.162 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.162 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.162 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.162 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.162 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.162 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.162 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.162 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.162 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 5 monclient: authenticate success, global_id 4250 2024-09-10T16:30:16.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:16.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 1 -- 172.21.15.81:0/2639138288 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70540019e0 con 0x7f7060073d20 2024-09-10T16:30:16.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:16.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 4 set_mon_vals no callback set 2024-09-10T16:30:16.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 1 -- 172.21.15.81:0/2639138288 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7054004bf0 con 0x7f7060073d20 2024-09-10T16:30:16.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:16.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f705e7fc640 10 monclient: dump: 2024-09-10T16:30:16.163 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.163 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.163 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.163 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.164 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.164 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.164 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.164 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.164 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.164 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.164 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.164 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.164 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.164 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.164 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.164 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient: shutdown 2024-09-10T16:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 1 -- 172.21.15.81:0/2639138288 >> v1:172.21.15.81:6790/0 conn(0x7f7060073d20 legacy=0x7f706013c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 1 -- 172.21.15.81:0/2639138288 shutdown_connections 2024-09-10T16:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 1 -- 172.21.15.81:0/2639138288 >> 172.21.15.81:0/2639138288 conn(0x7f70600a94f0 msgr2=0x7f70600a9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 1 -- 172.21.15.81:0/2639138288 shutdown_connections 2024-09-10T16:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 1 -- 172.21.15.81:0/2639138288 wait complete. 2024-09-10T16:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient: monmap: 2024-09-10T16:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:16.165 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.166 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 1 Processor -- start 2024-09-10T16:30:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 1 -- start start 2024-09-10T16:30:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient: init 2024-09-10T16:30:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient: _add_conns ranks=[2,6,0,4,7,3,1,5,8] 2024-09-10T16:30:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient(hunting): picked mon.noname-b con 0x7f7060073d20 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient(hunting): picked mon.noname-d con 0x7f70600a3ef0 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 10 monclient(hunting): picked mon.noname-a con 0x7f70600a49e0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.151+0000 7f7065f8e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70601217b0 con 0x7f70600a49e0 2024-09-10T16:30:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7060121300 con 0x7f7060073d20 2024-09-10T16:30:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7060137c70 con 0x7f70600a3ef0 2024-09-10T16:30:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 10 monclient(hunting): authenticate will time out at 983.556026s 2024-09-10T16:30:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f705f7fe640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f7060073d20 0x7f70601ce2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38476/0 (socket says 172.21.15.81:38476) 2024-09-10T16:30:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f705f7fe640 1 -- 172.21.15.81:0/2479640160 learned_addr learned my addr 172.21.15.81:0/2479640160 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 863638184 0 0) 0x7f7060121300 con 0x7f7060073d20 2024-09-10T16:30:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): my global_id is 4259 2024-09-10T16:30:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f704c003530 con 0x7f7060073d20 2024-09-10T16:30:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093353421 0 0) 0x7f7060137c70 con 0x7f70600a3ef0 2024-09-10T16:30:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): my global_id is 4263 2024-09-10T16:30:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7060121300 con 0x7f70600a3ef0 2024-09-10T16:30:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1060127196 0 0) 0x7f7060073590 con 0x7f70600a49e0 2024-09-10T16:30:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): my global_id is 4293 2024-09-10T16:30:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7060137c70 con 0x7f70600a49e0 2024-09-10T16:30:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2606354462 0 0) 0x7f704c003530 con 0x7f7060073d20 2024-09-10T16:30:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7060073590 con 0x7f7060073d20 2024-09-10T16:30:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7050001be0 con 0x7f7060073d20 2024-09-10T16:30:16.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:16.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): dump: 2024-09-10T16:30:16.170 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.170 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.170 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.170 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.170 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.170 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.170 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.170 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.170 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.170 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.170 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.171 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 782969131 0 0) 0x7f7060137c70 con 0x7f70600a49e0 2024-09-10T16:30:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f704c003530 con 0x7f70600a49e0 2024-09-10T16:30:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1664288753 0 0) 0x7f7060121300 con 0x7f70600a3ef0 2024-09-10T16:30:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7060137c70 con 0x7f70600a3ef0 2024-09-10T16:30:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7058001bc0 con 0x7f70600a49e0 2024-09-10T16:30:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): dump: 2024-09-10T16:30:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.173 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7054004b30 con 0x7f70600a3ef0 2024-09-10T16:30:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient(hunting): dump: 2024-09-10T16:30:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.174 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1674900768 0 0) 0x7f7060073590 con 0x7f7060073d20 2024-09-10T16:30:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 >> v1:172.21.15.81:6792/0 conn(0x7f70600a3ef0 legacy=0x7f70601d3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 >> v1:172.21.15.81:6789/0 conn(0x7f70600a49e0 legacy=0x7f70601d6950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 monclient: found mon.b 2024-09-10T16:30:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70600a01f0 con 0x7f7060073d20 2024-09-10T16:30:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 5 monclient: authenticate success, global_id 4259 2024-09-10T16:30:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 10 monclient: _renew_subs 2024-09-10T16:30:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 1 -- 172.21.15.81:0/2479640160 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f706009fe30 con 0x7f7060073d20 2024-09-10T16:30:16.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 10 monclient: _renew_subs 2024-09-10T16:30:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 1 -- 172.21.15.81:0/2479640160 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f7060121020 con 0x7f7060073d20 2024-09-10T16:30:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f70500038d0 con 0x7f7060073d20 2024-09-10T16:30:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7050003e80 con 0x7f7060073d20 2024-09-10T16:30:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f705dffb640 4 set_mon_vals no callback set 2024-09-10T16:30:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 10 monclient: dump: 2024-09-10T16:30:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.176 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.177 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:16.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7065f8e640 1 -- 172.21.15.81:0/2479640160 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7040005090 con 0x7f7060073d20 2024-09-10T16:30:16.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f70500040a0 con 0x7f7060073d20 2024-09-10T16:30:16.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f705004afa0 con 0x7f7060073d20 2024-09-10T16:30:16.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.155+0000 7f705effd640 10 monclient: get_auth_request con 0x7f704c03da10 auth_method 0 2024-09-10T16:30:16.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.159+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f7050016e90 con 0x7f7060073d20 2024-09-10T16:30:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.159+0000 7f7047fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:16.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.159+0000 7f7047fff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:16.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.335+0000 7f7065f8e640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:16.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.335+0000 7f7065f8e640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:16.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.335+0000 7f7065f8e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.335+0000 7f7065f8e640 1 -- 172.21.15.81:0/2479640160 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7040005380 con 0x7f7060073d20 2024-09-10T16:30:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.339+0000 7f7047fff640 1 -- 172.21.15.81:0/2479640160 <== mon.2 v1:172.21.15.81:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+10963 (unknown 3413328019 0 2723292324) 0x7f7050016790 con 0x7f7060073d20 2024-09-10T16:30:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.339+0000 7f7047fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:16.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.339+0000 7f7047fff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:16.343 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:30:16.344 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","created":"2024-09-10T16:29:55.164545+0000","modified":"2024-09-10T16:30:15.314824+0000","last_up_change":"2024-09-10T16:30:08.199951+0000","last_in_change":"2024-09-10T16:29:57.004838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T16:30:08.333238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T16:30:12.247126+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c68b183d-5af0-4465-bf0b-1b1410e7a5c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6808","nonce":1659450435}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6809","nonce":1659450435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6811","nonce":1659450435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6810","nonce":1659450435}]},"public_addr":"172.21.15.81:6808/1659450435","cluster_addr":"172.21.15.81:6809/1659450435","heartbeat_back_addr":"172.21.15.81:6811/1659450435","heartbeat_front_addr":"172.21.15.81:6810/1659450435","state":["exists","up"]},{"osd":1,"uuid":"b0e4a6b2-56e9-4f68-8dc0-998d3dec5bc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6800","nonce":4086249229}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6801","nonce":4086249229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6803","nonce":4086249229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6802","nonce":4086249229}]},"public_addr":"172.21.15.81:6800/4086249229","cluster_addr":"172.21.15.81:6801/4086249229","heartbeat_back_addr":"172.21.15.81:6803/4086249229","heartbeat_front_addr":"172.21.15.81:6802/4086249229","state":["exists","up"]},{"osd":2,"uuid":"8021ac53-8498-4069-92a8-a6477fab55b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6804","nonce":2595021275}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6805","nonce":2595021275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6807","nonce":2595021275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6806","nonce":2595021275}]},"public_addr":"172.21.15.81:6804/2595021275","cluster_addr":"172.21.15.81:6805/2595021275","heartbeat_back_addr":"172.21.15.81:6807/2595021275","heartbeat_front_addr":"172.21.15.81:6806/2595021275","state":["exists","up"]},{"osd":3,"uuid":"c098399b-faef-460a-b448-a1c4ba227a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6804","nonce":3461775318}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6805","nonce":3461775318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6807","nonce":3461775318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6806","nonce":3461775318}]},"public_addr":"172.21.15.189:6804/3461775318","cluster_addr":"172.21.15.189:6805/3461775318","heartbeat_back_addr":"172.21.15.189:6807/3461775318","heartbeat_front_addr":"172.21.15.189:6806/3461775318","state":["exists","up"]},{"osd":4,"uuid":"f9ea0631-7d1d-4b3a-9806-684dfc66c44e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6808","nonce":1206180154}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6809","nonce":1206180154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6811","nonce":1206180154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6810","nonce":1206180154}]},"public_addr":"172.21.15.189:6808/1206180154","cluster_addr":"172.21.15.189:6809/1206180154","heartbeat_back_addr":"172.21.15.189:6811/1206180154","heartbeat_front_addr":"172.21.15.189:6810/1206180154","state":["exists","up"]},{"osd":5,"uuid":"e32e3250-fe69-4ef0-8553-974e89bf80e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6800","nonce":1814191784}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6801","nonce":1814191784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6803","nonce":1814191784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6802","nonce":1814191784}]},"public_addr":"172.21.15.189:6800/1814191784","cluster_addr":"172.21.15.189:6801/1814191784","heartbeat_back_addr":"172.21.15.189:6803/1814191784","heartbeat_front_addr":"172.21.15.189:6802/1814191784","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.542123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.718470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.484310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.507370+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.609326+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.643721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T16:30:16.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.343+0000 7f7065f8e640 1 -- 172.21.15.81:0/2479640160 >> v1:172.21.15.189:6812/1108603242 conn(0x7f704c03da10 legacy=0x7f704c03fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.343+0000 7f7065f8e640 10 monclient: shutdown 2024-09-10T16:30:16.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.343+0000 7f7065f8e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.343+0000 7f7065f8e640 1 -- 172.21.15.81:0/2479640160 >> v1:172.21.15.81:6790/0 conn(0x7f7060073d20 legacy=0x7f70601ce2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.343+0000 7f7065f8e640 1 -- 172.21.15.81:0/2479640160 shutdown_connections 2024-09-10T16:30:16.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.343+0000 7f7065f8e640 1 -- 172.21.15.81:0/2479640160 >> 172.21.15.81:0/2479640160 conn(0x7f70600a94f0 msgr2=0x7f706009e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.343+0000 7f7065f8e640 1 -- 172.21.15.81:0/2479640160 shutdown_connections 2024-09-10T16:30:16.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.343+0000 7f7065f8e640 1 -- 172.21.15.81:0/2479640160 wait complete. 2024-09-10T16:30:16.361 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-10T16:30:16.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T16:30:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.475+0000 7f767acc6640 10 monclient: get_monmap_and_config 2024-09-10T16:30:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.475+0000 7f767acc6640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.475+0000 7f767acc6640 10 monclient: monmap: 2024-09-10T16:30:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:16.480744+0000 2024-09-10T16:30:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:16.480744+0000 2024-09-10T16:30:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.480 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.475+0000 7f767acc6640 1 Processor -- start 2024-09-10T16:30:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.475+0000 7f767acc6640 1 -- start start 2024-09-10T16:30:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.475+0000 7f767acc6640 10 monclient: init 2024-09-10T16:30:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.475+0000 7f767acc6640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient: _add_conns ranks=[6,0,1,7,4,3,8,5,2] 2024-09-10T16:30:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient(hunting): picked mon.noname-d con 0x7f76740a0a90 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient(hunting): picked mon.noname-a con 0x7f76740a35f0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:16.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient(hunting): picked mon.noname-f con 0x7f76740a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767409df70 con 0x7f76740a35f0 2024-09-10T16:30:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767409fa30 con 0x7f76740a3a40 2024-09-10T16:30:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767409fd10 con 0x7f76740a0a90 2024-09-10T16:30:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient(hunting): authenticate will time out at 983.880134s 2024-09-10T16:30:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f7673fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f76740a35f0 0x7f767413c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43028/0 (socket says 172.21.15.81:43028) 2024-09-10T16:30:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f7673fff640 1 -- 172.21.15.81:0/1452238475 learned_addr learned my addr 172.21.15.81:0/1452238475 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f7678a62640 1 --1- 172.21.15.81:0/1452238475 >> v1:172.21.15.81:6792/0 conn(0x7f76740a0a90 0x7f76740a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56100/0 (socket says 172.21.15.81:56100) 2024-09-10T16:30:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 1 -- 172.21.15.81:0/1452238475 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 264279663 0 0) 0x7f767409df70 con 0x7f76740a35f0 2024-09-10T16:30:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient(hunting): my global_id is 4302 2024-09-10T16:30:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 1 -- 172.21.15.81:0/1452238475 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7660003530 con 0x7f76740a35f0 2024-09-10T16:30:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 1 -- 172.21.15.81:0/1452238475 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 589976480 0 0) 0x7f767409fd10 con 0x7f76740a0a90 2024-09-10T16:30:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient(hunting): my global_id is 4272 2024-09-10T16:30:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 1 -- 172.21.15.81:0/1452238475 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f767409df70 con 0x7f76740a0a90 2024-09-10T16:30:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 1 -- 172.21.15.81:0/1452238475 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3579804105 0 0) 0x7f7660003530 con 0x7f76740a35f0 2024-09-10T16:30:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 1 -- 172.21.15.81:0/1452238475 >> v1:172.21.15.81:6792/0 conn(0x7f76740a0a90 legacy=0x7f76740a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 1 -- 172.21.15.81:0/1452238475 >> v1:172.21.15.189:6789/0 conn(0x7f76740a3a40 legacy=0x7f767413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 1 monclient: found mon.noname-a 2024-09-10T16:30:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:30:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 1 -- 172.21.15.81:0/1452238475 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767409fff0 con 0x7f76740a35f0 2024-09-10T16:30:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 1 -- 172.21.15.81:0/1452238475 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f765c001860 con 0x7f76740a35f0 2024-09-10T16:30:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 5 monclient: authenticate success, global_id 4302 2024-09-10T16:30:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient: dump: 2024-09-10T16:30:16.490 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.491 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.491 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.491 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.491 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.491 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.491 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.491 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.491 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.491 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.491 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.491 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.491 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.491 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.492 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.492 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:16.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 1 -- 172.21.15.81:0/1452238475 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f765c001a00 con 0x7f76740a35f0 2024-09-10T16:30:16.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:16.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 4 set_mon_vals no callback set 2024-09-10T16:30:16.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 1 -- 172.21.15.81:0/1452238475 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f765c004bf0 con 0x7f76740a35f0 2024-09-10T16:30:16.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:16.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76737fe640 10 monclient: dump: 2024-09-10T16:30:16.492 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.492 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.493 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.493 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.493 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.493 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.493 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.493 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.493 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.493 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.493 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.493 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.493 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.493 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.493 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.493 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient: shutdown 2024-09-10T16:30:16.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 1 -- 172.21.15.81:0/1452238475 >> v1:172.21.15.81:6789/0 conn(0x7f76740a35f0 legacy=0x7f767413c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 1 -- 172.21.15.81:0/1452238475 shutdown_connections 2024-09-10T16:30:16.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 1 -- 172.21.15.81:0/1452238475 >> 172.21.15.81:0/1452238475 conn(0x7f76740a3fd0 msgr2=0x7f76740a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 1 -- 172.21.15.81:0/1452238475 shutdown_connections 2024-09-10T16:30:16.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 1 -- 172.21.15.81:0/1452238475 wait complete. 2024-09-10T16:30:16.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient: monmap: 2024-09-10T16:30:16.494 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.494 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:16.494 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:16.494 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:16.494 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 1 Processor -- start 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 1 -- start start 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient: init 2024-09-10T16:30:16.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient: _add_conns ranks=[2,1,8,6,0,5,4,3,7] 2024-09-10T16:30:16.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient(hunting): picked mon.noname-b con 0x7f76740a0a90 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:16.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient(hunting): picked mon.noname-f con 0x7f76740a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:16.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient(hunting): picked mon.noname-e con 0x7f767409c510 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:16.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7674098b20 con 0x7f76740a3a40 2024-09-10T16:30:16.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7674098e00 con 0x7f76740a0a90 2024-09-10T16:30:16.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7674097600 con 0x7f767409c510 2024-09-10T16:30:16.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f767acc6640 10 monclient(hunting): authenticate will time out at 983.883315s 2024-09-10T16:30:16.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f7678a62640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f76740a0a90 0x7f76741ca690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38488/0 (socket says 172.21.15.81:38488) 2024-09-10T16:30:16.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f7678a62640 1 -- 172.21.15.81:0/3209930058 learned_addr learned my addr 172.21.15.81:0/3209930058 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2740688079 0 0) 0x7f7674097600 con 0x7f767409c510 2024-09-10T16:30:16.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76717fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76717fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76717fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76717fa640 10 monclient(hunting): my global_id is 4229 2024-09-10T16:30:16.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7654003530 con 0x7f767409c510 2024-09-10T16:30:16.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1843267477 0 0) 0x7f7674098e00 con 0x7f76740a0a90 2024-09-10T16:30:16.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76717fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76717fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76717fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76717fa640 10 monclient(hunting): my global_id is 4268 2024-09-10T16:30:16.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7674097600 con 0x7f76740a0a90 2024-09-10T16:30:16.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 434622757 0 0) 0x7f7674097600 con 0x7f76740a0a90 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.479+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7674098e00 con 0x7f76740a0a90 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 300421665 0 0) 0x7f7654003530 con 0x7f767409c510 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7674097600 con 0x7f767409c510 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7664001410 con 0x7f76740a0a90 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient(hunting): dump: 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3438206140 0 0) 0x7f7674098b20 con 0x7f76740a3a40 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient(hunting): my global_id is 4285 2024-09-10T16:30:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7654003530 con 0x7f76740a3a40 2024-09-10T16:30:16.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f766c001cc0 con 0x7f767409c510 2024-09-10T16:30:16.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:16.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient(hunting): dump: 2024-09-10T16:30:16.500 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.500 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.500 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.500 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.500 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.500 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.500 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.500 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.500 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.500 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.501 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 962397531 0 0) 0x7f7674098e00 con 0x7f76740a0a90 2024-09-10T16:30:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 >> v1:172.21.15.81:6793/0 conn(0x7f767409c510 legacy=0x7f76741d6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 >> v1:172.21.15.189:6789/0 conn(0x7f76740a3a40 legacy=0x7f76741d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 monclient: found mon.b 2024-09-10T16:30:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7674099810 con 0x7f76740a0a90 2024-09-10T16:30:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f767acc6640 5 monclient: authenticate success, global_id 4268 2024-09-10T16:30:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f767acc6640 10 monclient: _renew_subs 2024-09-10T16:30:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f767acc6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f767acc6640 1 -- 172.21.15.81:0/3209930058 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7674097ac0 con 0x7f76740a0a90 2024-09-10T16:30:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f767acc6640 10 monclient: _renew_subs 2024-09-10T16:30:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f767acc6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f767acc6640 1 -- 172.21.15.81:0/3209930058 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f76741cada0 con 0x7f76740a0a90 2024-09-10T16:30:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7664001750 con 0x7f76740a0a90 2024-09-10T16:30:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7664004de0 con 0x7f76740a0a90 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f7672ffd640 4 set_mon_vals no callback set 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 10 monclient: dump: 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.504 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f7664010cf0 con 0x7f76740a0a90 2024-09-10T16:30:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f767acc6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f767acc6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f767acc6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f767acc6640 1 -- 172.21.15.81:0/3209930058 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7658005090 con 0x7f76740a0a90 2024-09-10T16:30:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f766404ac90 con 0x7f76740a0a90 2024-09-10T16:30:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.483+0000 7f7673fff640 10 monclient: get_auth_request con 0x7f765403d800 auth_method 0 2024-09-10T16:30:16.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.487+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f7664016b20 con 0x7f76740a0a90 2024-09-10T16:30:16.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.487+0000 7f76717fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:16.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.487+0000 7f76717fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:16.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.643+0000 7f767acc6640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:16.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.643+0000 7f767acc6640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:16.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.643+0000 7f767acc6640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.643+0000 7f767acc6640 1 -- 172.21.15.81:0/3209930058 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7658005380 con 0x7f76740a0a90 2024-09-10T16:30:16.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.643+0000 7f76717fa640 1 -- 172.21.15.81:0/3209930058 <== mon.2 v1:172.21.15.81:6790/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) ==== 74+0+10963 (unknown 3413328019 0 2723292324) 0x7f7664016420 con 0x7f76740a0a90 2024-09-10T16:30:16.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.643+0000 7f76717fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:16.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.643+0000 7f76717fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:16.647 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:30:16.647 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":20,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","created":"2024-09-10T16:29:55.164545+0000","modified":"2024-09-10T16:30:15.314824+0000","last_up_change":"2024-09-10T16:30:08.199951+0000","last_in_change":"2024-09-10T16:29:57.004838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T16:30:08.333238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T16:30:12.247126+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c68b183d-5af0-4465-bf0b-1b1410e7a5c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6808","nonce":1659450435}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6809","nonce":1659450435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6811","nonce":1659450435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6810","nonce":1659450435}]},"public_addr":"172.21.15.81:6808/1659450435","cluster_addr":"172.21.15.81:6809/1659450435","heartbeat_back_addr":"172.21.15.81:6811/1659450435","heartbeat_front_addr":"172.21.15.81:6810/1659450435","state":["exists","up"]},{"osd":1,"uuid":"b0e4a6b2-56e9-4f68-8dc0-998d3dec5bc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6800","nonce":4086249229}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6801","nonce":4086249229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6803","nonce":4086249229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6802","nonce":4086249229}]},"public_addr":"172.21.15.81:6800/4086249229","cluster_addr":"172.21.15.81:6801/4086249229","heartbeat_back_addr":"172.21.15.81:6803/4086249229","heartbeat_front_addr":"172.21.15.81:6802/4086249229","state":["exists","up"]},{"osd":2,"uuid":"8021ac53-8498-4069-92a8-a6477fab55b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6804","nonce":2595021275}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6805","nonce":2595021275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6807","nonce":2595021275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6806","nonce":2595021275}]},"public_addr":"172.21.15.81:6804/2595021275","cluster_addr":"172.21.15.81:6805/2595021275","heartbeat_back_addr":"172.21.15.81:6807/2595021275","heartbeat_front_addr":"172.21.15.81:6806/2595021275","state":["exists","up"]},{"osd":3,"uuid":"c098399b-faef-460a-b448-a1c4ba227a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6804","nonce":3461775318}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6805","nonce":3461775318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6807","nonce":3461775318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6806","nonce":3461775318}]},"public_addr":"172.21.15.189:6804/3461775318","cluster_addr":"172.21.15.189:6805/3461775318","heartbeat_back_addr":"172.21.15.189:6807/3461775318","heartbeat_front_addr":"172.21.15.189:6806/3461775318","state":["exists","up"]},{"osd":4,"uuid":"f9ea0631-7d1d-4b3a-9806-684dfc66c44e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6808","nonce":1206180154}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6809","nonce":1206180154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6811","nonce":1206180154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6810","nonce":1206180154}]},"public_addr":"172.21.15.189:6808/1206180154","cluster_addr":"172.21.15.189:6809/1206180154","heartbeat_back_addr":"172.21.15.189:6811/1206180154","heartbeat_front_addr":"172.21.15.189:6810/1206180154","state":["exists","up"]},{"osd":5,"uuid":"e32e3250-fe69-4ef0-8553-974e89bf80e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6800","nonce":1814191784}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6801","nonce":1814191784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6803","nonce":1814191784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6802","nonce":1814191784}]},"public_addr":"172.21.15.189:6800/1814191784","cluster_addr":"172.21.15.189:6801/1814191784","heartbeat_back_addr":"172.21.15.189:6803/1814191784","heartbeat_front_addr":"172.21.15.189:6802/1814191784","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.542123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.718470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.484310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.507370+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.609326+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.643721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T16:30:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.647+0000 7f767acc6640 1 -- 172.21.15.81:0/3209930058 >> v1:172.21.15.189:6812/1108603242 conn(0x7f765403d800 legacy=0x7f765403fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.647+0000 7f767acc6640 10 monclient: shutdown 2024-09-10T16:30:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.647+0000 7f767acc6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.647+0000 7f767acc6640 1 -- 172.21.15.81:0/3209930058 >> v1:172.21.15.81:6790/0 conn(0x7f76740a0a90 legacy=0x7f76741ca690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.647+0000 7f767acc6640 1 -- 172.21.15.81:0/3209930058 shutdown_connections 2024-09-10T16:30:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.647+0000 7f767acc6640 1 -- 172.21.15.81:0/3209930058 >> 172.21.15.81:0/3209930058 conn(0x7f76740a3fd0 msgr2=0x7f7674072810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.647+0000 7f767acc6640 1 -- 172.21.15.81:0/3209930058 shutdown_connections 2024-09-10T16:30:16.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.647+0000 7f767acc6640 1 -- 172.21.15.81:0/3209930058 wait complete. 2024-09-10T16:30:16.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-10T16:30:16.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-10T16:30:16.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-10T16:30:16.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-10T16:30:16.666 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-10T16:30:16.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-10T16:30:16.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 10 monclient: get_monmap_and_config 2024-09-10T16:30:16.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 10 monclient: monmap: 2024-09-10T16:30:16.778 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.778 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.778 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:16.780081+0000 2024-09-10T16:30:16.778 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:16.780081+0000 2024-09-10T16:30:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.779 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.779 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 1 Processor -- start 2024-09-10T16:30:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 1 -- start start 2024-09-10T16:30:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 10 monclient: init 2024-09-10T16:30:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 10 monclient: _add_conns ranks=[8,7,2,6,1,3,5,0,4] 2024-09-10T16:30:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 10 monclient(hunting): picked mon.noname-e con 0x7fa67c0a3ef0 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 10 monclient(hunting): picked mon.noname-i con 0x7fa67c073d20 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 10 monclient(hunting): picked mon.noname-b con 0x7fa67c0a49e0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa6826fb640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fa67c0a49e0 0x7fa67c13f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38500/0 (socket says 172.21.15.81:38500) 2024-09-10T16:30:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa6826fb640 1 -- 172.21.15.81:0/687325788 learned_addr learned my addr 172.21.15.81:0/687325788 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 1 -- 172.21.15.81:0/687325788 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c073870 con 0x7fa67c0a49e0 2024-09-10T16:30:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 1 -- 172.21.15.81:0/687325788 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c0a5630 con 0x7fa67c073d20 2024-09-10T16:30:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa680ef8640 1 -- 172.21.15.81:0/687325788 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3536133988 0 0) 0x7fa67c073870 con 0x7fa67c0a49e0 2024-09-10T16:30:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 1 -- 172.21.15.81:0/687325788 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c073590 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa68415e640 10 monclient(hunting): authenticate will time out at 984.179907s 2024-09-10T16:30:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa680ef8640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa680ef8640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa680ef8640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa680ef8640 10 monclient(hunting): my global_id is 4277 2024-09-10T16:30:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.775+0000 7fa680ef8640 1 -- 172.21.15.81:0/687325788 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa668003530 con 0x7fa67c0a49e0 2024-09-10T16:30:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 1 -- 172.21.15.81:0/687325788 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3860201165 0 0) 0x7fa67c0a5630 con 0x7fa67c073d20 2024-09-10T16:30:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient(hunting): my global_id is 4282 2024-09-10T16:30:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 1 -- 172.21.15.81:0/687325788 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa67c073870 con 0x7fa67c073d20 2024-09-10T16:30:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 1 -- 172.21.15.81:0/687325788 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1638705026 0 0) 0x7fa67c073590 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient(hunting): my global_id is 4238 2024-09-10T16:30:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 1 -- 172.21.15.81:0/687325788 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa67c0a5630 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 1 -- 172.21.15.81:0/687325788 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 475435044 0 0) 0x7fa668003530 con 0x7fa67c0a49e0 2024-09-10T16:30:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 1 -- 172.21.15.81:0/687325788 >> v1:172.21.15.81:6793/0 conn(0x7fa67c0a3ef0 legacy=0x7fa67c0a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 1 -- 172.21.15.81:0/687325788 >> v1:172.21.15.189:6792/0 conn(0x7fa67c073d20 legacy=0x7fa67c13c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 1 monclient: found mon.noname-b 2024-09-10T16:30:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 1 -- 172.21.15.81:0/687325788 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c0a5870 con 0x7fa67c0a49e0 2024-09-10T16:30:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 1 -- 172.21.15.81:0/687325788 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa674001bc0 con 0x7fa67c0a49e0 2024-09-10T16:30:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient: dump: 2024-09-10T16:30:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.786 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.788 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 5 monclient: authenticate success, global_id 4277 2024-09-10T16:30:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 1 -- 172.21.15.81:0/687325788 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa674001de0 con 0x7fa67c0a49e0 2024-09-10T16:30:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 1 -- 172.21.15.81:0/687325788 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa674004f70 con 0x7fa67c0a49e0 2024-09-10T16:30:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa680ef8640 10 monclient: dump: 2024-09-10T16:30:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.790 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 4 set_mon_vals no callback set 2024-09-10T16:30:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 10 monclient: shutdown 2024-09-10T16:30:16.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 1 -- 172.21.15.81:0/687325788 >> v1:172.21.15.81:6790/0 conn(0x7fa67c0a49e0 legacy=0x7fa67c13f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 1 -- 172.21.15.81:0/687325788 shutdown_connections 2024-09-10T16:30:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 1 -- 172.21.15.81:0/687325788 >> 172.21.15.81:0/687325788 conn(0x7fa67c0a94f0 msgr2=0x7fa67c0a9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 1 -- 172.21.15.81:0/687325788 shutdown_connections 2024-09-10T16:30:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 1 -- 172.21.15.81:0/687325788 wait complete. 2024-09-10T16:30:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 10 monclient: monmap: 2024-09-10T16:30:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:16.791 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.792 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 1 Processor -- start 2024-09-10T16:30:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 1 -- start start 2024-09-10T16:30:16.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 10 monclient: init 2024-09-10T16:30:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7f31c0f4f640 10 monclient: get_monmap_and_config 2024-09-10T16:30:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7f31c0f4f640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7f31c0f4f640 10 monclient: monmap: 2024-09-10T16:30:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:16.784800+0000 2024-09-10T16:30:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:16.784800+0000 2024-09-10T16:30:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.793 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.794 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.794 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 10 monclient: _add_conns ranks=[2,0,6,3,1,4,5,7,8] 2024-09-10T16:30:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 10 monclient(hunting): picked mon.noname-b con 0x7fa67c073d20 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 10 monclient(hunting): picked mon.noname-a con 0x7fa67c0a3ef0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa681efa640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fa67c073d20 0x7fa67c137560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38502/0 (socket says 172.21.15.81:38502) 2024-09-10T16:30:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa681efa640 1 -- 172.21.15.81:0/4115052396 learned_addr learned my addr 172.21.15.81:0/4115052396 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 10 monclient(hunting): picked mon.noname-d con 0x7fa67c0a49e0 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 1 -- 172.21.15.81:0/4115052396 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c13f670 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 1 -- 172.21.15.81:0/4115052396 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c0a99b0 con 0x7fa67c073d20 2024-09-10T16:30:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 1 -- 172.21.15.81:0/4115052396 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa67c120fe0 con 0x7fa67c0a49e0 2024-09-10T16:30:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 204177317 0 0) 0x7fa67c13f670 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa68415e640 10 monclient(hunting): authenticate will time out at 984.183629s 2024-09-10T16:30:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 10 monclient(hunting): my global_id is 4311 2024-09-10T16:30:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa660003530 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 394207147 0 0) 0x7fa678001300 con 0x7fa67c073d20 2024-09-10T16:30:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 10 monclient(hunting): my global_id is 4286 2024-09-10T16:30:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa67c13f670 con 0x7fa67c073d20 2024-09-10T16:30:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3132121747 0 0) 0x7fa67c120fe0 con 0x7fa67c0a49e0 2024-09-10T16:30:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 10 monclient(hunting): my global_id is 4281 2024-09-10T16:30:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.779+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa678001300 con 0x7fa67c0a49e0 2024-09-10T16:30:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1754144598 0 0) 0x7fa660003530 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa67c120fe0 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa66c001990 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient(hunting): dump: 2024-09-10T16:30:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.800 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:16.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3982267314 0 0) 0x7fa67c13f670 con 0x7fa67c073d20 2024-09-10T16:30:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa660003530 con 0x7fa67c073d20 2024-09-10T16:30:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa678003620 con 0x7fa67c073d20 2024-09-10T16:30:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient(hunting): dump: 2024-09-10T16:30:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2419512772 0 0) 0x7fa67c120fe0 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 >> v1:172.21.15.81:6792/0 conn(0x7fa67c0a49e0 legacy=0x7fa67c1d5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 >> v1:172.21.15.81:6790/0 conn(0x7fa67c073d20 legacy=0x7fa67c137560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 monclient: found mon.a 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67c0a9de0 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa68415e640 5 monclient: authenticate success, global_id 4311 2024-09-10T16:30:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa68415e640 10 monclient: _renew_subs 2024-09-10T16:30:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa68415e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa68415e640 1 -- 172.21.15.81:0/4115052396 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa67c120740 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 1 Processor -- start 2024-09-10T16:30:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa68415e640 10 monclient: _renew_subs 2024-09-10T16:30:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa68415e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa68415e640 1 -- 172.21.15.81:0/4115052396 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa67c137c70 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 1 -- start start 2024-09-10T16:30:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 10 monclient: init 2024-09-10T16:30:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa66c003620 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa66c003c50 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient: dump: 2024-09-10T16:30:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.805 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.806 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa673fff640 4 set_mon_vals no callback set 2024-09-10T16:30:16.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 10 monclient: _add_conns ranks=[1,5,2,7,3,8,6,0,4] 2024-09-10T16:30:16.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 10 monclient(hunting): picked mon.noname-f con 0x7f31bc068960 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:16.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa68415e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:16.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa68415e640 1 -- 172.21.15.81:0/4115052396 --> v1:172.21.15.81:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa664000f90 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 10 monclient(hunting): picked mon.noname-h con 0x7f31bc0a0950 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 10 monclient(hunting): picked mon.noname-b con 0x7f31bc13f5c0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31bc0a4200 con 0x7f31bc068960 2024-09-10T16:30:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31bc0a3c20 con 0x7f31bc13f5c0 2024-09-10T16:30:16.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31bc0a0ee0 con 0x7f31bc0a0950 2024-09-10T16:30:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 10 monclient(hunting): authenticate will time out at 984.185557s 2024-09-10T16:30:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31bad9d640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f31bc13f5c0 0x7f31bc1419b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38514/0 (socket says 172.21.15.81:38514) 2024-09-10T16:30:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31bad9d640 1 -- 172.21.15.81:0/4234890239 learned_addr learned my addr 172.21.15.81:0/4234890239 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 1 -- 172.21.15.81:0/4234890239 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3612823424 0 0) 0x7f31bc0a3c20 con 0x7f31bc13f5c0 2024-09-10T16:30:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient(hunting): my global_id is 4295 2024-09-10T16:30:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 1 -- 172.21.15.81:0/4234890239 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31a4003530 con 0x7f31bc13f5c0 2024-09-10T16:30:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 1 -- 172.21.15.81:0/4234890239 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2016986790 0 0) 0x7f31a4003530 con 0x7f31bc13f5c0 2024-09-10T16:30:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 1 -- 172.21.15.81:0/4234890239 >> v1:172.21.15.189:6791/0 conn(0x7f31bc0a0950 legacy=0x7f31bc0a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 1 -- 172.21.15.81:0/4234890239 >> v1:172.21.15.189:6789/0 conn(0x7f31bc068960 legacy=0x7f31bc0a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 1 monclient: found mon.noname-b 2024-09-10T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 1 -- 172.21.15.81:0/4234890239 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31bc0a4630 con 0x7f31bc13f5c0 2024-09-10T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 5 monclient: authenticate success, global_id 4295 2024-09-10T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 1 -- 172.21.15.81:0/4234890239 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f31b4001bc0 con 0x7f31bc13f5c0 2024-09-10T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient: dump: 2024-09-10T16:30:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.811 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.812 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 1 -- 172.21.15.81:0/4234890239 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31b4001dd0 con 0x7f31bc13f5c0 2024-09-10T16:30:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 1 -- 172.21.15.81:0/4234890239 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f31b4004f70 con 0x7f31bc13f5c0 2024-09-10T16:30:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 4 set_mon_vals no callback set 2024-09-10T16:30:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31b959a640 10 monclient: dump: 2024-09-10T16:30:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.814 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fa66c00fb60 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7fa66c0499c0 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 --> v1:172.21.15.81:6808/1659450435 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa6600480e0 con 0x7fa660044430 2024-09-10T16:30:16.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7fa66c014f80 con 0x7fa67c0a3ef0 2024-09-10T16:30:16.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6727fc640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-10T16:30:16.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 10 monclient: shutdown 2024-09-10T16:30:16.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 1 -- 172.21.15.81:0/4234890239 >> v1:172.21.15.81:6790/0 conn(0x7f31bc13f5c0 legacy=0x7f31bc1419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 1 -- 172.21.15.81:0/4234890239 shutdown_connections 2024-09-10T16:30:16.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 1 -- 172.21.15.81:0/4234890239 >> 172.21.15.81:0/4234890239 conn(0x7f31bc0a85d0 msgr2=0x7f31bc0a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa681efa640 10 monclient: get_auth_request con 0x7fa66003d8a0 auth_method 0 2024-09-10T16:30:16.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7fa6826fb640 10 monclient: get_auth_request con 0x7fa660044430 auth_method 0 2024-09-10T16:30:16.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 1 -- 172.21.15.81:0/4234890239 shutdown_connections 2024-09-10T16:30:16.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.783+0000 7f31c0f4f640 1 -- 172.21.15.81:0/4234890239 wait complete. 2024-09-10T16:30:16.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 10 monclient: monmap: 2024-09-10T16:30:16.817 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.817 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:16.817 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:16.817 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:16.817 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.817 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:16.817 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.817 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.817 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.817 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.817 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.817 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.817 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.817 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.818 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.818 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 1 Processor -- start 2024-09-10T16:30:16.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== osd.0 v1:172.21.15.81:6808/1659450435 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fa6600480e0 con 0x7fa660044430 2024-09-10T16:30:16.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 1 -- start start 2024-09-10T16:30:16.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 10 monclient: init 2024-09-10T16:30:16.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 10 monclient: _add_conns ranks=[5,2,1,6,7,8,4,0,3] 2024-09-10T16:30:16.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 10 monclient(hunting): picked mon.noname-h con 0x7f31bc068960 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:16.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 10 monclient(hunting): picked mon.noname-b con 0x7f31bc0a0950 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:16.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 10 monclient(hunting): picked mon.noname-f con 0x7f31bc13f5c0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:16.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31bc073fa0 con 0x7f31bc13f5c0 2024-09-10T16:30:16.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31bc071ef0 con 0x7f31bc0a0950 2024-09-10T16:30:16.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31bc0a6aa0 con 0x7f31bc068960 2024-09-10T16:30:16.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31c0f4f640 10 monclient(hunting): authenticate will time out at 984.189625s 2024-09-10T16:30:16.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31b9d9b640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f31bc0a0950 0x7f31bc0717e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38520/0 (socket says 172.21.15.81:38520) 2024-09-10T16:30:16.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31b9d9b640 1 -- 172.21.15.81:0/1026013968 learned_addr learned my addr 172.21.15.81:0/1026013968 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3037536287 0 0) 0x7f31bc071ef0 con 0x7f31bc0a0950 2024-09-10T16:30:16.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): my global_id is 4304 2024-09-10T16:30:16.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f319c003530 con 0x7f31bc0a0950 2024-09-10T16:30:16.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 513609389 0 0) 0x7f31bc073fa0 con 0x7f31bc13f5c0 2024-09-10T16:30:16.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): my global_id is 4294 2024-09-10T16:30:16.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31bc071ef0 con 0x7f31bc13f5c0 2024-09-10T16:30:16.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1313698367 0 0) 0x7f31bc0a6aa0 con 0x7f31bc068960 2024-09-10T16:30:16.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): my global_id is 4262 2024-09-10T16:30:16.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31bc073fa0 con 0x7f31bc068960 2024-09-10T16:30:16.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3614290853 0 0) 0x7f319c003530 con 0x7f31bc0a0950 2024-09-10T16:30:16.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31bc0a6aa0 con 0x7f31bc0a0950 2024-09-10T16:30:16.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f31b0001be0 con 0x7f31bc0a0950 2024-09-10T16:30:16.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:16.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): dump: 2024-09-10T16:30:16.823 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.823 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.823 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.823 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.823 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.823 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.823 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.823 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.823 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.823 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.823 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.824 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 971957338 0 0) 0x7f31bc0a6aa0 con 0x7f31bc0a0950 2024-09-10T16:30:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 >> v1:172.21.15.189:6791/0 conn(0x7f31bc068960 legacy=0x7f31bc0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 >> v1:172.21.15.189:6789/0 conn(0x7f31bc13f5c0 legacy=0x7f31bc1d6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 monclient: found mon.b 2024-09-10T16:30:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31bc0a6570 con 0x7f31bc0a0950 2024-09-10T16:30:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31b00038d0 con 0x7f31bc0a0950 2024-09-10T16:30:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f31b0003e80 con 0x7f31bc0a0950 2024-09-10T16:30:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31aaffd640 10 monclient: dump: 2024-09-10T16:30:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.825 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.826 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.787+0000 7f31b8d99640 4 set_mon_vals no callback set 2024-09-10T16:30:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31c0f4f640 5 monclient: authenticate success, global_id 4304 2024-09-10T16:30:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31c0f4f640 10 monclient: _renew_subs 2024-09-10T16:30:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31c0f4f640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31c0f4f640 1 -- 172.21.15.81:0/1026013968 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f31bc142d40 con 0x7f31bc0a0950 2024-09-10T16:30:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31c0f4f640 10 monclient: _renew_subs 2024-09-10T16:30:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31c0f4f640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31c0f4f640 1 -- 172.21.15.81:0/1026013968 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f31bc0727a0 con 0x7f31bc0a0950 2024-09-10T16:30:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31c0f4f640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31c0f4f640 1 -- 172.21.15.81:0/1026013968 --> v1:172.21.15.81:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f31bc074f90 con 0x7f31bc0a0950 2024-09-10T16:30:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f31b0004020 con 0x7f31bc0a0950 2024-09-10T16:30:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f31b004ae70 con 0x7f31bc0a0950 2024-09-10T16:30:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 --> v1:172.21.15.81:6800/4086249229 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f319c047b70 con 0x7f319c043ec0 2024-09-10T16:30:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f31b004b280 con 0x7f31bc0a0950 2024-09-10T16:30:16.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31aaffd640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-10T16:30:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31bad9d640 10 monclient: get_auth_request con 0x7f319c043ec0 auth_method 0 2024-09-10T16:30:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31ba59c640 10 monclient: get_auth_request con 0x7f319c03d380 auth_method 0 2024-09-10T16:30:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.795+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 <== osd.1 v1:172.21.15.81:6800/4086249229 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f319c047b70 con 0x7f319c043ec0 2024-09-10T16:30:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.803+0000 7fa68415e640 1 -- 172.21.15.81:0/4115052396 --> v1:172.21.15.81:6808/1659450435 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa664002c80 con 0x7fa660044430 2024-09-10T16:30:16.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.803+0000 7fa6727fc640 1 -- 172.21.15.81:0/4115052396 <== osd.0 v1:172.21.15.81:6808/1659450435 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 700469118) 0x7fa664002c80 con 0x7fa660044430 2024-09-10T16:30:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.803+0000 7fa68415e640 1 -- 172.21.15.81:0/4115052396 >> v1:172.21.15.81:6808/1659450435 conn(0x7fa660044430 legacy=0x7fa660046870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.803+0000 7fa68415e640 1 -- 172.21.15.81:0/4115052396 >> v1:172.21.15.189:6812/1108603242 conn(0x7fa66003d8a0 legacy=0x7fa66003fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.803+0000 7fa68415e640 10 monclient: shutdown 2024-09-10T16:30:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.803+0000 7fa68415e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.803+0000 7fa68415e640 1 -- 172.21.15.81:0/4115052396 >> v1:172.21.15.81:6789/0 conn(0x7fa67c0a3ef0 legacy=0x7fa67c1d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.803+0000 7fa6826fb640 1 -- 172.21.15.81:0/4115052396 reap_dead start 2024-09-10T16:30:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.803+0000 7fa68415e640 1 -- 172.21.15.81:0/4115052396 shutdown_connections 2024-09-10T16:30:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.803+0000 7fa68415e640 1 -- 172.21.15.81:0/4115052396 >> 172.21.15.81:0/4115052396 conn(0x7fa67c0a94f0 msgr2=0x7fa67c09f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.803+0000 7fa68415e640 1 -- 172.21.15.81:0/4115052396 shutdown_connections 2024-09-10T16:30:16.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.803+0000 7fa68415e640 1 -- 172.21.15.81:0/4115052396 wait complete. 2024-09-10T16:30:16.830 INFO:teuthology.orchestra.run.smithi081.stdout:55834574852 2024-09-10T16:30:16.831 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T16:30:16.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 10 monclient: get_monmap_and_config 2024-09-10T16:30:16.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 10 monclient: monmap: 2024-09-10T16:30:16.835 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:16.824326+0000 2024-09-10T16:30:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:16.824326+0000 2024-09-10T16:30:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.836 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.837 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 1 Processor -- start 2024-09-10T16:30:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 1 -- start start 2024-09-10T16:30:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 10 monclient: init 2024-09-10T16:30:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 10 monclient: _add_conns ranks=[0,8,3,7,2,1,4,5,6] 2024-09-10T16:30:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 10 monclient(hunting): picked mon.noname-a con 0x7f199809b4c0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 10 monclient(hunting): picked mon.noname-e con 0x7f19980a2620 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 10 monclient(hunting): picked mon.noname-g con 0x7f199813c320 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19980a15d0 con 0x7f199809b4c0 2024-09-10T16:30:16.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19980a0d30 con 0x7f199813c320 2024-09-10T16:30:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199d3fb640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f19980a2620 0x7f199813ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35184/0 (socket says 172.21.15.81:35184) 2024-09-10T16:30:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19980a1010 con 0x7f19980a2620 2024-09-10T16:30:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199d3fb640 1 -- 172.21.15.81:0/4010329476 learned_addr learned my addr 172.21.15.81:0/4010329476 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.819+0000 7f199fe60640 10 monclient(hunting): authenticate will time out at 984.223669s 2024-09-10T16:30:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 1 -- 172.21.15.81:0/4010329476 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 12038259 0 0) 0x7f19980a1010 con 0x7f19980a2620 2024-09-10T16:30:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient(hunting): my global_id is 4247 2024-09-10T16:30:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 1 -- 172.21.15.81:0/4010329476 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1984003530 con 0x7f19980a2620 2024-09-10T16:30:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 1 -- 172.21.15.81:0/4010329476 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1861986789 0 0) 0x7f19980a15d0 con 0x7f199809b4c0 2024-09-10T16:30:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient(hunting): my global_id is 4320 2024-09-10T16:30:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 1 -- 172.21.15.81:0/4010329476 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19980a1010 con 0x7f199809b4c0 2024-09-10T16:30:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 1 -- 172.21.15.81:0/4010329476 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 245082467 0 0) 0x7f19980a0d30 con 0x7f199813c320 2024-09-10T16:30:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient(hunting): my global_id is 4224 2024-09-10T16:30:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 1 -- 172.21.15.81:0/4010329476 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19980a15d0 con 0x7f199813c320 2024-09-10T16:30:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 1 -- 172.21.15.81:0/4010329476 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 725658063 0 0) 0x7f1984003530 con 0x7f19980a2620 2024-09-10T16:30:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 1 -- 172.21.15.81:0/4010329476 >> v1:172.21.15.189:6790/0 conn(0x7f199813c320 legacy=0x7f199813e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 1 -- 172.21.15.81:0/4010329476 >> v1:172.21.15.81:6789/0 conn(0x7f199809b4c0 legacy=0x7f199809b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 1 monclient: found mon.noname-e 2024-09-10T16:30:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:30:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 1 -- 172.21.15.81:0/4010329476 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19980a12f0 con 0x7f19980a2620 2024-09-10T16:30:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 1 -- 172.21.15.81:0/4010329476 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1988001840 con 0x7f19980a2620 2024-09-10T16:30:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient: dump: 2024-09-10T16:30:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.842 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 5 monclient: authenticate success, global_id 4247 2024-09-10T16:30:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 1 -- 172.21.15.81:0/4010329476 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f19880019e0 con 0x7f19980a2620 2024-09-10T16:30:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 1 -- 172.21.15.81:0/4010329476 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1988004bf0 con 0x7f19980a2620 2024-09-10T16:30:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 4 set_mon_vals no callback set 2024-09-10T16:30:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199cbfa640 10 monclient: dump: 2024-09-10T16:30:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.844 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 10 monclient: shutdown 2024-09-10T16:30:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 1 -- 172.21.15.81:0/4010329476 >> v1:172.21.15.81:6793/0 conn(0x7f19980a2620 legacy=0x7f199813ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 1 -- 172.21.15.81:0/4010329476 shutdown_connections 2024-09-10T16:30:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 1 -- 172.21.15.81:0/4010329476 >> 172.21.15.81:0/4010329476 conn(0x7f19980a85d0 msgr2=0x7f19980a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 1 -- 172.21.15.81:0/4010329476 shutdown_connections 2024-09-10T16:30:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 1 -- 172.21.15.81:0/4010329476 wait complete. 2024-09-10T16:30:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 10 monclient: monmap: 2024-09-10T16:30:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.844 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.845 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.846 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 1 Processor -- start 2024-09-10T16:30:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 1 -- start start 2024-09-10T16:30:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 10 monclient: init 2024-09-10T16:30:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 10 monclient: _add_conns ranks=[3,5,4,8,0,7,1,6,2] 2024-09-10T16:30:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 10 monclient(hunting): picked mon.noname-g con 0x7f199809b4c0 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 10 monclient(hunting): picked mon.noname-h con 0x7f19980a2620 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 10 monclient(hunting): picked mon.noname-c con 0x7f199813c320 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1998068f80 con 0x7f199809b4c0 2024-09-10T16:30:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f199813b5f0 con 0x7f199813c320 2024-09-10T16:30:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19980a80c0 con 0x7f19980a2620 2024-09-10T16:30:16.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199fe60640 10 monclient(hunting): authenticate will time out at 984.227243s 2024-09-10T16:30:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199e3fd640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f199813c320 0x7f19981d1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34504/0 (socket says 172.21.15.81:34504) 2024-09-10T16:30:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f199e3fd640 1 -- 172.21.15.81:0/669459835 learned_addr learned my addr 172.21.15.81:0/669459835 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 247293664 0 0) 0x7f199813b5f0 con 0x7f199813c320 2024-09-10T16:30:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 10 monclient(hunting): my global_id is 4333 2024-09-10T16:30:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f197c003530 con 0x7f199813c320 2024-09-10T16:30:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2812055878 0 0) 0x7f1994001aa0 con 0x7f199809b4c0 2024-09-10T16:30:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 10 monclient(hunting): my global_id is 4233 2024-09-10T16:30:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f199813b5f0 con 0x7f199809b4c0 2024-09-10T16:30:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4207676726 0 0) 0x7f19980a80c0 con 0x7f19980a2620 2024-09-10T16:30:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 10 monclient(hunting): my global_id is 4271 2024-09-10T16:30:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1994001aa0 con 0x7f19980a2620 2024-09-10T16:30:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1306967193 0 0) 0x7f197c003530 con 0x7f199813c320 2024-09-10T16:30:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f19980a80c0 con 0x7f199813c320 2024-09-10T16:30:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1990001de0 con 0x7f199813c320 2024-09-10T16:30:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.823+0000 7f198e7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 10 monclient(hunting): dump: 2024-09-10T16:30:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.849 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.850 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2191219909 0 0) 0x7f19980a80c0 con 0x7f199813c320 2024-09-10T16:30:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 >> v1:172.21.15.189:6791/0 conn(0x7f19980a2620 legacy=0x7f19981ce6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 >> v1:172.21.15.189:6790/0 conn(0x7f199809b4c0 legacy=0x7f199809a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 1 monclient: found mon.c 2024-09-10T16:30:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19980a7d20 con 0x7f199813c320 2024-09-10T16:30:16.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f199fe60640 5 monclient: authenticate success, global_id 4333 2024-09-10T16:30:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f199fe60640 10 monclient: _renew_subs 2024-09-10T16:30:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f199fe60640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f199fe60640 1 -- 172.21.15.81:0/669459835 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f199813b030 con 0x7f199813c320 2024-09-10T16:30:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f31c0f4f640 1 -- 172.21.15.81:0/1026013968 --> v1:172.21.15.81:6800/4086249229 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f31bc09e6c0 con 0x7f319c043ec0 2024-09-10T16:30:16.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f31aaffd640 1 -- 172.21.15.81:0/1026013968 <== osd.1 v1:172.21.15.81:6800/4086249229 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 3325991546) 0x7f31bc09e6c0 con 0x7f319c043ec0 2024-09-10T16:30:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f199fe60640 10 monclient: _renew_subs 2024-09-10T16:30:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f199fe60640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f199fe60640 1 -- 172.21.15.81:0/669459835 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f199809ad90 con 0x7f199813c320 2024-09-10T16:30:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1990003c50 con 0x7f199813c320 2024-09-10T16:30:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1990004280 con 0x7f199813c320 2024-09-10T16:30:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 10 monclient: dump: 2024-09-10T16:30:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.852 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.853 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.854 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198ffff640 4 set_mon_vals no callback set 2024-09-10T16:30:16.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f199fe60640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:16.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f199fe60640 1 -- 172.21.15.81:0/669459835 --> v1:172.21.15.81:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f1980000f90 con 0x7f199813c320 2024-09-10T16:30:16.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f19900044e0 con 0x7f199813c320 2024-09-10T16:30:16.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f31c0f4f640 1 -- 172.21.15.81:0/1026013968 >> v1:172.21.15.81:6800/4086249229 conn(0x7f319c043ec0 legacy=0x7f319c046300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f31c0f4f640 1 -- 172.21.15.81:0/1026013968 >> v1:172.21.15.189:6812/1108603242 conn(0x7f319c03d380 legacy=0x7f319c03f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f199004b070 con 0x7f199813c320 2024-09-10T16:30:16.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f31c0f4f640 10 monclient: shutdown 2024-09-10T16:30:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f31c0f4f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f31c0f4f640 1 -- 172.21.15.81:0/1026013968 >> v1:172.21.15.81:6790/0 conn(0x7f31bc0a0950 legacy=0x7f31bc0717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 --> v1:172.21.15.189:6808/1206180154 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1990004800 con 0x7f197c048260 2024-09-10T16:30:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f199004b4e0 con 0x7f199813c320 2024-09-10T16:30:16.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f198e7fc640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-10T16:30:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f31bad9d640 1 -- 172.21.15.81:0/1026013968 reap_dead start 2024-09-10T16:30:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f31c0f4f640 1 -- 172.21.15.81:0/1026013968 shutdown_connections 2024-09-10T16:30:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f31c0f4f640 1 -- 172.21.15.81:0/1026013968 >> 172.21.15.81:0/1026013968 conn(0x7f31bc0a85d0 msgr2=0x7f31bc0a4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f31c0f4f640 1 -- 172.21.15.81:0/1026013968 shutdown_connections 2024-09-10T16:30:16.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f31c0f4f640 1 -- 172.21.15.81:0/1026013968 wait complete. 2024-09-10T16:30:16.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f199dbfc640 10 monclient: get_auth_request con 0x7f197c041740 auth_method 0 2024-09-10T16:30:16.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.827+0000 7f199d3fb640 10 monclient: get_auth_request con 0x7f197c048260 auth_method 0 2024-09-10T16:30:16.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 <== osd.4 v1:172.21.15.189:6808/1206180154 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f1990004800 con 0x7f197c048260 2024-09-10T16:30:16.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 10 monclient: get_monmap_and_config 2024-09-10T16:30:16.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 10 monclient: monmap: 2024-09-10T16:30:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:16.835718+0000 2024-09-10T16:30:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:16.835718+0000 2024-09-10T16:30:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.860 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.861 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 1 Processor -- start 2024-09-10T16:30:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 1 -- start start 2024-09-10T16:30:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 10 monclient: init 2024-09-10T16:30:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 10 monclient: _add_conns ranks=[3,2,4,6,7,0,5,8,1] 2024-09-10T16:30:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 10 monclient(hunting): picked mon.noname-g con 0x7f25441357d0 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 10 monclient(hunting): picked mon.noname-b con 0x7f254409f7d0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:16.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 10 monclient(hunting): picked mon.noname-c con 0x7f25440a3d30 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f25427fc640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f254409f7d0 0x7f254413a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38530/0 (socket says 172.21.15.81:38530) 2024-09-10T16:30:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f25427fc640 1 -- 172.21.15.81:0/3763857221 learned_addr learned my addr 172.21.15.81:0/3763857221 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 1 -- 172.21.15.81:0/3763857221 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f254409eb30 con 0x7f254409f7d0 2024-09-10T16:30:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 1 -- 172.21.15.81:0/3763857221 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f254409cf50 con 0x7f25441357d0 2024-09-10T16:30:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 1 -- 172.21.15.81:0/3763857221 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25441362c0 con 0x7f25440a3d30 2024-09-10T16:30:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2549344640 10 monclient(hunting): authenticate will time out at 984.235415s 2024-09-10T16:30:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 1 -- 172.21.15.81:0/3763857221 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2449637328 0 0) 0x7f254409eb30 con 0x7f254409f7d0 2024-09-10T16:30:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient(hunting): my global_id is 4313 2024-09-10T16:30:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 1 -- 172.21.15.81:0/3763857221 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f252c003530 con 0x7f254409f7d0 2024-09-10T16:30:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 1 -- 172.21.15.81:0/3763857221 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1909503688 0 0) 0x7f25441362c0 con 0x7f25440a3d30 2024-09-10T16:30:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient(hunting): my global_id is 4342 2024-09-10T16:30:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 1 -- 172.21.15.81:0/3763857221 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f254409eb30 con 0x7f25440a3d30 2024-09-10T16:30:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7ff94366f640 10 monclient: get_monmap_and_config 2024-09-10T16:30:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7ff94366f640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7ff94366f640 10 monclient: monmap: 2024-09-10T16:30:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:16.837697+0000 2024-09-10T16:30:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:16.837697+0000 2024-09-10T16:30:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.864 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.865 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.865 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 1 -- 172.21.15.81:0/3763857221 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2687109425 0 0) 0x7f252c003530 con 0x7f254409f7d0 2024-09-10T16:30:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 1 -- 172.21.15.81:0/3763857221 >> v1:172.21.15.81:6791/0 conn(0x7f25440a3d30 legacy=0x7f254413de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 1 -- 172.21.15.81:0/3763857221 >> v1:172.21.15.189:6790/0 conn(0x7f25441357d0 legacy=0x7f2544135bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 1 monclient: found mon.noname-b 2024-09-10T16:30:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 1 -- 172.21.15.81:0/3763857221 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f254406d270 con 0x7f254409f7d0 2024-09-10T16:30:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 1 -- 172.21.15.81:0/3763857221 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2538001840 con 0x7f254409f7d0 2024-09-10T16:30:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.831+0000 7f2541ffb640 10 monclient: dump: 2024-09-10T16:30:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.867 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.868 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 5 monclient: authenticate success, global_id 4313 2024-09-10T16:30:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2541ffb640 1 -- 172.21.15.81:0/3763857221 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f25380019e0 con 0x7f254409f7d0 2024-09-10T16:30:16.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2541ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2541ffb640 1 -- 172.21.15.81:0/3763857221 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2538001cd0 con 0x7f254409f7d0 2024-09-10T16:30:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2541ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2541ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2541ffb640 10 monclient: dump: 2024-09-10T16:30:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.869 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.870 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:16.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 4 set_mon_vals no callback set 2024-09-10T16:30:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 1 Processor -- start 2024-09-10T16:30:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 1 -- start start 2024-09-10T16:30:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 10 monclient: init 2024-09-10T16:30:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 10 monclient: shutdown 2024-09-10T16:30:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 1 -- 172.21.15.81:0/3763857221 >> v1:172.21.15.81:6790/0 conn(0x7f254409f7d0 legacy=0x7f254413a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 1 -- 172.21.15.81:0/3763857221 shutdown_connections 2024-09-10T16:30:16.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 1 -- 172.21.15.81:0/3763857221 >> 172.21.15.81:0/3763857221 conn(0x7f25440a8150 msgr2=0x7f25440a8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 10 monclient: _add_conns ranks=[7,6,0,8,5,2,4,3,1] 2024-09-10T16:30:16.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 10 monclient(hunting): picked mon.noname-i con 0x7ff93c09b4c0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:16.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 1 -- 172.21.15.81:0/3763857221 shutdown_connections 2024-09-10T16:30:16.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 1 -- 172.21.15.81:0/3763857221 wait complete. 2024-09-10T16:30:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 10 monclient(hunting): picked mon.noname-d con 0x7ff93c0a2620 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 10 monclient(hunting): picked mon.noname-a con 0x7ff93c13c320 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff93c0a15d0 con 0x7ff93c13c320 2024-09-10T16:30:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff93c0a0d30 con 0x7ff93c0a2620 2024-09-10T16:30:16.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff93c0a1010 con 0x7ff93c09b4c0 2024-09-10T16:30:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 10 monclient(hunting): authenticate will time out at 984.237655s 2024-09-10T16:30:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff941c0c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7ff93c13c320 0x7ff93c13e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43050/0 (socket says 172.21.15.81:43050) 2024-09-10T16:30:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94140b640 1 --1- >> v1:172.21.15.189:6792/0 conn(0x7ff93c09b4c0 0x7ff93c09b8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6792/0 says I am v1:172.21.15.81:43194/0 (socket says 172.21.15.81:43194) 2024-09-10T16:30:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff940c0a640 1 --1- 172.21.15.81:0/800544312 >> v1:172.21.15.81:6792/0 conn(0x7ff93c0a2620 0x7ff93c13ac00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56110/0 (socket says 172.21.15.81:56110) 2024-09-10T16:30:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff941c0c640 1 -- 172.21.15.81:0/800544312 learned_addr learned my addr 172.21.15.81:0/800544312 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 10 monclient: monmap: 2024-09-10T16:30:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.874 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.875 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.876 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 1 -- 172.21.15.81:0/800544312 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1029341210 0 0) 0x7ff93c0a15d0 con 0x7ff93c13c320 2024-09-10T16:30:16.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient(hunting): my global_id is 4329 2024-09-10T16:30:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 1 -- 172.21.15.81:0/800544312 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff928003530 con 0x7ff93c13c320 2024-09-10T16:30:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 1 -- 172.21.15.81:0/800544312 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 459424722 0 0) 0x7ff93c0a1010 con 0x7ff93c09b4c0 2024-09-10T16:30:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient(hunting): my global_id is 4291 2024-09-10T16:30:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 1 -- 172.21.15.81:0/800544312 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff93c0a15d0 con 0x7ff93c09b4c0 2024-09-10T16:30:16.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 1 -- 172.21.15.81:0/800544312 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 271021612 0 0) 0x7ff93c0a0d30 con 0x7ff93c0a2620 2024-09-10T16:30:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient(hunting): my global_id is 4290 2024-09-10T16:30:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 1 -- 172.21.15.81:0/800544312 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff93c0a1010 con 0x7ff93c0a2620 2024-09-10T16:30:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 1 -- 172.21.15.81:0/800544312 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2893551566 0 0) 0x7ff928003530 con 0x7ff93c13c320 2024-09-10T16:30:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 1 -- 172.21.15.81:0/800544312 >> v1:172.21.15.189:6792/0 conn(0x7ff93c09b4c0 legacy=0x7ff93c09b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 1 -- 172.21.15.81:0/800544312 >> v1:172.21.15.81:6792/0 conn(0x7ff93c0a2620 legacy=0x7ff93c13ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 1 monclient: found mon.noname-a 2024-09-10T16:30:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:30:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 1 -- 172.21.15.81:0/800544312 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93c0a12f0 con 0x7ff93c13c320 2024-09-10T16:30:16.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 1 -- 172.21.15.81:0/800544312 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff934001bc0 con 0x7ff93c13c320 2024-09-10T16:30:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 1 Processor -- start 2024-09-10T16:30:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:16.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient: dump: 2024-09-10T16:30:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.880 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.881 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.881 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 5 monclient: authenticate success, global_id 4329 2024-09-10T16:30:16.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:16.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 1 -- start start 2024-09-10T16:30:16.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 10 monclient: init 2024-09-10T16:30:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 1 -- 172.21.15.81:0/800544312 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff934001d60 con 0x7ff93c13c320 2024-09-10T16:30:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 1 -- 172.21.15.81:0/800544312 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff934004f70 con 0x7ff93c13c320 2024-09-10T16:30:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff933fff640 10 monclient: dump: 2024-09-10T16:30:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.882 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.883 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:16.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 4 set_mon_vals no callback set 2024-09-10T16:30:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 10 monclient: _add_conns ranks=[0,4,5,1,6,3,8,2,7] 2024-09-10T16:30:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 10 monclient(hunting): picked mon.noname-a con 0x7f254409f7d0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 10 monclient(hunting): picked mon.noname-c con 0x7f25440a3d30 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 10 monclient(hunting): picked mon.noname-h con 0x7f25441357d0 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2544122b70 con 0x7f254409f7d0 2024-09-10T16:30:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2544071780 con 0x7f25440a3d30 2024-09-10T16:30:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2544070de0 con 0x7f25441357d0 2024-09-10T16:30:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2549344640 10 monclient(hunting): authenticate will time out at 984.239568s 2024-09-10T16:30:16.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2542ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f254409f7d0 0x7f254406ffc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43060/0 (socket says 172.21.15.81:43060) 2024-09-10T16:30:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7f2542ffd640 1 -- 172.21.15.81:0/683634459 learned_addr learned my addr 172.21.15.81:0/683634459 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 10 monclient: shutdown 2024-09-10T16:30:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.835+0000 7ff94366f640 1 -- 172.21.15.81:0/800544312 >> v1:172.21.15.81:6789/0 conn(0x7ff93c13c320 legacy=0x7ff93c13e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 1 -- 172.21.15.81:0/800544312 shutdown_connections 2024-09-10T16:30:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 1 -- 172.21.15.81:0/800544312 >> 172.21.15.81:0/800544312 conn(0x7ff93c0a85d0 msgr2=0x7ff93c0a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 1 -- 172.21.15.81:0/800544312 shutdown_connections 2024-09-10T16:30:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 1 -- 172.21.15.81:0/800544312 wait complete. 2024-09-10T16:30:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 349456963 0 0) 0x7f2544071780 con 0x7f25440a3d30 2024-09-10T16:30:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): my global_id is 4351 2024-09-10T16:30:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2530003530 con 0x7f25440a3d30 2024-09-10T16:30:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1276345011 0 0) 0x7f2544070de0 con 0x7f25441357d0 2024-09-10T16:30:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): my global_id is 4280 2024-09-10T16:30:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2544071780 con 0x7f25441357d0 2024-09-10T16:30:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1395057249 0 0) 0x7f2544122b70 con 0x7f254409f7d0 2024-09-10T16:30:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): my global_id is 4338 2024-09-10T16:30:16.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2544070de0 con 0x7f254409f7d0 2024-09-10T16:30:16.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 10 monclient: get_monmap_and_config 2024-09-10T16:30:16.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 10 monclient: monmap: 2024-09-10T16:30:16.888 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.888 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.888 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:16.843098+0000 2024-09-10T16:30:16.888 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:16.843098+0000 2024-09-10T16:30:16.888 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.888 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.889 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.889 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 824699533 0 0) 0x7f2530003530 con 0x7f25440a3d30 2024-09-10T16:30:16.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2544122b70 con 0x7f25440a3d30 2024-09-10T16:30:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2538001780 con 0x7f25440a3d30 2024-09-10T16:30:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): dump: 2024-09-10T16:30:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.891 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.892 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2753945977 0 0) 0x7f2544071780 con 0x7f25441357d0 2024-09-10T16:30:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2530003530 con 0x7f25441357d0 2024-09-10T16:30:16.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f253c0018e0 con 0x7f25441357d0 2024-09-10T16:30:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-10T16:30:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient(hunting): dump: 2024-09-10T16:30:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.893 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.894 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 740465235 0 0) 0x7f2544122b70 con 0x7f25440a3d30 2024-09-10T16:30:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 >> v1:172.21.15.189:6791/0 conn(0x7f25441357d0 legacy=0x7f25441d5ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 >> v1:172.21.15.81:6789/0 conn(0x7f254409f7d0 legacy=0x7f254406ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 monclient: found mon.c 2024-09-10T16:30:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2544072640 con 0x7f25440a3d30 2024-09-10T16:30:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f2549344640 5 monclient: authenticate success, global_id 4351 2024-09-10T16:30:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f2549344640 10 monclient: _renew_subs 2024-09-10T16:30:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f2549344640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f2549344640 1 -- 172.21.15.81:0/683634459 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f25441239e0 con 0x7f25440a3d30 2024-09-10T16:30:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f2549344640 10 monclient: _renew_subs 2024-09-10T16:30:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f2549344640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:16.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f2549344640 1 -- 172.21.15.81:0/683634459 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f25441bdda0 con 0x7f25440a3d30 2024-09-10T16:30:16.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 10 monclient: monmap: 2024-09-10T16:30:16.949 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.949 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:16.949 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:16.949 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:16.949 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.949 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:16.949 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.950 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.950 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.950 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.950 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.950 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.950 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.950 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.950 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.950 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 1 Processor -- start 2024-09-10T16:30:16.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 1 -- start start 2024-09-10T16:30:16.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 10 monclient: init 2024-09-10T16:30:16.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 1 Processor -- start 2024-09-10T16:30:16.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 10 monclient: _add_conns ranks=[5,3,7,2,8,4,6,1,0] 2024-09-10T16:30:16.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 10 monclient(hunting): picked mon.noname-h con 0x7ff93c09b4c0 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:16.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 10 monclient(hunting): picked mon.noname-g con 0x7ff93c0a2620 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:16.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 10 monclient(hunting): picked mon.noname-i con 0x7ff93c13c320 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:16.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff93c1365a0 con 0x7ff93c0a2620 2024-09-10T16:30:16.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff93c071ef0 con 0x7ff93c09b4c0 2024-09-10T16:30:16.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff93c0a7210 con 0x7ff93c13c320 2024-09-10T16:30:16.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94366f640 10 monclient(hunting): authenticate will time out at 984.242521s 2024-09-10T16:30:16.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 1 -- start start 2024-09-10T16:30:16.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 10 monclient: init 2024-09-10T16:30:16.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f2549344640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:16.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f2549344640 1 -- 172.21.15.81:0/683634459 --> v1:172.21.15.81:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f254406d6f0 con 0x7f25440a3d30 2024-09-10T16:30:16.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94140b640 1 --1- >> v1:172.21.15.189:6791/0 conn(0x7ff93c09b4c0 0x7ff93c0710d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6791/0 says I am v1:172.21.15.81:55130/0 (socket says 172.21.15.81:55130) 2024-09-10T16:30:16.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff94140b640 1 -- 172.21.15.81:0/3445189947 learned_addr learned my addr 172.21.15.81:0/3445189947 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f25380019c0 con 0x7f25440a3d30 2024-09-10T16:30:16.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2538004de0 con 0x7f25440a3d30 2024-09-10T16:30:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient: dump: 2024-09-10T16:30:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.954 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.955 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 10 monclient: _add_conns ranks=[5,2,7,1,3,0,6,8,4] 2024-09-10T16:30:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 10 monclient(hunting): picked mon.noname-h con 0x7f0df809ca10 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3608501660 0 0) 0x7ff93c0a1010 con 0x7ff93c0a2620 2024-09-10T16:30:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 10 monclient(hunting): my global_id is 4251 2024-09-10T16:30:16.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff920003560 con 0x7ff93c0a2620 2024-09-10T16:30:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 10 monclient(hunting): picked mon.noname-b con 0x7f0df80a56e0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0df6ffd640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f0df80a56e0 0x7f0df813df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38538/0 (socket says 172.21.15.81:38538) 2024-09-10T16:30:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0df6ffd640 1 -- 172.21.15.81:0/3111471010 learned_addr learned my addr 172.21.15.81:0/3111471010 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 10 monclient(hunting): picked mon.noname-i con 0x7f0df80a5b00 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 1 -- 172.21.15.81:0/3111471010 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df81362b0 con 0x7f0df80a56e0 2024-09-10T16:30:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f2538005040 con 0x7f25440a3d30 2024-09-10T16:30:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f25417fa640 4 set_mon_vals no callback set 2024-09-10T16:30:16.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f253804ad10 con 0x7f25440a3d30 2024-09-10T16:30:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 1 -- 172.21.15.81:0/3111471010 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df80a80b0 con 0x7f0df809ca10 2024-09-10T16:30:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 1 -- 172.21.15.81:0/3111471010 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df809de70 con 0x7f0df80a5b00 2024-09-10T16:30:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0dfe13a640 10 monclient(hunting): authenticate will time out at 984.243660s 2024-09-10T16:30:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 --> v1:172.21.15.81:6804/2595021275 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25300482f0 con 0x7f2530044640 2024-09-10T16:30:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f253804b0c0 con 0x7f25440a3d30 2024-09-10T16:30:16.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f252b7fe640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-10T16:30:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1443164152 0 0) 0x7ff93c0a7210 con 0x7ff93c13c320 2024-09-10T16:30:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 10 monclient(hunting): my global_id is 4300 2024-09-10T16:30:16.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff93c0a1010 con 0x7ff93c13c320 2024-09-10T16:30:16.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f2542ffd640 10 monclient: get_auth_request con 0x7f253003da40 auth_method 0 2024-09-10T16:30:16.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1547719878 0 0) 0x7ff93c071ef0 con 0x7ff93c09b4c0 2024-09-10T16:30:16.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 10 monclient(hunting): my global_id is 4289 2024-09-10T16:30:16.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f25437fe640 10 monclient: get_auth_request con 0x7f2530044640 auth_method 0 2024-09-10T16:30:16.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff93c0a7210 con 0x7ff93c09b4c0 2024-09-10T16:30:16.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0df67fc640 1 -- 172.21.15.81:0/3111471010 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 390787580 0 0) 0x7f0df81362b0 con 0x7f0df80a56e0 2024-09-10T16:30:16.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0df67fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0df67fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0df67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.839+0000 7f0df67fc640 10 monclient(hunting): my global_id is 4322 2024-09-10T16:30:16.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 1 -- 172.21.15.81:0/3111471010 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0de0003530 con 0x7f0df80a56e0 2024-09-10T16:30:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1353418262 0 0) 0x7ff920003560 con 0x7ff93c0a2620 2024-09-10T16:30:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff93c071ef0 con 0x7ff93c0a2620 2024-09-10T16:30:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff92c001a20 con 0x7ff93c0a2620 2024-09-10T16:30:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-10T16:30:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient(hunting): dump: 2024-09-10T16:30:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.963 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.964 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:16.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 1 -- 172.21.15.81:0/3111471010 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3971452219 0 0) 0x7f0de0003530 con 0x7f0df80a56e0 2024-09-10T16:30:16.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 1 -- 172.21.15.81:0/3111471010 >> v1:172.21.15.189:6792/0 conn(0x7f0df80a5b00 legacy=0x7f0df8141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 368378016 0 0) 0x7ff93c0a1010 con 0x7ff93c13c320 2024-09-10T16:30:16.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 1 -- 172.21.15.81:0/3111471010 >> v1:172.21.15.189:6791/0 conn(0x7f0df809ca10 legacy=0x7f0df8135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 1 monclient: found mon.noname-b 2024-09-10T16:30:16.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff920003560 con 0x7ff93c13c320 2024-09-10T16:30:16.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:30:16.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 1 -- 172.21.15.81:0/3111471010 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df809e150 con 0x7f0df80a56e0 2024-09-10T16:30:16.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 1 -- 172.21.15.81:0/3111471010 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0dec001840 con 0x7f0df80a56e0 2024-09-10T16:30:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 10 monclient: dump: 2024-09-10T16:30:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.967 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.968 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff934001a80 con 0x7ff93c13c320 2024-09-10T16:30:16.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-10T16:30:16.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient(hunting): dump: 2024-09-10T16:30:16.969 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.969 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.969 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.969 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.969 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.969 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.969 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.969 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.969 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.970 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2280337452 0 0) 0x7ff93c0a7210 con 0x7ff93c09b4c0 2024-09-10T16:30:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff93c0a1010 con 0x7ff93c09b4c0 2024-09-10T16:30:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff938001aa0 con 0x7ff93c09b4c0 2024-09-10T16:30:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-10T16:30:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient(hunting): dump: 2024-09-10T16:30:16.970 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.971 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0dfe13a640 5 monclient: authenticate success, global_id 4322 2024-09-10T16:30:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0dfe13a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 1 -- 172.21.15.81:0/3111471010 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0dec001a60 con 0x7f0df80a56e0 2024-09-10T16:30:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0dfe13a640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 1 -- 172.21.15.81:0/3111471010 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0dec004bf0 con 0x7f0df80a56e0 2024-09-10T16:30:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0dfe13a640 4 set_mon_vals no callback set 2024-09-10T16:30:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0df67fc640 10 monclient: dump: 2024-09-10T16:30:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.973 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.974 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.974 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3352784728 0 0) 0x7ff93c071ef0 con 0x7ff93c0a2620 2024-09-10T16:30:16.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 >> v1:172.21.15.189:6792/0 conn(0x7ff93c13c320 legacy=0x7ff93c1da0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 >> v1:172.21.15.189:6791/0 conn(0x7ff93c09b4c0 legacy=0x7ff93c0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 monclient: found mon.g 2024-09-10T16:30:16.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:30:16.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93c136270 con 0x7ff93c0a2620 2024-09-10T16:30:16.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff94366f640 5 monclient: authenticate success, global_id 4251 2024-09-10T16:30:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff94366f640 10 monclient: _renew_subs 2024-09-10T16:30:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff94366f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:30:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff94366f640 1 -- 172.21.15.81:0/3445189947 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff93c072a20 con 0x7ff93c0a2620 2024-09-10T16:30:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff94366f640 10 monclient: _renew_subs 2024-09-10T16:30:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff94366f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:30:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff94366f640 1 -- 172.21.15.81:0/3445189947 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7ff93c0735c0 con 0x7ff93c0a2620 2024-09-10T16:30:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.3 v1:172.21.15.189:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff92c001d40 con 0x7ff93c0a2620 2024-09-10T16:30:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.3 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff92c004de0 con 0x7ff93c0a2620 2024-09-10T16:30:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:30:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff9337fe640 4 set_mon_vals no callback set 2024-09-10T16:30:16.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient: dump: 2024-09-10T16:30:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.977 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.978 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff94366f640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:30:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff94366f640 1 -- 172.21.15.81:0/3445189947 --> v1:172.21.15.189:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7ff91c000f90 con 0x7ff93c0a2620 2024-09-10T16:30:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== osd.2 v1:172.21.15.81:6804/2595021275 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f25300482f0 con 0x7f2530044640 2024-09-10T16:30:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0dfe13a640 10 monclient: shutdown 2024-09-10T16:30:16.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0dfe13a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0dfe13a640 1 -- 172.21.15.81:0/3111471010 >> v1:172.21.15.81:6790/0 conn(0x7f0df80a56e0 legacy=0x7f0df813df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0dfe13a640 1 -- 172.21.15.81:0/3111471010 shutdown_connections 2024-09-10T16:30:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0dfe13a640 1 -- 172.21.15.81:0/3111471010 >> 172.21.15.81:0/3111471010 conn(0x7f0df806dc90 msgr2=0x7f0df80ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0dfe13a640 1 -- 172.21.15.81:0/3111471010 shutdown_connections 2024-09-10T16:30:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7f0dfe13a640 1 -- 172.21.15.81:0/3111471010 wait complete. 2024-09-10T16:30:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.3 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7ff92c004f80 con 0x7ff93c0a2620 2024-09-10T16:30:16.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.3 v1:172.21.15.189:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7ff92c04acc0 con 0x7ff93c0a2620 2024-09-10T16:30:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 --> v1:172.21.15.189:6804/3461775318 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff9200482a0 con 0x7ff9200445f0 2024-09-10T16:30:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== mon.3 v1:172.21.15.189:6790/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7ff92c04b0a0 con 0x7ff93c0a2620 2024-09-10T16:30:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff931ffb640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-10T16:30:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff94140b640 10 monclient: get_auth_request con 0x7ff92003da40 auth_method 0 2024-09-10T16:30:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.843+0000 7ff941c0c640 10 monclient: get_auth_request con 0x7ff9200445f0 auth_method 0 2024-09-10T16:30:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 10 monclient: build_initial_monmap 2024-09-10T16:30:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 10 monclient: monmap: 2024-09-10T16:30:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:16.981 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:16.982 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 1 Processor -- start 2024-09-10T16:30:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 1 -- start start 2024-09-10T16:30:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 10 monclient: init 2024-09-10T16:30:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 10 monclient: _add_conns ranks=[0,2,5,3,1,7,8,6,4] 2024-09-10T16:30:16.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== osd.3 v1:172.21.15.189:6804/3461775318 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7ff9200482a0 con 0x7ff9200445f0 2024-09-10T16:30:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 10 monclient(hunting): picked mon.noname-a con 0x7f0df809ca10 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 10 monclient(hunting): picked mon.noname-b con 0x7f0df80a56e0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 10 monclient(hunting): picked mon.noname-h con 0x7f0df80a5b00 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df8131b80 con 0x7f0df809ca10 2024-09-10T16:30:16.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0df77fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0df809ca10 0x7f0df812e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43068/0 (socket says 172.21.15.81:43068) 2024-09-10T16:30:16.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0df77fe640 1 -- 172.21.15.81:0/4127185042 learned_addr learned my addr 172.21.15.81:0/4127185042 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:16.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 1 -- 172.21.15.81:0/4127185042 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df8130560 con 0x7f0df80a56e0 2024-09-10T16:30:16.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 1 -- 172.21.15.81:0/4127185042 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df80aa4c0 con 0x7f0df80a5b00 2024-09-10T16:30:16.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:16.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 10 monclient(hunting): authenticate will time out at 984.250262s 2024-09-10T16:30:16.985 INFO:teuthology.orchestra.run.smithi081.stdout:47244640262 2024-09-10T16:30:16.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T16:30:16.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3892976408 0 0) 0x7f0df8131b80 con 0x7f0df809ca10 2024-09-10T16:30:16.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient(hunting): my global_id is 4347 2024-09-10T16:30:16.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0de4003560 con 0x7f0df809ca10 2024-09-10T16:30:16.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 618933560 0 0) 0x7f0de4003560 con 0x7f0df809ca10 2024-09-10T16:30:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0df8131b80 con 0x7f0df809ca10 2024-09-10T16:30:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0de8001f00 con 0x7f0df809ca10 2024-09-10T16:30:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient(hunting): dump: 2024-09-10T16:30:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.988 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.989 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2741620921 0 0) 0x7f0df80aa4c0 con 0x7f0df80a5b00 2024-09-10T16:30:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient(hunting): my global_id is 4307 2024-09-10T16:30:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0de4003560 con 0x7f0df80a5b00 2024-09-10T16:30:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3593789986 0 0) 0x7f0df8131b80 con 0x7f0df809ca10 2024-09-10T16:30:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 >> v1:172.21.15.189:6791/0 conn(0x7f0df80a5b00 legacy=0x7f0df81d5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 >> v1:172.21.15.81:6790/0 conn(0x7f0df80a56e0 legacy=0x7f0df812f090 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:30:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient: _finish_hunting 0 2024-09-10T16:30:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 1 monclient: found mon.a 2024-09-10T16:30:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df80aa9d0 con 0x7f0df809ca10 2024-09-10T16:30:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient: _finish_auth 0 2024-09-10T16:30:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient: _check_auth_tickets 2024-09-10T16:30:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 5 monclient: authenticate success, global_id 4347 2024-09-10T16:30:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 10 monclient: _renew_subs 2024-09-10T16:30:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 1 -- 172.21.15.81:0/4127185042 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0df8132140 con 0x7f0df809ca10 2024-09-10T16:30:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 10 monclient: _renew_subs 2024-09-10T16:30:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0dfe13a640 1 -- 172.21.15.81:0/4127185042 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0df8132840 con 0x7f0df809ca10 2024-09-10T16:30:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0de8003c50 con 0x7f0df809ca10 2024-09-10T16:30:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0de8004200 con 0x7f0df809ca10 2024-09-10T16:30:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0ddffff640 10 monclient: dump: 2024-09-10T16:30:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:16.991 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:16.992 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.992 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:16.992 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:16.992 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:16.992 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:16.992 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:16.992 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:16.992 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:16.992 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:16.992 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:16.992 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:16.992 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:16.992 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:16.992 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.847+0000 7f0df5ffb640 4 set_mon_vals no callback set 2024-09-10T16:30:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f0dfe13a640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f0dfe13a640 1 -- 172.21.15.81:0/4127185042 --> v1:172.21.15.81:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f0dd8000f90 con 0x7f0df809ca10 2024-09-10T16:30:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f0de8004420 con 0x7f0df809ca10 2024-09-10T16:30:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f0de804b290 con 0x7f0df809ca10 2024-09-10T16:30:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 --> v1:172.21.15.189:6800/1814191784 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0de40478c0 con 0x7f0de4043c10 2024-09-10T16:30:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_get_version_reply(handle=1 version=20) ==== 24+0+0 (unknown 592526333 0 0) 0x7f0de804b6d0 con 0x7f0df809ca10 2024-09-10T16:30:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f0ddffff640 10 monclient: handle_get_version_reply finishing 1 version 20 2024-09-10T16:30:16.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f199fe60640 1 -- 172.21.15.81:0/669459835 --> v1:172.21.15.189:6808/1206180154 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1980002c80 con 0x7f197c048260 2024-09-10T16:30:16.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f0df6ffd640 10 monclient: get_auth_request con 0x7f0de403d030 auth_method 0 2024-09-10T16:30:16.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f0df7fff640 10 monclient: get_auth_request con 0x7f0de4043c10 auth_method 0 2024-09-10T16:30:16.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f198e7fc640 1 -- 172.21.15.81:0/669459835 <== osd.4 v1:172.21.15.189:6808/1206180154 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 700469118) 0x7f1980002c80 con 0x7f197c048260 2024-09-10T16:30:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f199fe60640 1 -- 172.21.15.81:0/669459835 >> v1:172.21.15.189:6808/1206180154 conn(0x7f197c048260 legacy=0x7f197c04a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f199fe60640 1 -- 172.21.15.81:0/669459835 >> v1:172.21.15.189:6812/1108603242 conn(0x7f197c041740 legacy=0x7f197c043be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f199fe60640 10 monclient: shutdown 2024-09-10T16:30:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f199fe60640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f199fe60640 1 -- 172.21.15.81:0/669459835 >> v1:172.21.15.81:6791/0 conn(0x7f199813c320 legacy=0x7f19981d1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f199e3fd640 1 -- 172.21.15.81:0/669459835 reap_dead start 2024-09-10T16:30:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f199fe60640 1 -- 172.21.15.81:0/669459835 shutdown_connections 2024-09-10T16:30:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f199fe60640 1 -- 172.21.15.81:0/669459835 >> 172.21.15.81:0/669459835 conn(0x7f19980a85d0 msgr2=0x7f199809e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f199fe60640 1 -- 172.21.15.81:0/669459835 shutdown_connections 2024-09-10T16:30:16.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.851+0000 7f199fe60640 1 -- 172.21.15.81:0/669459835 wait complete. 2024-09-10T16:30:16.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.855+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 <== osd.5 v1:172.21.15.189:6800/1814191784 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f0de40478c0 con 0x7f0de4043c10 2024-09-10T16:30:16.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.863+0000 7f2549344640 1 -- 172.21.15.81:0/683634459 --> v1:172.21.15.81:6804/2595021275 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f25440a2d20 con 0x7f2530044640 2024-09-10T16:30:16.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.863+0000 7f252b7fe640 1 -- 172.21.15.81:0/683634459 <== osd.2 v1:172.21.15.81:6804/2595021275 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 982563978) 0x7f25440a2d20 con 0x7f2530044640 2024-09-10T16:30:16.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.863+0000 7ff94366f640 1 -- 172.21.15.81:0/3445189947 --> v1:172.21.15.189:6804/3461775318 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff91c002c80 con 0x7ff9200445f0 2024-09-10T16:30:16.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.863+0000 7f2549344640 1 -- 172.21.15.81:0/683634459 >> v1:172.21.15.81:6804/2595021275 conn(0x7f2530044640 legacy=0x7f2530046a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.863+0000 7f2549344640 1 -- 172.21.15.81:0/683634459 >> v1:172.21.15.189:6812/1108603242 conn(0x7f253003da40 legacy=0x7f253003ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.863+0000 7f2549344640 10 monclient: shutdown 2024-09-10T16:30:16.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.863+0000 7f2549344640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.863+0000 7f2549344640 1 -- 172.21.15.81:0/683634459 >> v1:172.21.15.81:6791/0 conn(0x7f25440a3d30 legacy=0x7f25440706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.863+0000 7f25437fe640 1 -- 172.21.15.81:0/683634459 reap_dead start 2024-09-10T16:30:16.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.863+0000 7f2549344640 1 -- 172.21.15.81:0/683634459 shutdown_connections 2024-09-10T16:30:16.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.863+0000 7f2549344640 1 -- 172.21.15.81:0/683634459 >> 172.21.15.81:0/683634459 conn(0x7f25440a8150 msgr2=0x7f2544134bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:16.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.863+0000 7f2549344640 1 -- 172.21.15.81:0/683634459 shutdown_connections 2024-09-10T16:30:16.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.863+0000 7f2549344640 1 -- 172.21.15.81:0/683634459 wait complete. 2024-09-10T16:30:16.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.863+0000 7ff931ffb640 1 -- 172.21.15.81:0/3445189947 <== osd.3 v1:172.21.15.189:6804/3461775318 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 700469118) 0x7ff91c002c80 con 0x7ff9200445f0 2024-09-10T16:30:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.867+0000 7ff94366f640 1 -- 172.21.15.81:0/3445189947 >> v1:172.21.15.189:6804/3461775318 conn(0x7ff9200445f0 legacy=0x7ff920046a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.867+0000 7ff94366f640 1 -- 172.21.15.81:0/3445189947 >> v1:172.21.15.189:6812/1108603242 conn(0x7ff92003da40 legacy=0x7ff92003ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.867+0000 7ff94366f640 10 monclient: shutdown 2024-09-10T16:30:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.867+0000 7ff94366f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.867+0000 7ff94366f640 1 -- 172.21.15.81:0/3445189947 >> v1:172.21.15.189:6790/0 conn(0x7ff93c0a2620 legacy=0x7ff93c0717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.867+0000 7ff941c0c640 1 -- 172.21.15.81:0/3445189947 reap_dead start 2024-09-10T16:30:16.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.867+0000 7ff94366f640 1 -- 172.21.15.81:0/3445189947 shutdown_connections 2024-09-10T16:30:17.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.867+0000 7ff94366f640 1 -- 172.21.15.81:0/3445189947 >> 172.21.15.81:0/3445189947 conn(0x7ff93c0a85d0 msgr2=0x7ff93c13bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:17.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.867+0000 7ff94366f640 1 -- 172.21.15.81:0/3445189947 shutdown_connections 2024-09-10T16:30:17.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.867+0000 7ff94366f640 1 -- 172.21.15.81:0/3445189947 wait complete. 2024-09-10T16:30:17.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.867+0000 7f0dfe13a640 1 -- 172.21.15.81:0/4127185042 --> v1:172.21.15.189:6800/1814191784 -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0dd8002c80 con 0x7f0de4043c10 2024-09-10T16:30:17.000 INFO:teuthology.orchestra.run.smithi081.stdout:55834574852 2024-09-10T16:30:17.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T16:30:17.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.871+0000 7f0ddffff640 1 -- 172.21.15.81:0/4127185042 <== osd.5 v1:172.21.15.189:6800/1814191784 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (unknown 0 0 258058390) 0x7f0dd8002c80 con 0x7f0de4043c10 2024-09-10T16:30:17.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.871+0000 7f0dfe13a640 1 -- 172.21.15.81:0/4127185042 >> v1:172.21.15.189:6800/1814191784 conn(0x7f0de4043c10 legacy=0x7f0de4046050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.871+0000 7f0dfe13a640 1 -- 172.21.15.81:0/4127185042 >> v1:172.21.15.189:6812/1108603242 conn(0x7f0de403d030 legacy=0x7f0de403f4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.871+0000 7f0dfe13a640 10 monclient: shutdown 2024-09-10T16:30:17.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.871+0000 7f0dfe13a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:17.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.871+0000 7f0dfe13a640 1 -- 172.21.15.81:0/4127185042 >> v1:172.21.15.81:6789/0 conn(0x7f0df809ca10 legacy=0x7f0df812e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.871+0000 7f0df7fff640 1 -- 172.21.15.81:0/4127185042 reap_dead start 2024-09-10T16:30:17.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.871+0000 7f0dfe13a640 1 -- 172.21.15.81:0/4127185042 shutdown_connections 2024-09-10T16:30:17.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.871+0000 7f0dfe13a640 1 -- 172.21.15.81:0/4127185042 >> 172.21.15.81:0/4127185042 conn(0x7f0df806dc90 msgr2=0x7f0df812c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:17.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.871+0000 7f0dfe13a640 1 -- 172.21.15.81:0/4127185042 shutdown_connections 2024-09-10T16:30:17.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.871+0000 7f0dfe13a640 1 -- 172.21.15.81:0/4127185042 wait complete. 2024-09-10T16:30:17.003 INFO:teuthology.orchestra.run.smithi081.stdout:55834574851 2024-09-10T16:30:17.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T16:30:17.004 INFO:teuthology.orchestra.run.smithi081.stdout:55834574852 2024-09-10T16:30:17.005 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T16:30:17.005 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2024-09-10T16:30:17.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T16:30:17.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient: get_monmap_and_config 2024-09-10T16:30:17.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient: build_initial_monmap 2024-09-10T16:30:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient: monmap: 2024-09-10T16:30:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:16.966211+0000 2024-09-10T16:30:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:16.966211+0000 2024-09-10T16:30:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:17.011 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:17.012 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 1 Processor -- start 2024-09-10T16:30:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 1 -- start start 2024-09-10T16:30:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient: init 2024-09-10T16:30:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient: _add_conns ranks=[8,2,0,3,4,1,7,5,6] 2024-09-10T16:30:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient(hunting): picked mon.noname-e con 0x7f269809ca10 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient(hunting): picked mon.noname-b con 0x7f26980a56e0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient(hunting): picked mon.noname-a con 0x7f26980a5b00 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26981362b0 con 0x7f26980a5b00 2024-09-10T16:30:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26980a80b0 con 0x7f26980a56e0 2024-09-10T16:30:17.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f269809de70 con 0x7f269809ca10 2024-09-10T16:30:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient(hunting): authenticate will time out at 984.365298s 2024-09-10T16:30:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d93e640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f26980a56e0 0x7f269813df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38548/0 (socket says 172.21.15.81:38548) 2024-09-10T16:30:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d93e640 1 -- 172.21.15.81:0/910276743 learned_addr learned my addr 172.21.15.81:0/910276743 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269e940640 1 --1- 172.21.15.81:0/910276743 >> v1:172.21.15.81:6789/0 conn(0x7f26980a5b00 0x7f2698141650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43080/0 (socket says 172.21.15.81:43080) 2024-09-10T16:30:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269e13f640 1 --1- 172.21.15.81:0/910276743 >> v1:172.21.15.81:6793/0 conn(0x7f269809ca10 0x7f2698135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35188/0 (socket says 172.21.15.81:35188) 2024-09-10T16:30:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 1 -- 172.21.15.81:0/910276743 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258837163 0 0) 0x7f26981362b0 con 0x7f26980a5b00 2024-09-10T16:30:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient(hunting): my global_id is 4356 2024-09-10T16:30:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 1 -- 172.21.15.81:0/910276743 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2680003530 con 0x7f26980a5b00 2024-09-10T16:30:17.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 1 -- 172.21.15.81:0/910276743 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1924741212 0 0) 0x7f269809de70 con 0x7f269809ca10 2024-09-10T16:30:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient(hunting): my global_id is 4256 2024-09-10T16:30:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 1 -- 172.21.15.81:0/910276743 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f26981362b0 con 0x7f269809ca10 2024-09-10T16:30:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 1 -- 172.21.15.81:0/910276743 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3599472342 0 0) 0x7f26980a80b0 con 0x7f26980a56e0 2024-09-10T16:30:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient(hunting): my global_id is 4331 2024-09-10T16:30:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 1 -- 172.21.15.81:0/910276743 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f269809de70 con 0x7f26980a56e0 2024-09-10T16:30:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 1 -- 172.21.15.81:0/910276743 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3271060815 0 0) 0x7f269809de70 con 0x7f26980a56e0 2024-09-10T16:30:17.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 1 -- 172.21.15.81:0/910276743 >> v1:172.21.15.81:6793/0 conn(0x7f269809ca10 legacy=0x7f2698135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 1 -- 172.21.15.81:0/910276743 >> v1:172.21.15.81:6789/0 conn(0x7f26980a5b00 legacy=0x7f2698141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient: _finish_hunting 0 2024-09-10T16:30:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 1 monclient: found mon.noname-b 2024-09-10T16:30:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:30:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 1 -- 172.21.15.81:0/910276743 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f269809e150 con 0x7f26980a56e0 2024-09-10T16:30:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient: _finish_auth 0 2024-09-10T16:30:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient: _check_auth_tickets 2024-09-10T16:30:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 1 -- 172.21.15.81:0/910276743 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f268c0016e0 con 0x7f26980a56e0 2024-09-10T16:30:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient: dump: 2024-09-10T16:30:17.015 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.016 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.017 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 5 monclient: authenticate success, global_id 4331 2024-09-10T16:30:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 1 -- 172.21.15.81:0/910276743 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f268c001880 con 0x7f26980a56e0 2024-09-10T16:30:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 4 set_mon_vals no callback set 2024-09-10T16:30:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 1 -- 172.21.15.81:0/910276743 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f268c0048b0 con 0x7f26980a56e0 2024-09-10T16:30:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f269d13d640 10 monclient: dump: 2024-09-10T16:30:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.017 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.018 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.019 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient: shutdown 2024-09-10T16:30:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 1 -- 172.21.15.81:0/910276743 >> v1:172.21.15.81:6790/0 conn(0x7f26980a56e0 legacy=0x7f269813df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 1 -- 172.21.15.81:0/910276743 shutdown_connections 2024-09-10T16:30:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 1 -- 172.21.15.81:0/910276743 >> 172.21.15.81:0/910276743 conn(0x7f269806dc90 msgr2=0x7f26980ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 1 -- 172.21.15.81:0/910276743 shutdown_connections 2024-09-10T16:30:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 1 -- 172.21.15.81:0/910276743 wait complete. 2024-09-10T16:30:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient: build_initial_monmap 2024-09-10T16:30:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient: monmap: 2024-09-10T16:30:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:17.019 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:17.020 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:17.021 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 1 Processor -- start 2024-09-10T16:30:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 1 -- start start 2024-09-10T16:30:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.963+0000 7f26a03a3640 10 monclient: init 2024-09-10T16:30:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 10 monclient: _add_conns ranks=[3,6,1,0,4,8,5,7,2] 2024-09-10T16:30:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 10 monclient(hunting): picked mon.noname-g con 0x7f269809ca10 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 10 monclient(hunting): picked mon.noname-d con 0x7f26980a56e0 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 10 monclient(hunting): picked mon.noname-f con 0x7f26980a5b00 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26980a9dc0 con 0x7f26980a5b00 2024-09-10T16:30:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2698135090 con 0x7f269809ca10 2024-09-10T16:30:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26980a54c0 con 0x7f26980a56e0 2024-09-10T16:30:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:17.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 10 monclient(hunting): authenticate will time out at 984.368196s 2024-09-10T16:30:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f269d93e640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f26980a56e0 0x7f26981cdcb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56126/0 (socket says 172.21.15.81:56126) 2024-09-10T16:30:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f269d93e640 1 -- 172.21.15.81:0/841648675 learned_addr learned my addr 172.21.15.81:0/841648675 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3384283780 0 0) 0x7f26980a54c0 con 0x7f26980a56e0 2024-09-10T16:30:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient(hunting): my global_id is 4299 2024-09-10T16:30:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2684003530 con 0x7f26980a56e0 2024-09-10T16:30:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1890985015 0 0) 0x7f2684003530 con 0x7f26980a56e0 2024-09-10T16:30:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f26980a54c0 con 0x7f26980a56e0 2024-09-10T16:30:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f268c0016a0 con 0x7f26980a56e0 2024-09-10T16:30:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:17.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.023 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.024 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.024 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.024 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:17.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3660605102 0 0) 0x7f26980a54c0 con 0x7f26980a56e0 2024-09-10T16:30:17.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 >> v1:172.21.15.189:6790/0 conn(0x7f269809ca10 legacy=0x7f26981cd5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 >> v1:172.21.15.189:6789/0 conn(0x7f26980a5b00 legacy=0x7f26981d56c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:17.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 1 monclient: found mon.d 2024-09-10T16:30:17.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:17.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:17.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2698131c70 con 0x7f26980a56e0 2024-09-10T16:30:17.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:17.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:17.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:17.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 5 monclient: authenticate success, global_id 4299 2024-09-10T16:30:17.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 10 monclient: _renew_subs 2024-09-10T16:30:17.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:17.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 1 -- 172.21.15.81:0/841648675 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f269809f270 con 0x7f26980a56e0 2024-09-10T16:30:17.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 10 monclient: _renew_subs 2024-09-10T16:30:17.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:17.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 1 -- 172.21.15.81:0/841648675 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f26981327d0 con 0x7f26980a56e0 2024-09-10T16:30:17.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f268c001840 con 0x7f26980a56e0 2024-09-10T16:30:17.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:17.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f268c005160 con 0x7f26980a56e0 2024-09-10T16:30:17.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f269c93c640 4 set_mon_vals no callback set 2024-09-10T16:30:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 10 monclient: dump: 2024-09-10T16:30:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.026 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.027 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.027 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.027 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.027 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:17.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f26a03a3640 1 -- 172.21.15.81:0/841648675 --> v1:172.21.15.81:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2678005090 con 0x7f26980a56e0 2024-09-10T16:30:17.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f268c011070 con 0x7f26980a56e0 2024-09-10T16:30:17.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f268c04b040 con 0x7f26980a56e0 2024-09-10T16:30:17.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.966+0000 7f269e13f640 10 monclient: get_auth_request con 0x7f268403cff0 auth_method 0 2024-09-10T16:30:17.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.970+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 <== mon.6 v1:172.21.15.81:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f268c016ed0 con 0x7f26980a56e0 2024-09-10T16:30:17.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.970+0000 7f2696ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:16.970+0000 7f2696ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.138+0000 7f3574caf640 10 monclient: get_monmap_and_config 2024-09-10T16:30:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.138+0000 7f3574caf640 10 monclient: build_initial_monmap 2024-09-10T16:30:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.138+0000 7f3574caf640 10 monclient: monmap: 2024-09-10T16:30:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:17.144805+0000 2024-09-10T16:30:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:17.144805+0000 2024-09-10T16:30:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:17.144 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.138+0000 7f3574caf640 1 Processor -- start 2024-09-10T16:30:17.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.138+0000 7f3574caf640 1 -- start start 2024-09-10T16:30:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.138+0000 7f3574caf640 10 monclient: init 2024-09-10T16:30:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 10 monclient: _add_conns ranks=[6,1,0,7,4,8,5,3,2] 2024-09-10T16:30:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 10 monclient(hunting): picked mon.noname-d con 0x7f357009ca10 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 10 monclient(hunting): picked mon.noname-f con 0x7f35700a56e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 10 monclient(hunting): picked mon.noname-a con 0x7f35700a5b00 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35701362b0 con 0x7f35700a5b00 2024-09-10T16:30:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35700a80b0 con 0x7f35700a56e0 2024-09-10T16:30:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f357009de70 con 0x7f357009ca10 2024-09-10T16:30:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 10 monclient(hunting): authenticate will time out at 984.544216s 2024-09-10T16:30:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356ed9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f35700a5b00 0x7f3570141650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43088/0 (socket says 172.21.15.81:43088) 2024-09-10T16:30:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356ed9d640 1 -- 172.21.15.81:0/3209351151 learned_addr learned my addr 172.21.15.81:0/3209351151 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 1 -- 172.21.15.81:0/3209351151 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2909214624 0 0) 0x7f357009de70 con 0x7f357009ca10 2024-09-10T16:30:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient(hunting): my global_id is 4308 2024-09-10T16:30:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 1 -- 172.21.15.81:0/3209351151 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f355c003530 con 0x7f357009ca10 2024-09-10T16:30:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 1 -- 172.21.15.81:0/3209351151 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 929721338 0 0) 0x7f355c003530 con 0x7f357009ca10 2024-09-10T16:30:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 1 -- 172.21.15.81:0/3209351151 >> v1:172.21.15.189:6789/0 conn(0x7f35700a56e0 legacy=0x7f357013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T16:30:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 1 -- 172.21.15.81:0/3209351151 >> v1:172.21.15.81:6789/0 conn(0x7f35700a5b00 legacy=0x7f3570141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient: _finish_hunting 0 2024-09-10T16:30:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 1 monclient: found mon.noname-d 2024-09-10T16:30:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:30:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 1 -- 172.21.15.81:0/3209351151 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f357009e150 con 0x7f357009ca10 2024-09-10T16:30:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient: _finish_auth 0 2024-09-10T16:30:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient: _check_auth_tickets 2024-09-10T16:30:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 1 -- 172.21.15.81:0/3209351151 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3558001770 con 0x7f357009ca10 2024-09-10T16:30:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient: dump: 2024-09-10T16:30:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.151 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 1 -- 172.21.15.81:0/3209351151 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f35580019d0 con 0x7f357009ca10 2024-09-10T16:30:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 5 monclient: authenticate success, global_id 4308 2024-09-10T16:30:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 4 set_mon_vals no callback set 2024-09-10T16:30:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 1 -- 172.21.15.81:0/3209351151 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3558003960 con 0x7f357009ca10 2024-09-10T16:30:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f356d59a640 10 monclient: dump: 2024-09-10T16:30:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.152 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 10 monclient: shutdown 2024-09-10T16:30:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 1 -- 172.21.15.81:0/3209351151 >> v1:172.21.15.81:6792/0 conn(0x7f357009ca10 legacy=0x7f3570135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 1 -- 172.21.15.81:0/3209351151 shutdown_connections 2024-09-10T16:30:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 1 -- 172.21.15.81:0/3209351151 >> 172.21.15.81:0/3209351151 conn(0x7f357006dc90 msgr2=0x7f35700ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 1 -- 172.21.15.81:0/3209351151 shutdown_connections 2024-09-10T16:30:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 1 -- 172.21.15.81:0/3209351151 wait complete. 2024-09-10T16:30:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 10 monclient: build_initial_monmap 2024-09-10T16:30:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.142+0000 7f3574caf640 10 monclient: monmap: 2024-09-10T16:30:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:17.156 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 1 Processor -- start 2024-09-10T16:30:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 1 -- start start 2024-09-10T16:30:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 monclient: init 2024-09-10T16:30:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 monclient: _add_conns ranks=[2,4,5,7,3,6,1,8,0] 2024-09-10T16:30:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 monclient(hunting): picked mon.noname-b con 0x7f357009ca10 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 monclient(hunting): picked mon.noname-c con 0x7f35700a56e0 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 monclient(hunting): picked mon.noname-h con 0x7f35700a5b00 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35700aa380 con 0x7f357009ca10 2024-09-10T16:30:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3570135090 con 0x7f35700a56e0 2024-09-10T16:30:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3570131e40 con 0x7f35700a5b00 2024-09-10T16:30:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 monclient(hunting): authenticate will time out at 984.549056s 2024-09-10T16:30:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f356e59c640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f357009ca10 0x7f35701cd850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38556/0 (socket says 172.21.15.81:38556) 2024-09-10T16:30:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f356e59c640 1 -- 172.21.15.81:0/1877899052 learned_addr learned my addr 172.21.15.81:0/1877899052 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1975504222 0 0) 0x7f357009e150 con 0x7f357009ca10 2024-09-10T16:30:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): my global_id is 4340 2024-09-10T16:30:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3550003530 con 0x7f357009ca10 2024-09-10T16:30:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 549760751 0 0) 0x7f3550003530 con 0x7f357009ca10 2024-09-10T16:30:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f357009e150 con 0x7f357009ca10 2024-09-10T16:30:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3558001630 con 0x7f357009ca10 2024-09-10T16:30:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:17.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.160 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1652452058 0 0) 0x7f3570131e40 con 0x7f35700a5b00 2024-09-10T16:30:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): my global_id is 4316 2024-09-10T16:30:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3550003530 con 0x7f35700a5b00 2024-09-10T16:30:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146411802 0 0) 0x7f35600010a0 con 0x7f35700a56e0 2024-09-10T16:30:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient(hunting): my global_id is 4360 2024-09-10T16:30:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3570131e40 con 0x7f35700a56e0 2024-09-10T16:30:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2667666969 0 0) 0x7f357009e150 con 0x7f357009ca10 2024-09-10T16:30:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 >> v1:172.21.15.189:6791/0 conn(0x7f35700a5b00 legacy=0x7f35701d5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 >> v1:172.21.15.81:6791/0 conn(0x7f35700a56e0 legacy=0x7f35701d2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 monclient: found mon.b 2024-09-10T16:30:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3570132120 con 0x7f357009ca10 2024-09-10T16:30:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:17.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 5 monclient: authenticate success, global_id 4340 2024-09-10T16:30:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 monclient: _renew_subs 2024-09-10T16:30:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 1 -- 172.21.15.81:0/1877899052 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f35700a9e70 con 0x7f357009ca10 2024-09-10T16:30:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 monclient: _renew_subs 2024-09-10T16:30:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 1 -- 172.21.15.81:0/1877899052 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f35701328a0 con 0x7f357009ca10 2024-09-10T16:30:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3558001c40 con 0x7f357009ca10 2024-09-10T16:30:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3558003f10 con 0x7f357009ca10 2024-09-10T16:30:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 10 monclient: dump: 2024-09-10T16:30:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.163 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.164 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.164 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.164 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:17.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3574caf640 1 -- 172.21.15.81:0/1877899052 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3570131ac0 con 0x7f357009ca10 2024-09-10T16:30:17.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f35580040b0 con 0x7f357009ca10 2024-09-10T16:30:17.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.146+0000 7f26a03a3640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-10T16:30:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.150+0000 7f26a03a3640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-10T16:30:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.150+0000 7f26a03a3640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.150+0000 7f26a03a3640 1 -- 172.21.15.81:0/841648675 --> v1:172.21.15.81:6792/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f2678005380 con 0x7f26980a56e0 2024-09-10T16:30:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.150+0000 7f356cd99640 4 set_mon_vals no callback set 2024-09-10T16:30:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.150+0000 7f2696ffd640 1 -- 172.21.15.81:0/841648675 <== mon.6 v1:172.21.15.81:6792/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 2194451396) 0x7f268c0167d0 con 0x7f26980a56e0 2024-09-10T16:30:17.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.150+0000 7f2696ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-10T16:30:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.150+0000 7f2696ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:17.166 INFO:teuthology.orchestra.run.smithi081.stdout:55834574851 2024-09-10T16:30:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.150+0000 7f2694ff9640 1 -- 172.21.15.81:0/841648675 >> v1:172.21.15.189:6812/1108603242 conn(0x7f268403cff0 legacy=0x7f268403f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.150+0000 7f2694ff9640 10 monclient: shutdown 2024-09-10T16:30:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.150+0000 7f2694ff9640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.150+0000 7f2694ff9640 1 -- 172.21.15.81:0/841648675 >> v1:172.21.15.81:6792/0 conn(0x7f26980a56e0 legacy=0x7f26981cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.150+0000 7f2694ff9640 1 -- 172.21.15.81:0/841648675 shutdown_connections 2024-09-10T16:30:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.150+0000 7f2694ff9640 1 -- 172.21.15.81:0/841648675 >> 172.21.15.81:0/841648675 conn(0x7f269806dc90 msgr2=0x7f26980a82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.154+0000 7f2694ff9640 1 -- 172.21.15.81:0/841648675 shutdown_connections 2024-09-10T16:30:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.154+0000 7f2694ff9640 1 -- 172.21.15.81:0/841648675 wait complete. 2024-09-10T16:30:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.154+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f355804ad60 con 0x7f357009ca10 2024-09-10T16:30:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.154+0000 7f356dd9b640 10 monclient: get_auth_request con 0x7f355003d120 auth_method 0 2024-09-10T16:30:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.154+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f35700aa380 con 0x7f357009ca10 2024-09-10T16:30:17.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.154+0000 7f3566ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.154+0000 7f3566ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:17.175 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.0 2024-09-10T16:30:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 10 monclient: get_monmap_and_config 2024-09-10T16:30:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 10 monclient: build_initial_monmap 2024-09-10T16:30:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 10 monclient: monmap: 2024-09-10T16:30:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:17.192415+0000 2024-09-10T16:30:17.190 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:17.192415+0000 2024-09-10T16:30:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:17.191 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:17.191 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 1 Processor -- start 2024-09-10T16:30:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 1 -- start start 2024-09-10T16:30:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 10 monclient: init 2024-09-10T16:30:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 10 monclient: _add_conns ranks=[1,7,6,8,5,2,0,3,4] 2024-09-10T16:30:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 10 monclient(hunting): picked mon.noname-f con 0x7f2f7009ca10 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 10 monclient(hunting): picked mon.noname-i con 0x7f2f700a56e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 10 monclient(hunting): picked mon.noname-d con 0x7f2f700a5b00 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f701362b0 con 0x7f2f7009ca10 2024-09-10T16:30:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f700a80b0 con 0x7f2f700a5b00 2024-09-10T16:30:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f7009de70 con 0x7f2f700a56e0 2024-09-10T16:30:17.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f76423640 10 monclient(hunting): authenticate will time out at 984.591550s 2024-09-10T16:30:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f749c0640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f2f700a5b00 0x7f2f70141650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56148/0 (socket says 172.21.15.81:56148) 2024-09-10T16:30:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.186+0000 7f2f749c0640 1 -- 172.21.15.81:0/2708075760 learned_addr learned my addr 172.21.15.81:0/2708075760 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 1 -- 172.21.15.81:0/2708075760 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2728214441 0 0) 0x7f2f700a80b0 con 0x7f2f700a5b00 2024-09-10T16:30:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient(hunting): my global_id is 4317 2024-09-10T16:30:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 1 -- 172.21.15.81:0/2708075760 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f58003530 con 0x7f2f700a5b00 2024-09-10T16:30:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 1 -- 172.21.15.81:0/2708075760 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 406009679 0 0) 0x7f2f58003530 con 0x7f2f700a5b00 2024-09-10T16:30:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 1 -- 172.21.15.81:0/2708075760 >> v1:172.21.15.189:6792/0 conn(0x7f2f700a56e0 legacy=0x7f2f7013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 1 -- 172.21.15.81:0/2708075760 >> v1:172.21.15.189:6789/0 conn(0x7f2f7009ca10 legacy=0x7f2f70135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 1 monclient: found mon.noname-d 2024-09-10T16:30:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:30:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 1 -- 172.21.15.81:0/2708075760 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7009e150 con 0x7f2f700a5b00 2024-09-10T16:30:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient: _finish_auth 0 2024-09-10T16:30:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 1 -- 172.21.15.81:0/2708075760 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2f68001bc0 con 0x7f2f700a5b00 2024-09-10T16:30:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient: dump: 2024-09-10T16:30:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.196 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.197 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 5 monclient: authenticate success, global_id 4317 2024-09-10T16:30:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 1 -- 172.21.15.81:0/2708075760 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f68001de0 con 0x7f2f700a5b00 2024-09-10T16:30:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 1 -- 172.21.15.81:0/2708075760 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2f68004f70 con 0x7f2f700a5b00 2024-09-10T16:30:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 4 set_mon_vals no callback set 2024-09-10T16:30:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6effd640 10 monclient: dump: 2024-09-10T16:30:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.198 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.199 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 10 monclient: shutdown 2024-09-10T16:30:17.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 1 -- 172.21.15.81:0/2708075760 >> v1:172.21.15.81:6792/0 conn(0x7f2f700a5b00 legacy=0x7f2f70141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 1 -- 172.21.15.81:0/2708075760 shutdown_connections 2024-09-10T16:30:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 1 -- 172.21.15.81:0/2708075760 >> 172.21.15.81:0/2708075760 conn(0x7f2f7006dc90 msgr2=0x7f2f700ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 1 -- 172.21.15.81:0/2708075760 shutdown_connections 2024-09-10T16:30:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 1 -- 172.21.15.81:0/2708075760 wait complete. 2024-09-10T16:30:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 10 monclient: get_monmap_and_config 2024-09-10T16:30:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 10 monclient: build_initial_monmap 2024-09-10T16:30:17.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 10 monclient: monmap: 2024-09-10T16:30:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:17.195793+0000 2024-09-10T16:30:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:17.195793+0000 2024-09-10T16:30:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:17.201 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:17.202 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:17.202 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:17.202 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 10 monclient: build_initial_monmap 2024-09-10T16:30:17.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 10 monclient: monmap: 2024-09-10T16:30:17.202 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:17.203 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:17.204 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 1 Processor -- start 2024-09-10T16:30:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 1 -- start start 2024-09-10T16:30:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 10 monclient: init 2024-09-10T16:30:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 1 Processor -- start 2024-09-10T16:30:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 1 -- start start 2024-09-10T16:30:17.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 10 monclient: init 2024-09-10T16:30:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 10 monclient: _add_conns ranks=[8,4,5,2,1,6,7,0,3] 2024-09-10T16:30:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 10 monclient(hunting): picked mon.noname-e con 0x7f2f7009ca10 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 10 monclient(hunting): picked mon.noname-c con 0x7f2f700a56e0 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 10 monclient(hunting): picked mon.noname-h con 0x7f2f700a5b00 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f700aa460 con 0x7f2f700a56e0 2024-09-10T16:30:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6f7fe640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f2f700a56e0 0x7f2f701376f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34536/0 (socket says 172.21.15.81:34536) 2024-09-10T16:30:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6f7fe640 1 -- 172.21.15.81:0/1631569791 learned_addr learned my addr 172.21.15.81:0/1631569791 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 1 -- 172.21.15.81:0/1631569791 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f70142ad0 con 0x7f2f700a5b00 2024-09-10T16:30:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 1 -- 172.21.15.81:0/1631569791 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f70138840 con 0x7f2f7009ca10 2024-09-10T16:30:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1127807887 0 0) 0x7f2f7009de70 con 0x7f2f700a56e0 2024-09-10T16:30:17.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f76423640 10 monclient(hunting): authenticate will time out at 984.595466s 2024-09-10T16:30:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): my global_id is 4369 2024-09-10T16:30:17.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f5c003560 con 0x7f2f700a56e0 2024-09-10T16:30:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 10 monclient: _add_conns ranks=[3,4,2,6,5,0,7,1,8] 2024-09-10T16:30:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 10 monclient(hunting): picked mon.noname-g con 0x7fd5e40a3f60 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 10 monclient(hunting): picked mon.noname-c con 0x7fd5e40a4a50 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 10 monclient(hunting): picked mon.noname-b con 0x7fd5e4073bf0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e40a5790 con 0x7fd5e4073bf0 2024-09-10T16:30:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e4072f30 con 0x7fd5e40a3f60 2024-09-10T16:30:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e40aa340 con 0x7fd5e40a4a50 2024-09-10T16:30:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:17.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5e881c640 10 monclient(hunting): authenticate will time out at 984.595667s 2024-09-10T16:30:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5dbfff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fd5e40a4a50 0x7fd5e413bf60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34542/0 (socket says 172.21.15.81:34542) 2024-09-10T16:30:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7fd5dbfff640 1 -- 172.21.15.81:0/2592719926 learned_addr learned my addr 172.21.15.81:0/2592719926 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 104860385 0 0) 0x7f2f7009e150 con 0x7f2f700a5b00 2024-09-10T16:30:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): my global_id is 4325 2024-09-10T16:30:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f7009de70 con 0x7f2f700a5b00 2024-09-10T16:30:17.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4275759762 0 0) 0x7f2f5c003560 con 0x7f2f700a56e0 2024-09-10T16:30:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f7009e150 con 0x7f2f700a56e0 2024-09-10T16:30:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2f64001b20 con 0x7f2f700a56e0 2024-09-10T16:30:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): dump: 2024-09-10T16:30:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.210 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.211 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 10 monclient: get_monmap_and_config 2024-09-10T16:30:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 10 monclient: build_initial_monmap 2024-09-10T16:30:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 10 monclient: monmap: 2024-09-10T16:30:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:17.198183+0000 2024-09-10T16:30:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:17.198183+0000 2024-09-10T16:30:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:17.212 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:17.213 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2219152477 0 0) 0x7f2f70138840 con 0x7f2f7009ca10 2024-09-10T16:30:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 10 monclient(hunting): my global_id is 4265 2024-09-10T16:30:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.190+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f5c003560 con 0x7f2f7009ca10 2024-09-10T16:30:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2665421595 0 0) 0x7f2f7009e150 con 0x7f2f700a56e0 2024-09-10T16:30:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 >> v1:172.21.15.81:6793/0 conn(0x7f2f7009ca10 legacy=0x7f2f70136fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 >> v1:172.21.15.189:6791/0 conn(0x7f2f700a5b00 legacy=0x7f2f701d5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 10 monclient: _finish_hunting 0 2024-09-10T16:30:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 1 monclient: found mon.c 2024-09-10T16:30:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:17.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f70137e00 con 0x7f2f700a56e0 2024-09-10T16:30:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 10 monclient: _finish_auth 0 2024-09-10T16:30:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 10 monclient: _check_auth_tickets 2024-09-10T16:30:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f76423640 5 monclient: authenticate success, global_id 4369 2024-09-10T16:30:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f76423640 10 monclient: _renew_subs 2024-09-10T16:30:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f76423640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f76423640 1 -- 172.21.15.81:0/1631569791 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7013a8c0 con 0x7f2f700a56e0 2024-09-10T16:30:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f76423640 10 monclient: _renew_subs 2024-09-10T16:30:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f76423640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f76423640 1 -- 172.21.15.81:0/1631569791 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2f70142310 con 0x7f2f700a56e0 2024-09-10T16:30:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f640038d0 con 0x7f2f700a56e0 2024-09-10T16:30:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:17.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2f64003ec0 con 0x7f2f700a56e0 2024-09-10T16:30:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6e7fc640 4 set_mon_vals no callback set 2024-09-10T16:30:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 10 monclient: dump: 2024-09-10T16:30:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.216 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.217 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.217 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.217 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.217 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.217 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.217 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.217 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 1 -- 172.21.15.81:0/2592719926 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2256183907 0 0) 0x7fd5e40aa340 con 0x7fd5e40a4a50 2024-09-10T16:30:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient(hunting): my global_id is 4378 2024-09-10T16:30:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 1 -- 172.21.15.81:0/2592719926 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5d0003530 con 0x7fd5e40a4a50 2024-09-10T16:30:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 1 -- 172.21.15.81:0/2592719926 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1942078299 0 0) 0x7fd5d0003530 con 0x7fd5e40a4a50 2024-09-10T16:30:17.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 1 -- 172.21.15.81:0/2592719926 >> v1:172.21.15.189:6790/0 conn(0x7fd5e40a3f60 legacy=0x7fd5e40a4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 1 -- 172.21.15.81:0/2592719926 >> v1:172.21.15.81:6790/0 conn(0x7fd5e4073bf0 legacy=0x7fd5e413f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient: _finish_hunting 0 2024-09-10T16:30:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 1 monclient: found mon.noname-c 2024-09-10T16:30:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:30:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 1 -- 172.21.15.81:0/2592719926 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e4143de0 con 0x7fd5e40a4a50 2024-09-10T16:30:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient: _finish_auth 0 2024-09-10T16:30:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient: _check_auth_tickets 2024-09-10T16:30:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 1 -- 172.21.15.81:0/2592719926 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd5cc001840 con 0x7fd5e40a4a50 2024-09-10T16:30:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:17.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient: dump: 2024-09-10T16:30:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.220 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.221 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.221 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 5 monclient: authenticate success, global_id 4378 2024-09-10T16:30:17.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:17.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 1 -- 172.21.15.81:0/2592719926 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5cc0019e0 con 0x7fd5e40a4a50 2024-09-10T16:30:17.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:17.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 1 -- 172.21.15.81:0/2592719926 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd5cc004bf0 con 0x7fd5e40a4a50 2024-09-10T16:30:17.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:17.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e1d9b640 10 monclient: dump: 2024-09-10T16:30:17.221 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.221 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.221 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.222 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.222 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.222 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.222 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.222 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.222 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.222 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.222 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.222 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.222 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.222 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.222 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.222 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 4 set_mon_vals no callback set 2024-09-10T16:30:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f76423640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f76423640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f76423640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f76423640 1 -- 172.21.15.81:0/1631569791 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f50005090 con 0x7f2f700a56e0 2024-09-10T16:30:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f2f64004060 con 0x7f2f700a56e0 2024-09-10T16:30:17.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f2f6404acd0 con 0x7f2f700a56e0 2024-09-10T16:30:17.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 10 monclient: shutdown 2024-09-10T16:30:17.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:17.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 1 -- 172.21.15.81:0/2592719926 >> v1:172.21.15.81:6791/0 conn(0x7fd5e40a4a50 legacy=0x7fd5e413bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f2f6ffff640 10 monclient: get_auth_request con 0x7f2f5c03d300 auth_method 0 2024-09-10T16:30:17.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 1 -- 172.21.15.81:0/2592719926 shutdown_connections 2024-09-10T16:30:17.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 1 -- 172.21.15.81:0/2592719926 >> 172.21.15.81:0/2592719926 conn(0x7fd5e40a9560 msgr2=0x7fd5e40a9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:17.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 1 Processor -- start 2024-09-10T16:30:17.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 1 -- 172.21.15.81:0/2592719926 shutdown_connections 2024-09-10T16:30:17.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 1 -- 172.21.15.81:0/2592719926 wait complete. 2024-09-10T16:30:17.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 1 -- start start 2024-09-10T16:30:17.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 10 monclient: init 2024-09-10T16:30:17.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7efe76621640 10 monclient: get_monmap_and_config 2024-09-10T16:30:17.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7efe76621640 10 monclient: build_initial_monmap 2024-09-10T16:30:17.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7efe76621640 10 monclient: monmap: 2024-09-10T16:30:17.226 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:17.226 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.226 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:17.200623+0000 2024-09-10T16:30:17.226 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:17.200623+0000 2024-09-10T16:30:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:17.227 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:17.227 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 10 monclient: build_initial_monmap 2024-09-10T16:30:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 10 monclient: monmap: 2024-09-10T16:30:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:17.228 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:17.229 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:17.229 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:17.229 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:17.229 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:17.229 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:17.229 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:17.229 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:17.229 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:17.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 10 monclient: _add_conns ranks=[8,7,5,0,3,1,4,2,6] 2024-09-10T16:30:17.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 10 monclient(hunting): picked mon.noname-e con 0x7f31400a5470 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:17.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 10 monclient(hunting): picked mon.noname-i con 0x7f3140138f10 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:17.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 10 monclient(hunting): picked mon.noname-h con 0x7f314013f500 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:17.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31400ab3d0 con 0x7f314013f500 2024-09-10T16:30:17.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 1 Processor -- start 2024-09-10T16:30:17.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f314009d640 con 0x7f3140138f10 2024-09-10T16:30:17.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f314009d920 con 0x7f31400a5470 2024-09-10T16:30:17.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:17.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3147058640 10 monclient(hunting): authenticate will time out at 984.599541s 2024-09-10T16:30:17.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 1 -- start start 2024-09-10T16:30:17.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 10 monclient: init 2024-09-10T16:30:17.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3145855640 1 --1- >> v1:172.21.15.189:6792/0 conn(0x7f3140138f10 0x7f314013dde0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6792/0 says I am v1:172.21.15.81:43206/0 (socket says 172.21.15.81:43206) 2024-09-10T16:30:17.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7f3145855640 1 -- 172.21.15.81:0/3864185552 learned_addr learned my addr 172.21.15.81:0/3864185552 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:17.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 10 monclient: _add_conns ranks=[1,3,7,6,8,4,2,0,5] 2024-09-10T16:30:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.194+0000 7fd5e881c640 10 monclient(hunting): picked mon.noname-f con 0x7fd5e4073bf0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 10 monclient(hunting): picked mon.noname-g con 0x7fd5e40a3f60 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 10 monclient(hunting): picked mon.noname-i con 0x7fd5e406f9a0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e413d590 con 0x7fd5e4073bf0 2024-09-10T16:30:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e40a6a10 con 0x7fd5e40a3f60 2024-09-10T16:30:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e4143bb0 con 0x7fd5e406f9a0 2024-09-10T16:30:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:17.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 10 monclient(hunting): authenticate will time out at 984.600082s 2024-09-10T16:30:17.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 1 Processor -- start 2024-09-10T16:30:17.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 1 -- start start 2024-09-10T16:30:17.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 10 monclient: init 2024-09-10T16:30:17.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 1 -- 172.21.15.81:0/3864185552 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1620057802 0 0) 0x7f314009d640 con 0x7f3140138f10 2024-09-10T16:30:17.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient(hunting): my global_id is 4327 2024-09-10T16:30:17.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 1 -- 172.21.15.81:0/3864185552 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f312c003530 con 0x7f3140138f10 2024-09-10T16:30:17.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5dbfff640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7fd5e40a3f60 0x7fd5e41d2fc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.81:34940/0 (socket says 172.21.15.81:34940) 2024-09-10T16:30:17.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5dbfff640 1 -- 172.21.15.81:0/206944233 learned_addr learned my addr 172.21.15.81:0/206944233 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:17.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 1 -- 172.21.15.81:0/3864185552 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 393436165 0 0) 0x7f31400ab3d0 con 0x7f314013f500 2024-09-10T16:30:17.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient(hunting): my global_id is 4334 2024-09-10T16:30:17.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 1 -- 172.21.15.81:0/3864185552 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f314009d640 con 0x7f314013f500 2024-09-10T16:30:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 1 -- 172.21.15.81:0/3864185552 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2200076803 0 0) 0x7f314009d920 con 0x7f31400a5470 2024-09-10T16:30:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient(hunting): my global_id is 4274 2024-09-10T16:30:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 1 -- 172.21.15.81:0/3864185552 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31400ab3d0 con 0x7f31400a5470 2024-09-10T16:30:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 1 -- 172.21.15.81:0/3864185552 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3947982987 0 0) 0x7f31400ab3d0 con 0x7f31400a5470 2024-09-10T16:30:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 1 -- 172.21.15.81:0/3864185552 >> v1:172.21.15.189:6792/0 conn(0x7f3140138f10 legacy=0x7f314013dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 1 -- 172.21.15.81:0/3864185552 >> v1:172.21.15.189:6791/0 conn(0x7f314013f500 legacy=0x7f31401418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient: _finish_hunting 0 2024-09-10T16:30:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 1 monclient: found mon.noname-e 2024-09-10T16:30:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:17.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:30:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 1 -- 172.21.15.81:0/3864185552 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31400ac340 con 0x7f31400a5470 2024-09-10T16:30:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient: _finish_auth 0 2024-09-10T16:30:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient: _check_auth_tickets 2024-09-10T16:30:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 1 -- 172.21.15.81:0/3864185552 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f313c001760 con 0x7f31400a5470 2024-09-10T16:30:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient: dump: 2024-09-10T16:30:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.238 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.239 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 5 monclient: authenticate success, global_id 4274 2024-09-10T16:30:17.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:17.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:17.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 1 -- 172.21.15.81:0/3864185552 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f313c001900 con 0x7f31400a5470 2024-09-10T16:30:17.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:17.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 1 -- 172.21.15.81:0/3864185552 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f313c003960 con 0x7f31400a5470 2024-09-10T16:30:17.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:17.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 4 set_mon_vals no callback set 2024-09-10T16:30:17.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:17.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 10 monclient: _add_conns ranks=[6,2,0,1,7,8,4,5,3] 2024-09-10T16:30:17.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 10 monclient(hunting): picked mon.noname-d con 0x7efe70068960 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:17.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3145054640 10 monclient: dump: 2024-09-10T16:30:17.241 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.241 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.241 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.242 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.242 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.242 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.242 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.242 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.242 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.242 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.242 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.242 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.242 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.242 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.242 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.242 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 10 monclient(hunting): picked mon.noname-b con 0x7efe700a0950 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:17.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399272240 0 0) 0x7fd5e40a6a10 con 0x7fd5e40a3f60 2024-09-10T16:30:17.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): my global_id is 4278 2024-09-10T16:30:17.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5c4003530 con 0x7fd5e40a3f60 2024-09-10T16:30:17.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2575218209 0 0) 0x7fd5e413d590 con 0x7fd5e4073bf0 2024-09-10T16:30:17.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): my global_id is 4321 2024-09-10T16:30:17.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5e40a6a10 con 0x7fd5e4073bf0 2024-09-10T16:30:17.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2200543531 0 0) 0x7fd5e4143bb0 con 0x7fd5e406f9a0 2024-09-10T16:30:17.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): my global_id is 4336 2024-09-10T16:30:17.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5e413d590 con 0x7fd5e406f9a0 2024-09-10T16:30:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 10 monclient(hunting): picked mon.noname-a con 0x7efe7013f5c0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6ffff640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7efe70068960 0x7efe700a2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56162/0 (socket says 172.21.15.81:56162) 2024-09-10T16:30:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6f7fe640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7efe700a0950 0x7efe700a3510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38586/0 (socket says 172.21.15.81:38586) 2024-09-10T16:30:17.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6ffff640 1 -- 172.21.15.81:0/3901023505 learned_addr learned my addr 172.21.15.81:0/3901023505 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 1 -- 172.21.15.81:0/3901023505 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe700a4200 con 0x7efe7013f5c0 2024-09-10T16:30:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 1 -- 172.21.15.81:0/3901023505 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe700a3c20 con 0x7efe700a0950 2024-09-10T16:30:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 1 -- 172.21.15.81:0/3901023505 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe700a0ee0 con 0x7efe70068960 2024-09-10T16:30:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 10 monclient(hunting): authenticate will time out at 984.601569s 2024-09-10T16:30:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 1 -- 172.21.15.81:0/3901023505 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3356871263 0 0) 0x7efe700a3c20 con 0x7efe700a0950 2024-09-10T16:30:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient(hunting): my global_id is 4358 2024-09-10T16:30:17.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 1 -- 172.21.15.81:0/3901023505 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe58003530 con 0x7efe700a0950 2024-09-10T16:30:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 175762419 0 0) 0x7fd5e413d590 con 0x7fd5e406f9a0 2024-09-10T16:30:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5e4143bb0 con 0x7fd5e406f9a0 2024-09-10T16:30:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd5dc001ce0 con 0x7fd5e406f9a0 2024-09-10T16:30:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-10T16:30:17.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): dump: 2024-09-10T16:30:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.248 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.249 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2067727286 0 0) 0x7fd5e40a6a10 con 0x7fd5e4073bf0 2024-09-10T16:30:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5e413d590 con 0x7fd5e4073bf0 2024-09-10T16:30:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2267698236 0 0) 0x7fd5c4003530 con 0x7fd5e40a3f60 2024-09-10T16:30:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd5e40a6a10 con 0x7fd5e40a3f60 2024-09-10T16:30:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd5cc001780 con 0x7fd5e40a3f60 2024-09-10T16:30:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-10T16:30:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): dump: 2024-09-10T16:30:17.249 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.250 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.251 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.251 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd5d4001930 con 0x7fd5e4073bf0 2024-09-10T16:30:17.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:17.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-10T16:30:17.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient(hunting): dump: 2024-09-10T16:30:17.251 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.251 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.251 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.251 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.251 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.251 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.251 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.251 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.252 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 10 monclient: shutdown 2024-09-10T16:30:17.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 1 -- 172.21.15.81:0/3864185552 >> v1:172.21.15.81:6793/0 conn(0x7f31400a5470 legacy=0x7f31400a5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 1 -- 172.21.15.81:0/3901023505 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3561290471 0 0) 0x7efe700a0ee0 con 0x7efe70068960 2024-09-10T16:30:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient(hunting): my global_id is 4326 2024-09-10T16:30:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 1 -- 172.21.15.81:0/3901023505 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe700a3c20 con 0x7efe70068960 2024-09-10T16:30:17.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 1 -- 172.21.15.81:0/3901023505 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2429935340 0 0) 0x7efe700a4200 con 0x7efe7013f5c0 2024-09-10T16:30:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient(hunting): my global_id is 4374 2024-09-10T16:30:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 1 -- 172.21.15.81:0/3901023505 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe700a0ee0 con 0x7efe7013f5c0 2024-09-10T16:30:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 1 -- 172.21.15.81:0/3864185552 shutdown_connections 2024-09-10T16:30:17.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 1 -- 172.21.15.81:0/3864185552 >> 172.21.15.81:0/3864185552 conn(0x7f314006da20 msgr2=0x7f31400ab8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:17.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3031603402 0 0) 0x7fd5e4143bb0 con 0x7fd5e406f9a0 2024-09-10T16:30:17.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 >> v1:172.21.15.189:6790/0 conn(0x7fd5e40a3f60 legacy=0x7fd5e41d2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 1 -- 172.21.15.81:0/3864185552 shutdown_connections 2024-09-10T16:30:17.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 >> v1:172.21.15.189:6789/0 conn(0x7fd5e4073bf0 legacy=0x7fd5e41cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:17.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 monclient: found mon.i 2024-09-10T16:30:17.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:30:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 --> v1:172.21.15.189:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e413d2b0 con 0x7fd5e406f9a0 2024-09-10T16:30:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 1 -- 172.21.15.81:0/3901023505 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1663427483 0 0) 0x7efe58003530 con 0x7efe700a0950 2024-09-10T16:30:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 1 -- 172.21.15.81:0/3901023505 >> v1:172.21.15.81:6792/0 conn(0x7efe70068960 legacy=0x7efe700a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 1 -- 172.21.15.81:0/3901023505 >> v1:172.21.15.81:6789/0 conn(0x7efe7013f5c0 legacy=0x7efe701419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 1 monclient: found mon.noname-b 2024-09-10T16:30:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:30:17.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 1 -- 172.21.15.81:0/3901023505 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe700a4630 con 0x7efe700a0950 2024-09-10T16:30:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 1 -- 172.21.15.81:0/3864185552 wait complete. 2024-09-10T16:30:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 5 monclient: authenticate success, global_id 4336 2024-09-10T16:30:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 10 monclient: _renew_subs 2024-09-10T16:30:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:30:17.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 1 -- 172.21.15.81:0/206944233 --> v1:172.21.15.189:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e413c1d0 con 0x7fd5e406f9a0 2024-09-10T16:30:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 10 monclient: _renew_subs 2024-09-10T16:30:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:30:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 1 -- 172.21.15.81:0/206944233 --> v1:172.21.15.189:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fd5e41ce6e0 con 0x7fd5e406f9a0 2024-09-10T16:30:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient: _finish_auth 0 2024-09-10T16:30:17.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:17.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:17.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 1 -- 172.21.15.81:0/3901023505 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7efe640017c0 con 0x7efe700a0950 2024-09-10T16:30:17.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:17.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient: dump: 2024-09-10T16:30:17.259 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.259 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.259 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.259 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.259 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.259 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.259 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.259 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.260 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 1 -- 172.21.15.81:0/3901023505 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe64001a20 con 0x7efe700a0950 2024-09-10T16:30:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 1 -- 172.21.15.81:0/3901023505 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7efe64004b30 con 0x7efe700a0950 2024-09-10T16:30:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe6effd640 10 monclient: dump: 2024-09-10T16:30:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.261 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.262 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.262 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.262 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.262 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 5 monclient: authenticate success, global_id 4358 2024-09-10T16:30:17.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:17.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 4 set_mon_vals no callback set 2024-09-10T16:30:17.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.7 v1:172.21.15.189:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd5dc002000 con 0x7fd5e406f9a0 2024-09-10T16:30:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.7 v1:172.21.15.189:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd5dc003f70 con 0x7fd5e406f9a0 2024-09-10T16:30:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:30:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5daffd640 10 monclient: dump: 2024-09-10T16:30:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.263 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.264 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.264 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.264 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.264 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.264 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.264 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.264 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.264 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.264 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.264 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e159a640 4 set_mon_vals no callback set 2024-09-10T16:30:17.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 10 monclient: build_initial_monmap 2024-09-10T16:30:17.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 10 monclient: monmap: 2024-09-10T16:30:17.265 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:17.265 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:17.265 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:17.265 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:17.265 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:17.265 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:17.265 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:17.265 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:17.265 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:17.266 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:30:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 10 monclient: shutdown 2024-09-10T16:30:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7fd5e881c640 1 -- 172.21.15.81:0/206944233 --> v1:172.21.15.189:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5c8005090 con 0x7fd5e406f9a0 2024-09-10T16:30:17.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 1 -- 172.21.15.81:0/3901023505 >> v1:172.21.15.81:6790/0 conn(0x7efe700a0950 legacy=0x7efe700a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 1 Processor -- start 2024-09-10T16:30:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 1 -- 172.21.15.81:0/3901023505 shutdown_connections 2024-09-10T16:30:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 1 -- 172.21.15.81:0/3901023505 >> 172.21.15.81:0/3901023505 conn(0x7efe700a85d0 msgr2=0x7efe700a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 1 -- start start 2024-09-10T16:30:17.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7f3147058640 10 monclient: init 2024-09-10T16:30:17.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 1 -- 172.21.15.81:0/3901023505 shutdown_connections 2024-09-10T16:30:17.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.198+0000 7efe76621640 1 -- 172.21.15.81:0/3901023505 wait complete. 2024-09-10T16:30:17.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:17.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 10 monclient: _add_conns ranks=[3,8,4,7,5,1,6,2,0] 2024-09-10T16:30:17.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 10 monclient(hunting): picked mon.noname-g con 0x7f31400a5470 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.7 v1:172.21.15.189:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fd5dc00fe80 con 0x7fd5e406f9a0 2024-09-10T16:30:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.7 v1:172.21.15.189:6792/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7fd5dc049ec0 con 0x7fd5e406f9a0 2024-09-10T16:30:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 10 monclient(hunting): picked mon.noname-e con 0x7f3140138f10 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:17.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 10 monclient(hunting): picked mon.noname-c con 0x7f314013f500 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 10 monclient: build_initial_monmap 2024-09-10T16:30:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 10 monclient: monmap: 2024-09-10T16:30:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:17.271 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:17.272 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3145855640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f3140138f10 0x7f31401d2830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35210/0 (socket says 172.21.15.81:35210) 2024-09-10T16:30:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3145855640 1 -- 172.21.15.81:0/3235657403 learned_addr learned my addr 172.21.15.81:0/3235657403 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 1 -- 172.21.15.81:0/3235657403 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f314013e620 con 0x7f31400a5470 2024-09-10T16:30:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 1 -- 172.21.15.81:0/3235657403 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3140142910 con 0x7f314013f500 2024-09-10T16:30:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 1 -- 172.21.15.81:0/3235657403 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3140137c40 con 0x7f3140138f10 2024-09-10T16:30:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 10 monclient(hunting): authenticate will time out at 984.604706s 2024-09-10T16:30:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7fd5e259c640 10 monclient: get_auth_request con 0x7fd5c403da50 auth_method 0 2024-09-10T16:30:17.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3635308857 0 0) 0x7f3140137c40 con 0x7f3140138f10 2024-09-10T16:30:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 1 Processor -- start 2024-09-10T16:30:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient(hunting): my global_id is 4283 2024-09-10T16:30:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3124003560 con 0x7f3140138f10 2024-09-10T16:30:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4272137307 0 0) 0x7f314013e620 con 0x7f31400a5470 2024-09-10T16:30:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient(hunting): my global_id is 4287 2024-09-10T16:30:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3140137c40 con 0x7f31400a5470 2024-09-10T16:30:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 1 -- start start 2024-09-10T16:30:17.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 10 monclient: init 2024-09-10T16:30:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3727000967 0 0) 0x7f3124003560 con 0x7f3140138f10 2024-09-10T16:30:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f314013e620 con 0x7f3140138f10 2024-09-10T16:30:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3138001e80 con 0x7f3140138f10 2024-09-10T16:30:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:17.276 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.277 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.278 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 10 monclient: _add_conns ranks=[8,6,7,5,0,2,1,3,4] 2024-09-10T16:30:17.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1661487051 0 0) 0x7f314013e620 con 0x7f3140138f10 2024-09-10T16:30:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 10 monclient(hunting): picked mon.noname-e con 0x7efe70068960 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 10 monclient(hunting): picked mon.noname-d con 0x7efe700a0950 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 10 monclient(hunting): picked mon.noname-i con 0x7efe7013f5c0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe70093930 con 0x7efe700a0950 2024-09-10T16:30:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe7013f3f0 con 0x7efe7013f5c0 2024-09-10T16:30:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe70093f00 con 0x7efe70068960 2024-09-10T16:30:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe76621640 10 monclient(hunting): authenticate will time out at 984.605592s 2024-09-10T16:30:17.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6f7fe640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7efe700a0950 0x7efe7013ece0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56170/0 (socket says 172.21.15.81:56170) 2024-09-10T16:30:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6f7fe640 1 -- 172.21.15.81:0/2403263657 learned_addr learned my addr 172.21.15.81:0/2403263657 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 >> v1:172.21.15.81:6791/0 conn(0x7f314013f500 legacy=0x7f31401d5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 >> v1:172.21.15.189:6790/0 conn(0x7f31400a5470 legacy=0x7f3140132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 monclient: found mon.e 2024-09-10T16:30:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:17.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31400a8f20 con 0x7f3140138f10 2024-09-10T16:30:17.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:17.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:17.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:17.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 5 monclient: authenticate success, global_id 4283 2024-09-10T16:30:17.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 10 monclient: _renew_subs 2024-09-10T16:30:17.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:17.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 1 -- 172.21.15.81:0/3235657403 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f314013c2c0 con 0x7f3140138f10 2024-09-10T16:30:17.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 10 monclient: _renew_subs 2024-09-10T16:30:17.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:17.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 1 -- 172.21.15.81:0/3235657403 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f314013edd0 con 0x7f3140138f10 2024-09-10T16:30:17.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489260246 0 0) 0x7efe700a3c20 con 0x7efe70068960 2024-09-10T16:30:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 10 monclient(hunting): my global_id is 4292 2024-09-10T16:30:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe5c003530 con 0x7efe70068960 2024-09-10T16:30:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 192568947 0 0) 0x7efe70093930 con 0x7efe700a0950 2024-09-10T16:30:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 10 monclient(hunting): my global_id is 4335 2024-09-10T16:30:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efe700a3c20 con 0x7efe700a0950 2024-09-10T16:30:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3300361656 0 0) 0x7efe5c003530 con 0x7efe70068960 2024-09-10T16:30:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe70093930 con 0x7efe70068960 2024-09-10T16:30:17.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7efe600019a0 con 0x7efe70068960 2024-09-10T16:30:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 10 monclient(hunting): dump: 2024-09-10T16:30:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.283 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.284 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.284 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.284 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.284 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.284 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7efe6cff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:17.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3138004e20 con 0x7f3140138f10 2024-09-10T16:30:17.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3144853640 4 set_mon_vals no callback set 2024-09-10T16:30:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3138005310 con 0x7f3140138f10 2024-09-10T16:30:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3147058640 1 -- 172.21.15.81:0/3235657403 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3128005090 con 0x7f3140138f10 2024-09-10T16:30:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 10 monclient: dump: 2024-09-10T16:30:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.285 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.286 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f3138011220 con 0x7f3140138f10 2024-09-10T16:30:17.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f313804b1c0 con 0x7f3140138f10 2024-09-10T16:30:17.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f3146056640 10 monclient: get_auth_request con 0x7f312403d120 auth_method 0 2024-09-10T16:30:17.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f2f700aa460 con 0x7f2f700a56e0 2024-09-10T16:30:17.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f2f6cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.202+0000 7f2f6cff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:17.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1836889984 0 0) 0x7efe700a3c20 con 0x7efe700a0950 2024-09-10T16:30:17.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efe5c003530 con 0x7efe700a0950 2024-09-10T16:30:17.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7efe64001700 con 0x7efe700a0950 2024-09-10T16:30:17.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:17.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:17.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 10 monclient(hunting): dump: 2024-09-10T16:30:17.288 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.288 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.288 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.289 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.289 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1244291777 0 0) 0x7efe70093930 con 0x7efe70068960 2024-09-10T16:30:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 >> v1:172.21.15.189:6792/0 conn(0x7efe7013f5c0 legacy=0x7efe701d6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 >> v1:172.21.15.81:6792/0 conn(0x7efe700a0950 legacy=0x7efe7013ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 10 monclient: _finish_hunting 0 2024-09-10T16:30:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 1 monclient: found mon.e 2024-09-10T16:30:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe70142e60 con 0x7efe70068960 2024-09-10T16:30:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 10 monclient: _finish_auth 0 2024-09-10T16:30:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 10 monclient: _check_auth_tickets 2024-09-10T16:30:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe6cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:17.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe76621640 5 monclient: authenticate success, global_id 4292 2024-09-10T16:30:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe76621640 10 monclient: _renew_subs 2024-09-10T16:30:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe76621640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe76621640 1 -- 172.21.15.81:0/2403263657 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efe70092440 con 0x7efe70068960 2024-09-10T16:30:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe76621640 10 monclient: _renew_subs 2024-09-10T16:30:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe76621640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe76621640 1 -- 172.21.15.81:0/2403263657 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7efe700a6cd0 con 0x7efe70068960 2024-09-10T16:30:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe76621640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe76621640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe76621640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.206+0000 7efe76621640 1 -- 172.21.15.81:0/2403263657 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe700699f0 con 0x7efe70068960 2024-09-10T16:30:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.210+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efe600047f0 con 0x7efe70068960 2024-09-10T16:30:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.210+0000 7efe6cff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:17.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.210+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7efe60004ce0 con 0x7efe70068960 2024-09-10T16:30:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.210+0000 7efe6cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.210+0000 7efe6cff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.210+0000 7efe6cff9640 10 monclient: dump: 2024-09-10T16:30:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:17.292 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:17.293 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.210+0000 7efe6e7fc640 4 set_mon_vals no callback set 2024-09-10T16:30:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.210+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 <== mon.8 v1:172.21.15.81:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f31380170a0 con 0x7f3140138f10 2024-09-10T16:30:17.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.210+0000 7f3136ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.210+0000 7f3136ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:17.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.210+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7efe60010bf0 con 0x7efe70068960 2024-09-10T16:30:17.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.210+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7efe6004ac10 con 0x7efe70068960 2024-09-10T16:30:17.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.210+0000 7efe6f7fe640 10 monclient: get_auth_request con 0x7efe5c03d710 auth_method 0 2024-09-10T16:30:17.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.214+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 <== mon.8 v1:172.21.15.81:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7efe70093f00 con 0x7efe70068960 2024-09-10T16:30:17.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.214+0000 7efe6cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.214+0000 7efe6cff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:17.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.214+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.7 v1:172.21.15.189:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7fd5dc015c90 con 0x7fd5e406f9a0 2024-09-10T16:30:17.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.214+0000 7fd5daffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:17.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.214+0000 7fd5daffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.386+0000 7fd5e881c640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-10T16:30:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.386+0000 7fd5e881c640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-10T16:30:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.386+0000 7fd5e881c640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:30:17.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.386+0000 7fd5e881c640 1 -- 172.21.15.81:0/206944233 --> v1:172.21.15.189:6792/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fd5c8005380 con 0x7fd5e406f9a0 2024-09-10T16:30:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.386+0000 7fd5daffd640 1 -- 172.21.15.81:0/206944233 <== mon.7 v1:172.21.15.189:6792/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 2194451396) 0x7fd5dc01a070 con 0x7fd5e406f9a0 2024-09-10T16:30:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.386+0000 7fd5daffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-10T16:30:17.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.386+0000 7fd5daffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:17.390 INFO:teuthology.orchestra.run.smithi081.stdout:55834574851 2024-09-10T16:30:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.386+0000 7fd5e881c640 1 -- 172.21.15.81:0/206944233 >> v1:172.21.15.189:6812/1108603242 conn(0x7fd5c403da50 legacy=0x7fd5c403ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.386+0000 7fd5e881c640 10 monclient: shutdown 2024-09-10T16:30:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.386+0000 7fd5e881c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.386+0000 7fd5e881c640 1 -- 172.21.15.81:0/206944233 >> v1:172.21.15.189:6792/0 conn(0x7fd5e406f9a0 legacy=0x7fd5e41d66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.386+0000 7fd5e881c640 1 -- 172.21.15.81:0/206944233 shutdown_connections 2024-09-10T16:30:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.390+0000 7fd5e881c640 1 -- 172.21.15.81:0/206944233 >> 172.21.15.81:0/206944233 conn(0x7fd5e40a9560 msgr2=0x7fd5e41404f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.390+0000 7fd5e881c640 1 -- 172.21.15.81:0/206944233 shutdown_connections 2024-09-10T16:30:17.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.390+0000 7fd5e881c640 1 -- 172.21.15.81:0/206944233 wait complete. 2024-09-10T16:30:17.407 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.4 2024-09-10T16:30:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.434+0000 7f3147058640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-10T16:30:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.434+0000 7f3147058640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-10T16:30:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.434+0000 7f3147058640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.434+0000 7f3147058640 1 -- 172.21.15.81:0/3235657403 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3128005380 con 0x7f3140138f10 2024-09-10T16:30:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.434+0000 7f3136ffd640 1 -- 172.21.15.81:0/3235657403 <== mon.8 v1:172.21.15.81:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 2194451396) 0x7f31380169a0 con 0x7f3140138f10 2024-09-10T16:30:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.434+0000 7f3136ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-10T16:30:17.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.434+0000 7f3136ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:17.439 INFO:teuthology.orchestra.run.smithi081.stdout:55834574851 2024-09-10T16:30:17.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.434+0000 7efe76621640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-10T16:30:17.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.434+0000 7efe76621640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-10T16:30:17.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.434+0000 7efe76621640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:17.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.434+0000 7efe76621640 1 -- 172.21.15.81:0/2403263657 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efe7006e990 con 0x7efe70068960 2024-09-10T16:30:17.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.434+0000 7efe6cff9640 1 -- 172.21.15.81:0/2403263657 <== mon.8 v1:172.21.15.81:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 2439918515) 0x7efe60016aa0 con 0x7efe70068960 2024-09-10T16:30:17.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.434+0000 7efe6cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-10T16:30:17.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.434+0000 7efe6cff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:17.440 INFO:teuthology.orchestra.run.smithi081.stdout:55834574850 2024-09-10T16:30:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7efe76621640 1 -- 172.21.15.81:0/2403263657 >> v1:172.21.15.189:6812/1108603242 conn(0x7efe5c03d710 legacy=0x7efe5c03fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7efe76621640 10 monclient: shutdown 2024-09-10T16:30:17.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7efe76621640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:17.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7efe76621640 1 -- 172.21.15.81:0/2403263657 >> v1:172.21.15.81:6793/0 conn(0x7efe70068960 legacy=0x7efe7013e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7efe76621640 1 -- 172.21.15.81:0/2403263657 shutdown_connections 2024-09-10T16:30:17.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7efe76621640 1 -- 172.21.15.81:0/2403263657 >> 172.21.15.81:0/2403263657 conn(0x7efe700a85d0 msgr2=0x7efe700a6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:17.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7efe76621640 1 -- 172.21.15.81:0/2403263657 shutdown_connections 2024-09-10T16:30:17.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7efe76621640 1 -- 172.21.15.81:0/2403263657 wait complete. 2024-09-10T16:30:17.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7f3147058640 1 -- 172.21.15.81:0/3235657403 >> v1:172.21.15.189:6812/1108603242 conn(0x7f312403d120 legacy=0x7f312403f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7f3147058640 10 monclient: shutdown 2024-09-10T16:30:17.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7f3147058640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:17.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7f3147058640 1 -- 172.21.15.81:0/3235657403 >> v1:172.21.15.81:6793/0 conn(0x7f3140138f10 legacy=0x7f31401d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7f3147058640 1 -- 172.21.15.81:0/3235657403 shutdown_connections 2024-09-10T16:30:17.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7f3147058640 1 -- 172.21.15.81:0/3235657403 >> 172.21.15.81:0/3235657403 conn(0x7f314006da20 msgr2=0x7f31400a6800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:17.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7f3147058640 1 -- 172.21.15.81:0/3235657403 shutdown_connections 2024-09-10T16:30:17.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.438+0000 7f3147058640 1 -- 172.21.15.81:0/3235657403 wait complete. 2024-09-10T16:30:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3574caf640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-10T16:30:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3574caf640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-10T16:30:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3574caf640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3574caf640 1 -- 172.21.15.81:0/1877899052 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f3570068c10 con 0x7f357009ca10 2024-09-10T16:30:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3566ffd640 1 -- 172.21.15.81:0/1877899052 <== mon.2 v1:172.21.15.81:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 1444633209) 0x7f3558016c50 con 0x7f357009ca10 2024-09-10T16:30:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3566ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-10T16:30:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3566ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:17.453 INFO:teuthology.orchestra.run.smithi081.stdout:47244640260 2024-09-10T16:30:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3574caf640 1 -- 172.21.15.81:0/1877899052 >> v1:172.21.15.189:6812/1108603242 conn(0x7f355003d120 legacy=0x7f355003f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3574caf640 10 monclient: shutdown 2024-09-10T16:30:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3574caf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3574caf640 1 -- 172.21.15.81:0/1877899052 >> v1:172.21.15.81:6790/0 conn(0x7f357009ca10 legacy=0x7f35701cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3574caf640 1 -- 172.21.15.81:0/1877899052 shutdown_connections 2024-09-10T16:30:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3574caf640 1 -- 172.21.15.81:0/1877899052 >> 172.21.15.81:0/1877899052 conn(0x7f357006dc90 msgr2=0x7f35700a82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3574caf640 1 -- 172.21.15.81:0/1877899052 shutdown_connections 2024-09-10T16:30:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.450+0000 7f3574caf640 1 -- 172.21.15.81:0/1877899052 wait complete. 2024-09-10T16:30:17.460 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2024-09-10T16:30:17.461 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574850 for osd.2 2024-09-10T16:30:17.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640260 for osd.1 2024-09-10T16:30:17.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f76423640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-10T16:30:17.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f76423640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-10T16:30:17.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f76423640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:17.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f76423640 1 -- 172.21.15.81:0/1631569791 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f2f50005380 con 0x7f2f700a56e0 2024-09-10T16:30:17.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f6cff9640 1 -- 172.21.15.81:0/1631569791 <== mon.4 v1:172.21.15.81:6791/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 2777258794) 0x7f2f64016c50 con 0x7f2f700a56e0 2024-09-10T16:30:17.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f6cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-10T16:30:17.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f6cff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:17.490 INFO:teuthology.orchestra.run.smithi081.stdout:55834574853 2024-09-10T16:30:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f76423640 1 -- 172.21.15.81:0/1631569791 >> v1:172.21.15.189:6812/1108603242 conn(0x7f2f5c03d300 legacy=0x7f2f5c03f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f76423640 10 monclient: shutdown 2024-09-10T16:30:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f76423640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f76423640 1 -- 172.21.15.81:0/1631569791 >> v1:172.21.15.81:6791/0 conn(0x7f2f700a56e0 legacy=0x7f2f701376f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f76423640 1 -- 172.21.15.81:0/1631569791 shutdown_connections 2024-09-10T16:30:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f76423640 1 -- 172.21.15.81:0/1631569791 >> 172.21.15.81:0/1631569791 conn(0x7f2f7006dc90 msgr2=0x7f2f70133e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f76423640 1 -- 172.21.15.81:0/1631569791 shutdown_connections 2024-09-10T16:30:17.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:17.486+0000 7f2f76423640 1 -- 172.21.15.81:0/1631569791 wait complete. 2024-09-10T16:30:17.506 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.5 2024-09-10T16:30:18.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-10T16:30:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient: get_monmap_and_config 2024-09-10T16:30:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient: build_initial_monmap 2024-09-10T16:30:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient: monmap: 2024-09-10T16:30:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:18.306272+0000 2024-09-10T16:30:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:18.306272+0000 2024-09-10T16:30:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:18.306 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:18.306 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:18.306 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 1 Processor -- start 2024-09-10T16:30:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 1 -- start start 2024-09-10T16:30:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient: init 2024-09-10T16:30:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient: _add_conns ranks=[8,7,6,3,0,4,2,5,1] 2024-09-10T16:30:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient(hunting): picked mon.noname-e con 0x7f887009ca10 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient(hunting): picked mon.noname-i con 0x7f88700a56e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient(hunting): picked mon.noname-d con 0x7f88700a5b00 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88701362b0 con 0x7f88700a5b00 2024-09-10T16:30:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88700a80b0 con 0x7f88700a56e0 2024-09-10T16:30:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f887009de70 con 0x7f887009ca10 2024-09-10T16:30:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient(hunting): authenticate will time out at 985.705753s 2024-09-10T16:30:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8876825640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f88700a5b00 0x7f8870141650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56174/0 (socket says 172.21.15.81:56174) 2024-09-10T16:30:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8876825640 1 -- 172.21.15.81:0/3921017099 learned_addr learned my addr 172.21.15.81:0/3921017099 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8876024640 1 --1- 172.21.15.81:0/3921017099 >> v1:172.21.15.81:6793/0 conn(0x7f887009ca10 0x7f8870135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35222/0 (socket says 172.21.15.81:35222) 2024-09-10T16:30:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 1 -- 172.21.15.81:0/3921017099 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2664425467 0 0) 0x7f88701362b0 con 0x7f88700a5b00 2024-09-10T16:30:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient(hunting): my global_id is 4344 2024-09-10T16:30:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 1 -- 172.21.15.81:0/3921017099 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8858003530 con 0x7f88700a5b00 2024-09-10T16:30:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 1 -- 172.21.15.81:0/3921017099 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4266601387 0 0) 0x7f887009de70 con 0x7f887009ca10 2024-09-10T16:30:18.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient(hunting): my global_id is 4301 2024-09-10T16:30:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 1 -- 172.21.15.81:0/3921017099 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f88701362b0 con 0x7f887009ca10 2024-09-10T16:30:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 1 -- 172.21.15.81:0/3921017099 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1546448683 0 0) 0x7f8858003530 con 0x7f88700a5b00 2024-09-10T16:30:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 1 -- 172.21.15.81:0/3921017099 >> v1:172.21.15.81:6793/0 conn(0x7f887009ca10 legacy=0x7f8870135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 1 -- 172.21.15.81:0/3921017099 >> v1:172.21.15.189:6792/0 conn(0x7f88700a56e0 legacy=0x7f887013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient: _finish_hunting 0 2024-09-10T16:30:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 1 monclient: found mon.noname-d 2024-09-10T16:30:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:30:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 1 -- 172.21.15.81:0/3921017099 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887009e150 con 0x7f88700a5b00 2024-09-10T16:30:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient: _finish_auth 0 2024-09-10T16:30:18.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient: _check_auth_tickets 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 1 -- 172.21.15.81:0/3921017099 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f8868001770 con 0x7f88700a5b00 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 5 monclient: authenticate success, global_id 4344 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient: dump: 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.314 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 1 -- 172.21.15.81:0/3921017099 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8868001910 con 0x7f88700a5b00 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 4 set_mon_vals no callback set 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 1 -- 172.21.15.81:0/3921017099 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f88680048b0 con 0x7f88700a5b00 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:18.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8875022640 10 monclient: dump: 2024-09-10T16:30:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.316 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.317 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient: shutdown 2024-09-10T16:30:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 1 -- 172.21.15.81:0/3921017099 >> v1:172.21.15.81:6792/0 conn(0x7f88700a5b00 legacy=0x7f8870141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 1 -- 172.21.15.81:0/3921017099 shutdown_connections 2024-09-10T16:30:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 1 -- 172.21.15.81:0/3921017099 >> 172.21.15.81:0/3921017099 conn(0x7f887006dc90 msgr2=0x7f88700ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 1 -- 172.21.15.81:0/3921017099 shutdown_connections 2024-09-10T16:30:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 1 -- 172.21.15.81:0/3921017099 wait complete. 2024-09-10T16:30:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient: build_initial_monmap 2024-09-10T16:30:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.302+0000 7f8878288640 10 monclient: monmap: 2024-09-10T16:30:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:18.317 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:18.318 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:18.318 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 1 Processor -- start 2024-09-10T16:30:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 1 -- start start 2024-09-10T16:30:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 monclient: init 2024-09-10T16:30:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 monclient: _add_conns ranks=[2,5,6,0,8,4,1,3,7] 2024-09-10T16:30:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 monclient(hunting): picked mon.noname-b con 0x7f887009ca10 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 monclient(hunting): picked mon.noname-h con 0x7f88700a56e0 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 monclient(hunting): picked mon.noname-d con 0x7f88700a5b00 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88700a0250 con 0x7f887009ca10 2024-09-10T16:30:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8870132670 con 0x7f88700a56e0 2024-09-10T16:30:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8870142a40 con 0x7f88700a5b00 2024-09-10T16:30:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:18.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 monclient(hunting): authenticate will time out at 985.708766s 2024-09-10T16:30:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8876825640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f88700a5b00 0x7f88701d5fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56182/0 (socket says 172.21.15.81:56182) 2024-09-10T16:30:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8876825640 1 -- 172.21.15.81:0/333533272 learned_addr learned my addr 172.21.15.81:0/333533272 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8876024640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f887009ca10 0x7f887009e670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38602/0 (socket says 172.21.15.81:38602) 2024-09-10T16:30:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687323988 0 0) 0x7f8870142a40 con 0x7f88700a5b00 2024-09-10T16:30:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): my global_id is 4353 2024-09-10T16:30:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f885c003530 con 0x7f88700a5b00 2024-09-10T16:30:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2445001409 0 0) 0x7f88700a0250 con 0x7f887009ca10 2024-09-10T16:30:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): my global_id is 4367 2024-09-10T16:30:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8870142a40 con 0x7f887009ca10 2024-09-10T16:30:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4192354841 0 0) 0x7f885c003530 con 0x7f88700a5b00 2024-09-10T16:30:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f88700a0250 con 0x7f88700a5b00 2024-09-10T16:30:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3057116482 0 0) 0x7f8870142a40 con 0x7f887009ca10 2024-09-10T16:30:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f885c003530 con 0x7f887009ca10 2024-09-10T16:30:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f8868001730 con 0x7f88700a5b00 2024-09-10T16:30:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): dump: 2024-09-10T16:30:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.321 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.322 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.322 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f8860001530 con 0x7f887009ca10 2024-09-10T16:30:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): dump: 2024-09-10T16:30:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.323 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.324 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3571337431 0 0) 0x7f8870132670 con 0x7f88700a56e0 2024-09-10T16:30:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient(hunting): my global_id is 4343 2024-09-10T16:30:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8870142a40 con 0x7f88700a56e0 2024-09-10T16:30:18.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3692813132 0 0) 0x7f885c003530 con 0x7f887009ca10 2024-09-10T16:30:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 >> v1:172.21.15.81:6792/0 conn(0x7f88700a5b00 legacy=0x7f88701d5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 >> v1:172.21.15.189:6791/0 conn(0x7f88700a56e0 legacy=0x7f887009ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 monclient: found mon.b 2024-09-10T16:30:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88700a0810 con 0x7f887009ca10 2024-09-10T16:30:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient: _finish_auth 0 2024-09-10T16:30:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 5 monclient: authenticate success, global_id 4367 2024-09-10T16:30:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 monclient: _renew_subs 2024-09-10T16:30:18.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 1 -- 172.21.15.81:0/333533272 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f88700a4700 con 0x7f887009ca10 2024-09-10T16:30:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 monclient: _renew_subs 2024-09-10T16:30:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 1 -- 172.21.15.81:0/333533272 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f887009f490 con 0x7f887009ca10 2024-09-10T16:30:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f88600018d0 con 0x7f887009ca10 2024-09-10T16:30:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f8860004de0 con 0x7f887009ca10 2024-09-10T16:30:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8874821640 4 set_mon_vals no callback set 2024-09-10T16:30:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 10 monclient: dump: 2024-09-10T16:30:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.326 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8878288640 1 -- 172.21.15.81:0/333533272 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8850005090 con 0x7f887009ca10 2024-09-10T16:30:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f8860010cf0 con 0x7f887009ca10 2024-09-10T16:30:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f886004acd0 con 0x7f887009ca10 2024-09-10T16:30:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.306+0000 7f8875823640 10 monclient: get_auth_request con 0x7f885c03d600 auth_method 0 2024-09-10T16:30:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.310+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f8860016b00 con 0x7f887009ca10 2024-09-10T16:30:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.310+0000 7f886effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.310+0000 7f886effd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:18.408 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-10T16:30:18.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-10T16:30:18.461 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-10T16:30:18.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-10T16:30:18.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.482+0000 7f8878288640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-10T16:30:18.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.482+0000 7f8878288640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-10T16:30:18.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.482+0000 7f8878288640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:18.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.482+0000 7f8878288640 1 -- 172.21.15.81:0/333533272 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8850005380 con 0x7f887009ca10 2024-09-10T16:30:18.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.482+0000 7f886effd640 1 -- 172.21.15.81:0/333533272 <== mon.2 v1:172.21.15.81:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (unknown 574334944 0 3056272221) 0x7f886001f250 con 0x7f887009ca10 2024-09-10T16:30:18.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.482+0000 7f886effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 0}] 2024-09-10T16:30:18.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.482+0000 7f886effd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:18.486 INFO:teuthology.orchestra.run.smithi081.stdout:55834574852 2024-09-10T16:30:18.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.482+0000 7f8878288640 1 -- 172.21.15.81:0/333533272 >> v1:172.21.15.189:6812/1108603242 conn(0x7f885c03d600 legacy=0x7f885c03fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.482+0000 7f8878288640 10 monclient: shutdown 2024-09-10T16:30:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.482+0000 7f8878288640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.482+0000 7f8878288640 1 -- 172.21.15.81:0/333533272 >> v1:172.21.15.81:6790/0 conn(0x7f887009ca10 legacy=0x7f887009e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.482+0000 7f8878288640 1 -- 172.21.15.81:0/333533272 shutdown_connections 2024-09-10T16:30:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.482+0000 7f8878288640 1 -- 172.21.15.81:0/333533272 >> 172.21.15.81:0/333533272 conn(0x7f887006dc90 msgr2=0x7f88700a82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.482+0000 7f8878288640 1 -- 172.21.15.81:0/333533272 shutdown_connections 2024-09-10T16:30:18.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.486+0000 7f8878288640 1 -- 172.21.15.81:0/333533272 wait complete. 2024-09-10T16:30:18.506 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-10T16:30:18.507 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.0 2024-09-10T16:30:18.508 DEBUG:teuthology.parallel:result is None 2024-09-10T16:30:18.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.514+0000 7f19f4a87640 10 monclient: get_monmap_and_config 2024-09-10T16:30:18.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.514+0000 7f19f4a87640 10 monclient: build_initial_monmap 2024-09-10T16:30:18.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.514+0000 7f19f4a87640 10 monclient: monmap: 2024-09-10T16:30:18.519 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:18.519 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.519 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:18.520932+0000 2024-09-10T16:30:18.519 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:18.520932+0000 2024-09-10T16:30:18.519 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:18.519 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.519 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:18.519 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:18.519 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:18.519 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:18.519 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:18.520 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:18.520 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:18.520 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:18.520 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:18.520 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.514+0000 7f19f4a87640 1 Processor -- start 2024-09-10T16:30:18.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.514+0000 7f19f4a87640 1 -- start start 2024-09-10T16:30:18.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.514+0000 7f19f4a87640 10 monclient: init 2024-09-10T16:30:18.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.514+0000 7f19f4a87640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:18.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.514+0000 7f19f4a87640 10 monclient: _add_conns ranks=[8,4,1,7,3,2,6,0,5] 2024-09-10T16:30:18.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.514+0000 7f19f4a87640 10 monclient(hunting): picked mon.noname-e con 0x7f19f009ca10 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:18.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient(hunting): picked mon.noname-c con 0x7f19f00a56e0 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:18.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient(hunting): picked mon.noname-f con 0x7f19f00a5b00 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:18.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19f01362b0 con 0x7f19f00a5b00 2024-09-10T16:30:18.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19f00a80b0 con 0x7f19f00a56e0 2024-09-10T16:30:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ee59c640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f19f009ca10 0x7f19f0135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35224/0 (socket says 172.21.15.81:35224) 2024-09-10T16:30:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ee59c640 1 -- 172.21.15.81:0/91972615 learned_addr learned my addr 172.21.15.81:0/91972615 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19edd9b640 1 --1- 172.21.15.81:0/91972615 >> v1:172.21.15.81:6791/0 conn(0x7f19f00a56e0 0x7f19f013df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34554/0 (socket says 172.21.15.81:34554) 2024-09-10T16:30:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 1 -- 172.21.15.81:0/91972615 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19f009de70 con 0x7f19f009ca10 2024-09-10T16:30:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient(hunting): authenticate will time out at 985.920449s 2024-09-10T16:30:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 1 -- 172.21.15.81:0/91972615 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1022484831 0 0) 0x7f19f009de70 con 0x7f19f009ca10 2024-09-10T16:30:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient(hunting): my global_id is 4310 2024-09-10T16:30:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 1 -- 172.21.15.81:0/91972615 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19d8003530 con 0x7f19f009ca10 2024-09-10T16:30:18.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 1 -- 172.21.15.81:0/91972615 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4239171863 0 0) 0x7f19f00a80b0 con 0x7f19f00a56e0 2024-09-10T16:30:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient(hunting): my global_id is 4387 2024-09-10T16:30:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 1 -- 172.21.15.81:0/91972615 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19f009de70 con 0x7f19f00a56e0 2024-09-10T16:30:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 1 -- 172.21.15.81:0/91972615 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 775412324 0 0) 0x7f19d8003530 con 0x7f19f009ca10 2024-09-10T16:30:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 1 -- 172.21.15.81:0/91972615 >> v1:172.21.15.81:6791/0 conn(0x7f19f00a56e0 legacy=0x7f19f013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 1 -- 172.21.15.81:0/91972615 >> v1:172.21.15.189:6789/0 conn(0x7f19f00a5b00 legacy=0x7f19f0141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient: _finish_hunting 0 2024-09-10T16:30:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 1 monclient: found mon.noname-e 2024-09-10T16:30:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:30:18.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 1 -- 172.21.15.81:0/91972615 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f009e150 con 0x7f19f009ca10 2024-09-10T16:30:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient: _finish_auth 0 2024-09-10T16:30:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient: _check_auth_tickets 2024-09-10T16:30:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 1 -- 172.21.15.81:0/91972615 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f19e0001840 con 0x7f19f009ca10 2024-09-10T16:30:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 5 monclient: authenticate success, global_id 4310 2024-09-10T16:30:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient: dump: 2024-09-10T16:30:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.527 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.528 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 1 -- 172.21.15.81:0/91972615 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f19e00019e0 con 0x7f19f009ca10 2024-09-10T16:30:18.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 1 -- 172.21.15.81:0/91972615 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f19e0001c50 con 0x7f19f009ca10 2024-09-10T16:30:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 4 set_mon_vals no callback set 2024-09-10T16:30:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19ed59a640 10 monclient: dump: 2024-09-10T16:30:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.529 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.530 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient: shutdown 2024-09-10T16:30:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 1 -- 172.21.15.81:0/91972615 >> v1:172.21.15.81:6793/0 conn(0x7f19f009ca10 legacy=0x7f19f0135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 1 -- 172.21.15.81:0/91972615 shutdown_connections 2024-09-10T16:30:18.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 1 -- 172.21.15.81:0/91972615 >> 172.21.15.81:0/91972615 conn(0x7f19f006dc90 msgr2=0x7f19f00ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 1 -- 172.21.15.81:0/91972615 shutdown_connections 2024-09-10T16:30:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 1 -- 172.21.15.81:0/91972615 wait complete. 2024-09-10T16:30:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient: build_initial_monmap 2024-09-10T16:30:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient: monmap: 2024-09-10T16:30:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:18.531 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:18.532 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 1 Processor -- start 2024-09-10T16:30:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 1 -- start start 2024-09-10T16:30:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient: init 2024-09-10T16:30:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient: _add_conns ranks=[5,3,0,7,4,1,8,6,2] 2024-09-10T16:30:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient(hunting): picked mon.noname-h con 0x7f19f009ca10 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:18.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient(hunting): picked mon.noname-g con 0x7f19f00a56e0 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient(hunting): picked mon.noname-a con 0x7f19f00a5b00 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19f00aa7c0 con 0x7f19f00a5b00 2024-09-10T16:30:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19f0132170 con 0x7f19f00a56e0 2024-09-10T16:30:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19f00aa270 con 0x7f19f009ca10 2024-09-10T16:30:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19f4a87640 10 monclient(hunting): authenticate will time out at 985.923778s 2024-09-10T16:30:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19eed9d640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f19f00a5b00 0x7f19f01d5fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43104/0 (socket says 172.21.15.81:43104) 2024-09-10T16:30:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.518+0000 7f19eed9d640 1 -- 172.21.15.81:0/2564962320 learned_addr learned my addr 172.21.15.81:0/2564962320 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3437488428 0 0) 0x7f19f01362b0 con 0x7f19f00a5b00 2024-09-10T16:30:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): my global_id is 4383 2024-09-10T16:30:18.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19d0003530 con 0x7f19f00a5b00 2024-09-10T16:30:18.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2761268200 0 0) 0x7f19d0003530 con 0x7f19f00a5b00 2024-09-10T16:30:18.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f19f01362b0 con 0x7f19f00a5b00 2024-09-10T16:30:18.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f19e8001e40 con 0x7f19f00a5b00 2024-09-10T16:30:18.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): dump: 2024-09-10T16:30:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.536 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.537 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.537 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.537 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.537 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.537 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:18.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521183101 0 0) 0x7f19f0132170 con 0x7f19f00a56e0 2024-09-10T16:30:18.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): my global_id is 4296 2024-09-10T16:30:18.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19d0003530 con 0x7f19f00a56e0 2024-09-10T16:30:18.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3497194812 0 0) 0x7f19f00aa270 con 0x7f19f009ca10 2024-09-10T16:30:18.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient(hunting): my global_id is 4352 2024-09-10T16:30:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19f0132170 con 0x7f19f009ca10 2024-09-10T16:30:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1361162633 0 0) 0x7f19f01362b0 con 0x7f19f00a5b00 2024-09-10T16:30:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 >> v1:172.21.15.189:6791/0 conn(0x7f19f009ca10 legacy=0x7f19f01421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 >> v1:172.21.15.189:6790/0 conn(0x7f19f00a56e0 legacy=0x7f19f01d2870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 monclient: found mon.a 2024-09-10T16:30:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19f01352c0 con 0x7f19f00a5b00 2024-09-10T16:30:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:18.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19f4a87640 5 monclient: authenticate success, global_id 4383 2024-09-10T16:30:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19f4a87640 10 monclient: _renew_subs 2024-09-10T16:30:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19f4a87640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19f4a87640 1 -- 172.21.15.81:0/2564962320 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f19f012fe10 con 0x7f19f00a5b00 2024-09-10T16:30:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19f4a87640 10 monclient: _renew_subs 2024-09-10T16:30:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19f4a87640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19f4a87640 1 -- 172.21.15.81:0/2564962320 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f19f0130b00 con 0x7f19f00a5b00 2024-09-10T16:30:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19f4a87640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19f4a87640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19f4a87640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19f4a87640 1 -- 172.21.15.81:0/2564962320 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19f00008e0 con 0x7f19f00a5b00 2024-09-10T16:30:18.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f19e8003c50 con 0x7f19f00a5b00 2024-09-10T16:30:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f19e80020d0 con 0x7f19f00a5b00 2024-09-10T16:30:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 10 monclient: dump: 2024-09-10T16:30:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.540 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.541 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f19e8004300 con 0x7f19f00a5b00 2024-09-10T16:30:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f19e804b220 con 0x7f19f00a5b00 2024-09-10T16:30:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.522+0000 7f19ecd99640 4 set_mon_vals no callback set 2024-09-10T16:30:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.526+0000 7f19ee59c640 10 monclient: get_auth_request con 0x7f19d0045a80 auth_method 0 2024-09-10T16:30:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.526+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f19f00aa7c0 con 0x7f19f00a5b00 2024-09-10T16:30:18.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.526+0000 7f19deffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.526+0000 7f19deffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:18.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.570+0000 7f6ea17d8640 10 monclient: get_monmap_and_config 2024-09-10T16:30:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.570+0000 7f6ea17d8640 10 monclient: build_initial_monmap 2024-09-10T16:30:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.570+0000 7f6ea17d8640 10 monclient: monmap: 2024-09-10T16:30:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:18.577867+0000 2024-09-10T16:30:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:18.577867+0000 2024-09-10T16:30:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:18.576 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:18.577 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:18.577 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 1 Processor -- start 2024-09-10T16:30:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 1 -- start start 2024-09-10T16:30:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 10 monclient: init 2024-09-10T16:30:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 10 monclient: _add_conns ranks=[4,3,1,2,7,8,6,5,0] 2024-09-10T16:30:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 10 monclient(hunting): picked mon.noname-c con 0x7f6e9c068960 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 10 monclient(hunting): picked mon.noname-g con 0x7f6e9c0a0950 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 10 monclient(hunting): picked mon.noname-f con 0x7f6e9c13f5c0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9c0a4200 con 0x7f6e9c13f5c0 2024-09-10T16:30:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9c0a3c20 con 0x7f6e9c0a0950 2024-09-10T16:30:18.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9c0a0ee0 con 0x7f6e9c068960 2024-09-10T16:30:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 10 monclient(hunting): authenticate will time out at 985.977084s 2024-09-10T16:30:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e9affd640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f6e9c068960 0x7f6e9c0a2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34566/0 (socket says 172.21.15.81:34566) 2024-09-10T16:30:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e9affd640 1 -- 172.21.15.81:0/1114419820 learned_addr learned my addr 172.21.15.81:0/1114419820 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 1 -- 172.21.15.81:0/1114419820 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3655722368 0 0) 0x7f6e9c0a0ee0 con 0x7f6e9c068960 2024-09-10T16:30:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient(hunting): my global_id is 4396 2024-09-10T16:30:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 1 -- 172.21.15.81:0/1114419820 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e84003530 con 0x7f6e9c068960 2024-09-10T16:30:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 1 -- 172.21.15.81:0/1114419820 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4129349003 0 0) 0x7f6e9c0a3c20 con 0x7f6e9c0a0950 2024-09-10T16:30:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient(hunting): my global_id is 4305 2024-09-10T16:30:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 1 -- 172.21.15.81:0/1114419820 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e9c0a0ee0 con 0x7f6e9c0a0950 2024-09-10T16:30:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 1 -- 172.21.15.81:0/1114419820 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3481586662 0 0) 0x7f6e84003530 con 0x7f6e9c068960 2024-09-10T16:30:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 1 -- 172.21.15.81:0/1114419820 >> v1:172.21.15.189:6790/0 conn(0x7f6e9c0a0950 legacy=0x7f6e9c0a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 1 -- 172.21.15.81:0/1114419820 >> v1:172.21.15.189:6789/0 conn(0x7f6e9c13f5c0 legacy=0x7f6e9c1419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:30:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 1 monclient: found mon.noname-c 2024-09-10T16:30:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:30:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 1 -- 172.21.15.81:0/1114419820 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9c0a4630 con 0x7f6e9c068960 2024-09-10T16:30:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient: _finish_auth 0 2024-09-10T16:30:18.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:30:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 1 -- 172.21.15.81:0/1114419820 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6e8c001840 con 0x7f6e9c068960 2024-09-10T16:30:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient: dump: 2024-09-10T16:30:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.583 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.584 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 5 monclient: authenticate success, global_id 4396 2024-09-10T16:30:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 1 -- 172.21.15.81:0/1114419820 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e8c0019e0 con 0x7f6e9c068960 2024-09-10T16:30:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:18.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 1 -- 172.21.15.81:0/1114419820 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6e8c004bf0 con 0x7f6e9c068960 2024-09-10T16:30:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 4 set_mon_vals no callback set 2024-09-10T16:30:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6e99ffb640 10 monclient: dump: 2024-09-10T16:30:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.585 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.586 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 10 monclient: shutdown 2024-09-10T16:30:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 1 -- 172.21.15.81:0/1114419820 >> v1:172.21.15.81:6791/0 conn(0x7f6e9c068960 legacy=0x7f6e9c0a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 1 -- 172.21.15.81:0/1114419820 shutdown_connections 2024-09-10T16:30:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 1 -- 172.21.15.81:0/1114419820 >> 172.21.15.81:0/1114419820 conn(0x7f6e9c0a85d0 msgr2=0x7f6e9c0a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:18.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 1 -- 172.21.15.81:0/1114419820 shutdown_connections 2024-09-10T16:30:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.574+0000 7f6ea17d8640 1 -- 172.21.15.81:0/1114419820 wait complete. 2024-09-10T16:30:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 monclient: build_initial_monmap 2024-09-10T16:30:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 monclient: monmap: 2024-09-10T16:30:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:18.587 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:18.588 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:18.588 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 1 Processor -- start 2024-09-10T16:30:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 1 -- start start 2024-09-10T16:30:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 monclient: init 2024-09-10T16:30:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 monclient: _add_conns ranks=[3,6,5,0,8,1,4,7,2] 2024-09-10T16:30:18.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 monclient(hunting): picked mon.noname-g con 0x7f6e9c068960 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:18.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 monclient(hunting): picked mon.noname-d con 0x7f6e9c0a0950 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:18.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 monclient(hunting): picked mon.noname-h con 0x7f6e9c13f5c0 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:18.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9c074d90 con 0x7f6e9c068960 2024-09-10T16:30:18.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e9a7fc640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f6e9c0a0950 0x7f6e9c0717e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56184/0 (socket says 172.21.15.81:56184) 2024-09-10T16:30:18.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e9a7fc640 1 -- 172.21.15.81:0/2920632670 learned_addr learned my addr 172.21.15.81:0/2920632670 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:18.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 1 -- 172.21.15.81:0/2920632670 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9c0735d0 con 0x7f6e9c13f5c0 2024-09-10T16:30:18.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 1 -- 172.21.15.81:0/2920632670 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e9c0738b0 con 0x7f6e9c0a0950 2024-09-10T16:30:18.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:18.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 monclient(hunting): authenticate will time out at 985.981916s 2024-09-10T16:30:18.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4104457997 0 0) 0x7f6e9c0738b0 con 0x7f6e9c0a0950 2024-09-10T16:30:18.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient(hunting): my global_id is 4362 2024-09-10T16:30:18.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e88003530 con 0x7f6e9c0a0950 2024-09-10T16:30:18.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2453632099 0 0) 0x7f6e88003530 con 0x7f6e9c0a0950 2024-09-10T16:30:18.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6e9c0738b0 con 0x7f6e9c0a0950 2024-09-10T16:30:18.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6e90001bc0 con 0x7f6e9c0a0950 2024-09-10T16:30:18.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:18.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:18.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient(hunting): dump: 2024-09-10T16:30:18.593 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.593 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.593 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.593 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.594 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.594 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.594 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.594 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.594 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.594 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.594 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.594 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.594 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.594 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.594 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.594 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:18.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1561800251 0 0) 0x7f6e9c074d90 con 0x7f6e9c068960 2024-09-10T16:30:18.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient(hunting): my global_id is 4314 2024-09-10T16:30:18.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e88003530 con 0x7f6e9c068960 2024-09-10T16:30:18.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1086014175 0 0) 0x7f6e9c0738b0 con 0x7f6e9c0a0950 2024-09-10T16:30:18.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 >> v1:172.21.15.189:6791/0 conn(0x7f6e9c13f5c0 legacy=0x7f6e9c1d6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 >> v1:172.21.15.189:6790/0 conn(0x7f6e9c068960 legacy=0x7f6e9c0710d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient: _finish_hunting 0 2024-09-10T16:30:18.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 monclient: found mon.d 2024-09-10T16:30:18.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:18.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:18.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9c071ef0 con 0x7f6e9c0a0950 2024-09-10T16:30:18.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient: _finish_auth 0 2024-09-10T16:30:18.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient: _check_auth_tickets 2024-09-10T16:30:18.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:18.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 5 monclient: authenticate success, global_id 4362 2024-09-10T16:30:18.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 monclient: _renew_subs 2024-09-10T16:30:18.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:18.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 1 -- 172.21.15.81:0/2920632670 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6e9c072230 con 0x7f6e9c0a0950 2024-09-10T16:30:18.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 monclient: _renew_subs 2024-09-10T16:30:18.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:18.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 1 -- 172.21.15.81:0/2920632670 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f6e9c09e930 con 0x7f6e9c0a0950 2024-09-10T16:30:18.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6e900038d0 con 0x7f6e9c0a0950 2024-09-10T16:30:18.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:18.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6e90003e40 con 0x7f6e9c0a0950 2024-09-10T16:30:18.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:18.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 10 monclient: dump: 2024-09-10T16:30:18.597 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.597 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.597 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.597 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.597 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.597 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.597 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.598 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.598 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.598 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.598 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.598 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.598 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.598 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.598 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.598 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6ea17d8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e997fa640 4 set_mon_vals no callback set 2024-09-10T16:30:18.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.578+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f6e900040a0 con 0x7f6e9c0a0950 2024-09-10T16:30:18.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.582+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f6e9004af10 con 0x7f6e9c0a0950 2024-09-10T16:30:18.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.582+0000 7f6ea17d8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.582+0000 7f6ea17d8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:18.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.582+0000 7f6ea17d8640 1 -- 172.21.15.81:0/2920632670 --> v1:172.21.15.81:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e9c0699f0 con 0x7f6e9c0a0950 2024-09-10T16:30:18.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.582+0000 7f6e9affd640 10 monclient: get_auth_request con 0x7f6e8803d110 auth_method 0 2024-09-10T16:30:18.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.586+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 <== mon.6 v1:172.21.15.81:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f6e90016e30 con 0x7f6e9c0a0950 2024-09-10T16:30:18.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.586+0000 7f6e837fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.586+0000 7f6e837fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.598+0000 7f3fd8b99640 10 monclient: get_monmap_and_config 2024-09-10T16:30:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.598+0000 7f3fd8b99640 10 monclient: build_initial_monmap 2024-09-10T16:30:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.598+0000 7f3fd8b99640 10 monclient: monmap: 2024-09-10T16:30:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:18.605363+0000 2024-09-10T16:30:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:18.605363+0000 2024-09-10T16:30:18.603 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:18.604 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:18.604 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.598+0000 7f3fd8b99640 1 Processor -- start 2024-09-10T16:30:18.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 1 -- start start 2024-09-10T16:30:18.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 10 monclient: init 2024-09-10T16:30:18.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:18.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 10 monclient: _add_conns ranks=[1,7,5,4,2,6,0,3,8] 2024-09-10T16:30:18.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 10 monclient(hunting): picked mon.noname-f con 0x7f3fd4068960 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:18.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 10 monclient(hunting): picked mon.noname-i con 0x7f3fd40a0950 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:18.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 10 monclient(hunting): picked mon.noname-h con 0x7f3fd413f5c0 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:18.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd40a4200 con 0x7f3fd4068960 2024-09-10T16:30:18.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd40a3c20 con 0x7f3fd413f5c0 2024-09-10T16:30:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd40a0ee0 con 0x7f3fd40a0950 2024-09-10T16:30:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 10 monclient(hunting): authenticate will time out at 986.004548s 2024-09-10T16:30:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd1d9b640 1 --1- >> v1:172.21.15.189:6792/0 conn(0x7f3fd40a0950 0x7f3fd40a3510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6792/0 says I am v1:172.21.15.81:43232/0 (socket says 172.21.15.81:43232) 2024-09-10T16:30:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd1d9b640 1 -- 172.21.15.81:0/3919476829 learned_addr learned my addr 172.21.15.81:0/3919476829 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 1 -- 172.21.15.81:0/3919476829 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3428949229 0 0) 0x7f3fd40a3c20 con 0x7f3fd413f5c0 2024-09-10T16:30:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient(hunting): my global_id is 4370 2024-09-10T16:30:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 1 -- 172.21.15.81:0/3919476829 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fbc003530 con 0x7f3fd413f5c0 2024-09-10T16:30:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 1 -- 172.21.15.81:0/3919476829 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3894082437 0 0) 0x7f3fd40a0ee0 con 0x7f3fd40a0950 2024-09-10T16:30:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient(hunting): my global_id is 4354 2024-09-10T16:30:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 1 -- 172.21.15.81:0/3919476829 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd40a3c20 con 0x7f3fd40a0950 2024-09-10T16:30:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 1 -- 172.21.15.81:0/3919476829 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1377858660 0 0) 0x7f3fd40a4200 con 0x7f3fd4068960 2024-09-10T16:30:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient(hunting): my global_id is 4348 2024-09-10T16:30:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 1 -- 172.21.15.81:0/3919476829 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd40a0ee0 con 0x7f3fd4068960 2024-09-10T16:30:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 1 -- 172.21.15.81:0/3919476829 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1481838083 0 0) 0x7f3fbc003530 con 0x7f3fd413f5c0 2024-09-10T16:30:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 1 -- 172.21.15.81:0/3919476829 >> v1:172.21.15.189:6792/0 conn(0x7f3fd40a0950 legacy=0x7f3fd40a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 1 -- 172.21.15.81:0/3919476829 >> v1:172.21.15.189:6789/0 conn(0x7f3fd4068960 legacy=0x7f3fd40a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient: _finish_hunting 0 2024-09-10T16:30:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 1 monclient: found mon.noname-h 2024-09-10T16:30:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.189:6791/0 2024-09-10T16:30:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 1 -- 172.21.15.81:0/3919476829 --> v1:172.21.15.189:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd40a4630 con 0x7f3fd413f5c0 2024-09-10T16:30:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient: _finish_auth 0 2024-09-10T16:30:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient: _check_auth_tickets 2024-09-10T16:30:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 1 -- 172.21.15.81:0/3919476829 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3fcc001af0 con 0x7f3fd413f5c0 2024-09-10T16:30:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-10T16:30:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient: dump: 2024-09-10T16:30:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.610 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 5 monclient: authenticate success, global_id 4370 2024-09-10T16:30:18.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 1 -- 172.21.15.81:0/3919476829 <== mon.5 v1:172.21.15.189:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3fcc001d10 con 0x7f3fd413f5c0 2024-09-10T16:30:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 1 -- 172.21.15.81:0/3919476829 <== mon.5 v1:172.21.15.189:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3fcc003ce0 con 0x7f3fd413f5c0 2024-09-10T16:30:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:30:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd159a640 10 monclient: dump: 2024-09-10T16:30:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.612 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.613 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 4 set_mon_vals no callback set 2024-09-10T16:30:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 10 monclient: shutdown 2024-09-10T16:30:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:18.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 1 -- 172.21.15.81:0/3919476829 >> v1:172.21.15.189:6791/0 conn(0x7f3fd413f5c0 legacy=0x7f3fd41419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 1 -- 172.21.15.81:0/3919476829 shutdown_connections 2024-09-10T16:30:18.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 1 -- 172.21.15.81:0/3919476829 >> 172.21.15.81:0/3919476829 conn(0x7f3fd40a85d0 msgr2=0x7f3fd40a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:18.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 1 -- 172.21.15.81:0/3919476829 shutdown_connections 2024-09-10T16:30:18.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.602+0000 7f3fd8b99640 1 -- 172.21.15.81:0/3919476829 wait complete. 2024-09-10T16:30:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 10 monclient: build_initial_monmap 2024-09-10T16:30:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 10 monclient: monmap: 2024-09-10T16:30:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:18.617 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 1 Processor -- start 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 1 -- start start 2024-09-10T16:30:18.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 10 monclient: init 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 10 monclient: _add_conns ranks=[2,1,3,4,8,5,6,0,7] 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 10 monclient(hunting): picked mon.noname-b con 0x7f3fd4068960 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 10 monclient(hunting): picked mon.noname-f con 0x7f3fd40a0950 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 10 monclient(hunting): picked mon.noname-g con 0x7f3fd413f5c0 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd413f3f0 con 0x7f3fd40a0950 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd4094860 con 0x7f3fd4068960 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fd40a6700 con 0x7f3fd413f5c0 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 10 monclient(hunting): authenticate will time out at 986.010277s 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd259c640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f3fd4068960 0x7f3fd413e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38606/0 (socket says 172.21.15.81:38606) 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd259c640 1 -- 172.21.15.81:0/1982717746 learned_addr learned my addr 172.21.15.81:0/1982717746 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1321727066 0 0) 0x7f3fd4094860 con 0x7f3fd4068960 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): my global_id is 4376 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fb4003530 con 0x7f3fd4068960 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2835407881 0 0) 0x7f3fd413f3f0 con 0x7f3fd40a0950 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): my global_id is 4357 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd4094860 con 0x7f3fd40a0950 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2487286522 0 0) 0x7f3fd40a6700 con 0x7f3fd413f5c0 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): my global_id is 4323 2024-09-10T16:30:18.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fd413f3f0 con 0x7f3fd413f5c0 2024-09-10T16:30:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2430322339 0 0) 0x7f3fb4003530 con 0x7f3fd4068960 2024-09-10T16:30:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fd40a6700 con 0x7f3fd4068960 2024-09-10T16:30:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3fc4001b20 con 0x7f3fd4068960 2024-09-10T16:30:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.621 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.622 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1352008893 0 0) 0x7f3fd40a6700 con 0x7f3fd4068960 2024-09-10T16:30:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 >> v1:172.21.15.189:6790/0 conn(0x7f3fd413f5c0 legacy=0x7f3fd41d6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 >> v1:172.21.15.189:6789/0 conn(0x7f3fd40a0950 legacy=0x7f3fd413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 monclient: found mon.b 2024-09-10T16:30:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fd4142dd0 con 0x7f3fd4068960 2024-09-10T16:30:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:18.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 5 monclient: authenticate success, global_id 4376 2024-09-10T16:30:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 10 monclient: _renew_subs 2024-09-10T16:30:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 1 -- 172.21.15.81:0/1982717746 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3fd4094580 con 0x7f3fd4068960 2024-09-10T16:30:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 10 monclient: _renew_subs 2024-09-10T16:30:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd8b99640 1 -- 172.21.15.81:0/1982717746 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f3fd40932c0 con 0x7f3fd4068960 2024-09-10T16:30:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3fc40038d0 con 0x7f3fd4068960 2024-09-10T16:30:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3fc4003ec0 con 0x7f3fd4068960 2024-09-10T16:30:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:18.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fc2ffd640 10 monclient: dump: 2024-09-10T16:30:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.626 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.627 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.606+0000 7f3fd0d99640 4 set_mon_vals no callback set 2024-09-10T16:30:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.610+0000 7f3fc0ff9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.610+0000 7f3fc0ff9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.610+0000 7f3fc0ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.610+0000 7f3fc0ff9640 1 -- 172.21.15.81:0/1982717746 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fac005090 con 0x7f3fd4068960 2024-09-10T16:30:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.610+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f3fc4004060 con 0x7f3fd4068960 2024-09-10T16:30:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.610+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f3fc404ada0 con 0x7f3fd4068960 2024-09-10T16:30:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.610+0000 7f3fd1d9b640 10 monclient: get_auth_request con 0x7f3fb403d330 auth_method 0 2024-09-10T16:30:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.614+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f3fc4016c30 con 0x7f3fd4068960 2024-09-10T16:30:18.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.614+0000 7f3fc2ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.614+0000 7f3fc2ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.618+0000 7f6151f89640 10 monclient: get_monmap_and_config 2024-09-10T16:30:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.618+0000 7f6151f89640 10 monclient: build_initial_monmap 2024-09-10T16:30:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.618+0000 7f6151f89640 10 monclient: monmap: 2024-09-10T16:30:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.632 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:18.624787+0000 2024-09-10T16:30:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:18.624787+0000 2024-09-10T16:30:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:18.633 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.618+0000 7f6151f89640 1 Processor -- start 2024-09-10T16:30:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.618+0000 7f6151f89640 1 -- start start 2024-09-10T16:30:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.618+0000 7f6151f89640 10 monclient: init 2024-09-10T16:30:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.618+0000 7f6151f89640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.618+0000 7f6151f89640 10 monclient: _add_conns ranks=[0,2,4,6,1,8,7,3,5] 2024-09-10T16:30:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.618+0000 7f6151f89640 10 monclient(hunting): picked mon.noname-a con 0x7f614c09e560 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.618+0000 7f6151f89640 10 monclient(hunting): picked mon.noname-b con 0x7f614c136ec0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 10 monclient(hunting): picked mon.noname-c con 0x7f614c13d490 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614c0a4200 con 0x7f614c09e560 2024-09-10T16:30:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614c0a44e0 con 0x7f614c136ec0 2024-09-10T16:30:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614bfff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f614c13d490 0x7f614c13f880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34580/0 (socket says 172.21.15.81:34580) 2024-09-10T16:30:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614bfff640 1 -- 172.21.15.81:0/1291824537 learned_addr learned my addr 172.21.15.81:0/1291824537 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 1 -- 172.21.15.81:0/1291824537 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614c0a47c0 con 0x7f614c13d490 2024-09-10T16:30:18.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 10 monclient(hunting): authenticate will time out at 986.024434s 2024-09-10T16:30:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 1 -- 172.21.15.81:0/1291824537 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3119877549 0 0) 0x7f614c0a4200 con 0x7f614c09e560 2024-09-10T16:30:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient(hunting): my global_id is 4392 2024-09-10T16:30:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 1 -- 172.21.15.81:0/1291824537 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6134003530 con 0x7f614c09e560 2024-09-10T16:30:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 1 -- 172.21.15.81:0/1291824537 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3781087045 0 0) 0x7f614c0a47c0 con 0x7f614c13d490 2024-09-10T16:30:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient(hunting): my global_id is 4405 2024-09-10T16:30:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 1 -- 172.21.15.81:0/1291824537 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61340048f0 con 0x7f614c13d490 2024-09-10T16:30:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 1 -- 172.21.15.81:0/1291824537 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 546128988 0 0) 0x7f614c0a44e0 con 0x7f614c136ec0 2024-09-10T16:30:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient(hunting): my global_id is 4385 2024-09-10T16:30:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 1 -- 172.21.15.81:0/1291824537 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f614c0a47c0 con 0x7f614c136ec0 2024-09-10T16:30:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 1 -- 172.21.15.81:0/1291824537 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1698866278 0 0) 0x7f61340048f0 con 0x7f614c13d490 2024-09-10T16:30:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 1 -- 172.21.15.81:0/1291824537 >> v1:172.21.15.81:6790/0 conn(0x7f614c136ec0 legacy=0x7f614c13bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 1 -- 172.21.15.81:0/1291824537 >> v1:172.21.15.81:6789/0 conn(0x7f614c09e560 legacy=0x7f614c09e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:30:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 1 monclient: found mon.noname-c 2024-09-10T16:30:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:30:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 1 -- 172.21.15.81:0/1291824537 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c1372e0 con 0x7f614c13d490 2024-09-10T16:30:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient: _finish_auth 0 2024-09-10T16:30:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:30:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 1 -- 172.21.15.81:0/1291824537 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6144001ba0 con 0x7f614c13d490 2024-09-10T16:30:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient: dump: 2024-09-10T16:30:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.637 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 5 monclient: authenticate success, global_id 4405 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 1 -- 172.21.15.81:0/1291824537 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6144001d40 con 0x7f614c13d490 2024-09-10T16:30:18.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 1 -- 172.21.15.81:0/1291824537 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6144002030 con 0x7f614c13d490 2024-09-10T16:30:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f614a7fc640 10 monclient: dump: 2024-09-10T16:30:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.639 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.640 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.640 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.640 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.640 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.640 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.640 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.640 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:18.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 4 set_mon_vals no callback set 2024-09-10T16:30:18.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 10 monclient: shutdown 2024-09-10T16:30:18.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:18.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 1 -- 172.21.15.81:0/1291824537 >> v1:172.21.15.81:6791/0 conn(0x7f614c13d490 legacy=0x7f614c13f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 1 -- 172.21.15.81:0/1291824537 shutdown_connections 2024-09-10T16:30:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 1 -- 172.21.15.81:0/1291824537 >> 172.21.15.81:0/1291824537 conn(0x7f614c0a85d0 msgr2=0x7f614c0a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 1 -- 172.21.15.81:0/1291824537 shutdown_connections 2024-09-10T16:30:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 1 -- 172.21.15.81:0/1291824537 wait complete. 2024-09-10T16:30:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 10 monclient: build_initial_monmap 2024-09-10T16:30:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 10 monclient: monmap: 2024-09-10T16:30:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:18.641 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:18.642 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 1 Processor -- start 2024-09-10T16:30:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.622+0000 7f6151f89640 1 -- start start 2024-09-10T16:30:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 monclient: init 2024-09-10T16:30:18.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 monclient: _add_conns ranks=[1,7,6,8,3,5,2,4,0] 2024-09-10T16:30:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 monclient(hunting): picked mon.noname-f con 0x7f614c09e560 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 monclient(hunting): picked mon.noname-i con 0x7f614c136ec0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 monclient(hunting): picked mon.noname-d con 0x7f614c13d490 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614c0a8ee0 con 0x7f614c09e560 2024-09-10T16:30:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614c0a89b0 con 0x7f614c13d490 2024-09-10T16:30:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f614c13ba00 con 0x7f614c136ec0 2024-09-10T16:30:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 monclient(hunting): authenticate will time out at 986.028699s 2024-09-10T16:30:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f614bfff640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f614c13d490 0x7f614c1d1f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56190/0 (socket says 172.21.15.81:56190) 2024-09-10T16:30:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f614bfff640 1 -- 172.21.15.81:0/4221314384 learned_addr learned my addr 172.21.15.81:0/4221314384 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3113052513 0 0) 0x7f614c0a89b0 con 0x7f614c13d490 2024-09-10T16:30:18.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): my global_id is 4371 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6138003530 con 0x7f614c13d490 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 583499759 0 0) 0x7f6138003530 con 0x7f614c13d490 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f614c0a89b0 con 0x7f614c13d490 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6144004b70 con 0x7f614c13d490 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): dump: 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.644 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301617554 0 0) 0x7f614c13ba00 con 0x7f614c136ec0 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): my global_id is 4363 2024-09-10T16:30:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6138003530 con 0x7f614c136ec0 2024-09-10T16:30:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 27378670 0 0) 0x7f614c0a8ee0 con 0x7f614c09e560 2024-09-10T16:30:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient(hunting): my global_id is 4366 2024-09-10T16:30:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f614c13ba00 con 0x7f614c09e560 2024-09-10T16:30:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1246120237 0 0) 0x7f614c0a89b0 con 0x7f614c13d490 2024-09-10T16:30:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 >> v1:172.21.15.189:6792/0 conn(0x7f614c136ec0 legacy=0x7f614c1ce830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 >> v1:172.21.15.189:6789/0 conn(0x7f614c09e560 legacy=0x7f614c1c9850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient: _finish_hunting 0 2024-09-10T16:30:18.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 monclient: found mon.d 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f614c13bce0 con 0x7f614c13d490 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient: _finish_auth 0 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient: _check_auth_tickets 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 5 monclient: authenticate success, global_id 4371 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 monclient: _renew_subs 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 1 -- 172.21.15.81:0/4221314384 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f614c13aaa0 con 0x7f614c13d490 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 monclient: _renew_subs 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 1 -- 172.21.15.81:0/4221314384 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f614c1398f0 con 0x7f614c13d490 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6151f89640 1 -- 172.21.15.81:0/4221314384 --> v1:172.21.15.81:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f614c13c970 con 0x7f614c13d490 2024-09-10T16:30:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6144001ca0 con 0x7f614c13d490 2024-09-10T16:30:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6144005300 con 0x7f614c13d490 2024-09-10T16:30:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 10 monclient: dump: 2024-09-10T16:30:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.648 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.649 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6149ffb640 4 set_mon_vals no callback set 2024-09-10T16:30:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f6144005560 con 0x7f614c13d490 2024-09-10T16:30:18.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.626+0000 7f614b7fe640 10 monclient: get_auth_request con 0x7f613803d2a0 auth_method 0 2024-09-10T16:30:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.638+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f6144016ce0 con 0x7f614c13d490 2024-09-10T16:30:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.638+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 <== mon.6 v1:172.21.15.81:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f6144017180 con 0x7f614c13d490 2024-09-10T16:30:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.638+0000 7f6133fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.638+0000 7f6133fff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.678+0000 7fad5c61b640 10 monclient: get_monmap_and_config 2024-09-10T16:30:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.678+0000 7fad5c61b640 10 monclient: build_initial_monmap 2024-09-10T16:30:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.678+0000 7fad5c61b640 10 monclient: monmap: 2024-09-10T16:30:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:18.684929+0000 2024-09-10T16:30:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:18.684929+0000 2024-09-10T16:30:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:18.683 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:18.684 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:18.684 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:18.684 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:18.684 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:18.684 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:18.684 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:18.684 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.678+0000 7fad5c61b640 1 Processor -- start 2024-09-10T16:30:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.678+0000 7fad5c61b640 1 -- start start 2024-09-10T16:30:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.678+0000 7fad5c61b640 10 monclient: init 2024-09-10T16:30:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 10 monclient: _add_conns ranks=[2,4,0,6,7,8,1,3,5] 2024-09-10T16:30:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 10 monclient(hunting): picked mon.noname-b con 0x7fad54068960 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 10 monclient(hunting): picked mon.noname-c con 0x7fad540a0950 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad59bb6640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fad540a0950 0x7fad540a3510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34592/0 (socket says 172.21.15.81:34592) 2024-09-10T16:30:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5abb8640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fad5413f5c0 0x7fad541419b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43128/0 (socket says 172.21.15.81:43128) 2024-09-10T16:30:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 10 monclient(hunting): picked mon.noname-a con 0x7fad5413f5c0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad59bb6640 1 -- 172.21.15.81:0/981871488 learned_addr learned my addr 172.21.15.81:0/981871488 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 1 -- 172.21.15.81:0/981871488 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad540a4200 con 0x7fad5413f5c0 2024-09-10T16:30:18.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 1 -- 172.21.15.81:0/981871488 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad540a3c20 con 0x7fad54068960 2024-09-10T16:30:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 1 -- 172.21.15.81:0/981871488 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad540a0ee0 con 0x7fad540a0950 2024-09-10T16:30:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 10 monclient(hunting): authenticate will time out at 986.085186s 2024-09-10T16:30:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 1 -- 172.21.15.81:0/981871488 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3983269373 0 0) 0x7fad540a4200 con 0x7fad5413f5c0 2024-09-10T16:30:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient(hunting): my global_id is 4401 2024-09-10T16:30:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 1 -- 172.21.15.81:0/981871488 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad40003530 con 0x7fad5413f5c0 2024-09-10T16:30:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 1 -- 172.21.15.81:0/981871488 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3915167624 0 0) 0x7fad540a0ee0 con 0x7fad540a0950 2024-09-10T16:30:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient(hunting): my global_id is 4414 2024-09-10T16:30:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 1 -- 172.21.15.81:0/981871488 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad540a4200 con 0x7fad540a0950 2024-09-10T16:30:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 1 -- 172.21.15.81:0/981871488 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1981672286 0 0) 0x7fad540a3c20 con 0x7fad54068960 2024-09-10T16:30:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient(hunting): my global_id is 4394 2024-09-10T16:30:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 1 -- 172.21.15.81:0/981871488 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad540a0ee0 con 0x7fad54068960 2024-09-10T16:30:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 1 -- 172.21.15.81:0/981871488 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 31742570 0 0) 0x7fad40003530 con 0x7fad5413f5c0 2024-09-10T16:30:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 1 -- 172.21.15.81:0/981871488 >> v1:172.21.15.81:6791/0 conn(0x7fad540a0950 legacy=0x7fad540a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 1 -- 172.21.15.81:0/981871488 >> v1:172.21.15.81:6790/0 conn(0x7fad54068960 legacy=0x7fad540a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient: _finish_hunting 0 2024-09-10T16:30:18.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 1 monclient: found mon.noname-a 2024-09-10T16:30:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:30:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 1 -- 172.21.15.81:0/981871488 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad540a4630 con 0x7fad5413f5c0 2024-09-10T16:30:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient: _finish_auth 0 2024-09-10T16:30:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient: _check_auth_tickets 2024-09-10T16:30:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 1 -- 172.21.15.81:0/981871488 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fad4c001bc0 con 0x7fad5413f5c0 2024-09-10T16:30:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient: dump: 2024-09-10T16:30:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.690 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.691 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.691 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 1 -- 172.21.15.81:0/981871488 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad4c001d60 con 0x7fad5413f5c0 2024-09-10T16:30:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 5 monclient: authenticate success, global_id 4401 2024-09-10T16:30:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 1 -- 172.21.15.81:0/981871488 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fad4c004eb0 con 0x7fad5413f5c0 2024-09-10T16:30:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 4 set_mon_vals no callback set 2024-09-10T16:30:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad593b5640 10 monclient: dump: 2024-09-10T16:30:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.692 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.693 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.693 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 10 monclient: shutdown 2024-09-10T16:30:18.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:18.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 1 -- 172.21.15.81:0/981871488 >> v1:172.21.15.81:6789/0 conn(0x7fad5413f5c0 legacy=0x7fad541419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 1 -- 172.21.15.81:0/981871488 shutdown_connections 2024-09-10T16:30:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 1 -- 172.21.15.81:0/981871488 >> 172.21.15.81:0/981871488 conn(0x7fad540a85d0 msgr2=0x7fad540a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 1 -- 172.21.15.81:0/981871488 shutdown_connections 2024-09-10T16:30:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.682+0000 7fad5c61b640 1 -- 172.21.15.81:0/981871488 wait complete. 2024-09-10T16:30:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 monclient: build_initial_monmap 2024-09-10T16:30:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 monclient: monmap: 2024-09-10T16:30:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:18.697 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 1 Processor -- start 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 1 -- start start 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 monclient: init 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 monclient: _add_conns ranks=[8,1,7,6,2,0,3,4,5] 2024-09-10T16:30:18.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 monclient(hunting): picked mon.noname-e con 0x7fad54068960 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 monclient(hunting): picked mon.noname-f con 0x7fad540a0950 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 monclient(hunting): picked mon.noname-i con 0x7fad5413f5c0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad5413f3f0 con 0x7fad540a0950 2024-09-10T16:30:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad54142df0 con 0x7fad5413f5c0 2024-09-10T16:30:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad54094820 con 0x7fad54068960 2024-09-10T16:30:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 monclient(hunting): authenticate will time out at 986.089769s 2024-09-10T16:30:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5a3b7640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fad54068960 0x7fad5413e5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35228/0 (socket says 172.21.15.81:35228) 2024-09-10T16:30:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5a3b7640 1 -- 172.21.15.81:0/1834939432 learned_addr learned my addr 172.21.15.81:0/1834939432 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2678564628 0 0) 0x7fad54094820 con 0x7fad54068960 2024-09-10T16:30:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): my global_id is 4319 2024-09-10T16:30:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad38003560 con 0x7fad54068960 2024-09-10T16:30:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4134752090 0 0) 0x7fad38003560 con 0x7fad54068960 2024-09-10T16:30:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fad54094820 con 0x7fad54068960 2024-09-10T16:30:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fad50001ac0 con 0x7fad54068960 2024-09-10T16:30:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): dump: 2024-09-10T16:30:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.700 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.701 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 175918205 0 0) 0x7fad540a4630 con 0x7fad5413f5c0 2024-09-10T16:30:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): my global_id is 4372 2024-09-10T16:30:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad38003560 con 0x7fad5413f5c0 2024-09-10T16:30:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2637088979 0 0) 0x7fad5413f3f0 con 0x7fad540a0950 2024-09-10T16:30:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient(hunting): my global_id is 4375 2024-09-10T16:30:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fad540a4630 con 0x7fad540a0950 2024-09-10T16:30:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3533438314 0 0) 0x7fad54094820 con 0x7fad54068960 2024-09-10T16:30:18.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 >> v1:172.21.15.189:6792/0 conn(0x7fad5413f5c0 legacy=0x7fad541d6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 >> v1:172.21.15.189:6789/0 conn(0x7fad540a0950 legacy=0x7fad5413ece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 monclient: found mon.e 2024-09-10T16:30:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad540a6d50 con 0x7fad54068960 2024-09-10T16:30:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient: _finish_auth 0 2024-09-10T16:30:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 5 monclient: authenticate success, global_id 4319 2024-09-10T16:30:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 monclient: _renew_subs 2024-09-10T16:30:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:18.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 1 -- 172.21.15.81:0/1834939432 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fad540a6800 con 0x7fad54068960 2024-09-10T16:30:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 monclient: _renew_subs 2024-09-10T16:30:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 1 -- 172.21.15.81:0/1834939432 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fad540749e0 con 0x7fad54068960 2024-09-10T16:30:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fad500038d0 con 0x7fad54068960 2024-09-10T16:30:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fad50003ec0 con 0x7fad54068960 2024-09-10T16:30:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad4affd640 10 monclient: dump: 2024-09-10T16:30:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:18.705 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad58bb4640 4 set_mon_vals no callback set 2024-09-10T16:30:18.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.686+0000 7fad5c61b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.690+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fad50004120 con 0x7fad54068960 2024-09-10T16:30:18.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.690+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7fad5004add0 con 0x7fad54068960 2024-09-10T16:30:18.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.690+0000 7fad5c61b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.690+0000 7fad5c61b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:18.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.690+0000 7fad5c61b640 1 -- 172.21.15.81:0/1834939432 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad540699f0 con 0x7fad54068960 2024-09-10T16:30:18.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.690+0000 7fad59bb6640 10 monclient: get_auth_request con 0x7fad3803d240 auth_method 0 2024-09-10T16:30:18.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.698+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 <== mon.8 v1:172.21.15.81:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7fad50016c60 con 0x7fad54068960 2024-09-10T16:30:18.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.698+0000 7fad4affd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:18.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.698+0000 7fad4affd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.770+0000 7f6ea17d8640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-10T16:30:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.770+0000 7f6ea17d8640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-10T16:30:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.770+0000 7f6ea17d8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.770+0000 7f6ea17d8640 1 -- 172.21.15.81:0/2920632670 --> v1:172.21.15.81:6792/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f6e9c074290 con 0x7f6e9c0a0950 2024-09-10T16:30:18.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.770+0000 7f6e837fe640 1 -- 172.21.15.81:0/2920632670 <== mon.6 v1:172.21.15.81:6792/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (unknown 383520633 0 3056272221) 0x7f6e9c074290 con 0x7f6e9c0a0950 2024-09-10T16:30:18.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.770+0000 7f6e837fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 3}] 2024-09-10T16:30:18.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.770+0000 7f6e837fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:18.775 INFO:teuthology.orchestra.run.smithi081.stdout:55834574852 2024-09-10T16:30:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.774+0000 7f6ea17d8640 1 -- 172.21.15.81:0/2920632670 >> v1:172.21.15.189:6812/1108603242 conn(0x7f6e8803d110 legacy=0x7f6e8803f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.774+0000 7f6ea17d8640 10 monclient: shutdown 2024-09-10T16:30:18.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.774+0000 7f6ea17d8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:18.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.774+0000 7f6ea17d8640 1 -- 172.21.15.81:0/2920632670 >> v1:172.21.15.81:6792/0 conn(0x7f6e9c0a0950 legacy=0x7f6e9c0717e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.774+0000 7f6ea17d8640 1 -- 172.21.15.81:0/2920632670 shutdown_connections 2024-09-10T16:30:18.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.774+0000 7f6ea17d8640 1 -- 172.21.15.81:0/2920632670 >> 172.21.15.81:0/2920632670 conn(0x7f6e9c0a85d0 msgr2=0x7f6e9c0a4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:18.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.774+0000 7f6ea17d8640 1 -- 172.21.15.81:0/2920632670 shutdown_connections 2024-09-10T16:30:18.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.774+0000 7f6ea17d8640 1 -- 172.21.15.81:0/2920632670 wait complete. 2024-09-10T16:30:18.791 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2024-09-10T16:30:18.792 DEBUG:teuthology.parallel:result is None 2024-09-10T16:30:18.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.786+0000 7f3fc0ff9640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-10T16:30:18.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.786+0000 7f3fc0ff9640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-10T16:30:18.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.786+0000 7f3fc0ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:18.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.786+0000 7f3fc0ff9640 1 -- 172.21.15.81:0/1982717746 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f3fac005380 con 0x7f3fd4068960 2024-09-10T16:30:18.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.790+0000 7f3fc2ffd640 1 -- 172.21.15.81:0/1982717746 <== mon.2 v1:172.21.15.81:6790/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (unknown 92182286 0 2194451396) 0x7f3fc401f320 con 0x7f3fd4068960 2024-09-10T16:30:18.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.790+0000 7f3fc2ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 2}] 2024-09-10T16:30:18.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.790+0000 7f3fc2ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:18.793 INFO:teuthology.orchestra.run.smithi081.stdout:55834574851 2024-09-10T16:30:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.790+0000 7f3fc0ff9640 1 -- 172.21.15.81:0/1982717746 >> v1:172.21.15.189:6812/1108603242 conn(0x7f3fb403d330 legacy=0x7f3fb403f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.790+0000 7f3fc0ff9640 10 monclient: shutdown 2024-09-10T16:30:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.790+0000 7f3fc0ff9640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:18.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.790+0000 7f3fc0ff9640 1 -- 172.21.15.81:0/1982717746 >> v1:172.21.15.81:6790/0 conn(0x7f3fd4068960 legacy=0x7f3fd413e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.790+0000 7f3fc0ff9640 1 -- 172.21.15.81:0/1982717746 shutdown_connections 2024-09-10T16:30:18.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.790+0000 7f3fc0ff9640 1 -- 172.21.15.81:0/1982717746 >> 172.21.15.81:0/1982717746 conn(0x7f3fd40a85d0 msgr2=0x7f3fd4141ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:18.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.790+0000 7f3fc0ff9640 1 -- 172.21.15.81:0/1982717746 shutdown_connections 2024-09-10T16:30:18.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.790+0000 7f3fc0ff9640 1 -- 172.21.15.81:0/1982717746 wait complete. 2024-09-10T16:30:18.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574851 got 55834574851 for osd.2 2024-09-10T16:30:18.809 DEBUG:teuthology.parallel:result is None 2024-09-10T16:30:18.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.810+0000 7f6151f89640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-10T16:30:18.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.810+0000 7f6151f89640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-10T16:30:18.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.810+0000 7f6151f89640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:18.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.810+0000 7f6151f89640 1 -- 172.21.15.81:0/4221314384 --> v1:172.21.15.81:6792/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f614c06e990 con 0x7f614c13d490 2024-09-10T16:30:18.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.810+0000 7f6133fff640 1 -- 172.21.15.81:0/4221314384 <== mon.6 v1:172.21.15.81:6792/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (unknown 832126871 0 1902013079) 0x7f6144016a80 con 0x7f614c13d490 2024-09-10T16:30:18.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.810+0000 7f6133fff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 1}] 2024-09-10T16:30:18.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.810+0000 7f6133fff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:18.814 INFO:teuthology.orchestra.run.smithi081.stdout:47244640262 2024-09-10T16:30:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.810+0000 7f6151f89640 1 -- 172.21.15.81:0/4221314384 >> v1:172.21.15.189:6812/1108603242 conn(0x7f613803d2a0 legacy=0x7f613803f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.810+0000 7f6151f89640 10 monclient: shutdown 2024-09-10T16:30:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.810+0000 7f6151f89640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.810+0000 7f6151f89640 1 -- 172.21.15.81:0/4221314384 >> v1:172.21.15.81:6792/0 conn(0x7f614c13d490 legacy=0x7f614c1d1f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.810+0000 7f6151f89640 1 -- 172.21.15.81:0/4221314384 shutdown_connections 2024-09-10T16:30:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.810+0000 7f6151f89640 1 -- 172.21.15.81:0/4221314384 >> 172.21.15.81:0/4221314384 conn(0x7f614c0a85d0 msgr2=0x7f614c09ce40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.810+0000 7f6151f89640 1 -- 172.21.15.81:0/4221314384 shutdown_connections 2024-09-10T16:30:18.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.814+0000 7f6151f89640 1 -- 172.21.15.81:0/4221314384 wait complete. 2024-09-10T16:30:18.830 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640262 for osd.1 2024-09-10T16:30:18.830 DEBUG:teuthology.parallel:result is None 2024-09-10T16:30:18.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.834+0000 7f19f4a87640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-10T16:30:18.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.834+0000 7f19f4a87640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-10T16:30:18.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.834+0000 7f19f4a87640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:18.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.834+0000 7f19f4a87640 1 -- 172.21.15.81:0/2564962320 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f19f0131930 con 0x7f19f00a5b00 2024-09-10T16:30:18.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.834+0000 7f19deffd640 1 -- 172.21.15.81:0/2564962320 <== mon.0 v1:172.21.15.81:6789/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (unknown 1823589948 0 3056272221) 0x7f19e8017190 con 0x7f19f00a5b00 2024-09-10T16:30:18.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.834+0000 7f19deffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 4}] 2024-09-10T16:30:18.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.834+0000 7f19deffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:18.838 INFO:teuthology.orchestra.run.smithi081.stdout:55834574852 2024-09-10T16:30:18.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.834+0000 7f19f4a87640 1 -- 172.21.15.81:0/2564962320 >> v1:172.21.15.189:6812/1108603242 conn(0x7f19d0045a80 legacy=0x7f19d0047f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.834+0000 7f19f4a87640 10 monclient: shutdown 2024-09-10T16:30:18.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.834+0000 7f19f4a87640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:18.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.834+0000 7f19f4a87640 1 -- 172.21.15.81:0/2564962320 >> v1:172.21.15.81:6789/0 conn(0x7f19f00a5b00 legacy=0x7f19f01d5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.838+0000 7f19f4a87640 1 -- 172.21.15.81:0/2564962320 shutdown_connections 2024-09-10T16:30:18.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.838+0000 7f19f4a87640 1 -- 172.21.15.81:0/2564962320 >> 172.21.15.81:0/2564962320 conn(0x7f19f006dc90 msgr2=0x7f19f00a82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.838+0000 7f19f4a87640 1 -- 172.21.15.81:0/2564962320 shutdown_connections 2024-09-10T16:30:18.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.838+0000 7f19f4a87640 1 -- 172.21.15.81:0/2564962320 wait complete. 2024-09-10T16:30:18.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.4 2024-09-10T16:30:18.854 DEBUG:teuthology.parallel:result is None 2024-09-10T16:30:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.922+0000 7fad5c61b640 10 start_mon_command cmd=[{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-10T16:30:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.922+0000 7fad5c61b640 10 monclient: _send_command 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-10T16:30:18.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.922+0000 7fad5c61b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.922+0000 7fad5c61b640 1 -- 172.21.15.81:0/1834939432 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fad540939b0 con 0x7fad54068960 2024-09-10T16:30:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.922+0000 7fad4affd640 1 -- 172.21.15.81:0/1834939432 <== mon.8 v1:172.21.15.81:6793/0 10 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (unknown 2131975755 0 3756282479) 0x7fad5001f350 con 0x7fad54068960 2024-09-10T16:30:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.922+0000 7fad4affd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd last-stat-seq", "id": 5}] 2024-09-10T16:30:18.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.922+0000 7fad4affd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:18.928 INFO:teuthology.orchestra.run.smithi081.stdout:55834574854 2024-09-10T16:30:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.926+0000 7fad5c61b640 1 -- 172.21.15.81:0/1834939432 >> v1:172.21.15.189:6812/1108603242 conn(0x7fad3803d240 legacy=0x7fad3803f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.926+0000 7fad5c61b640 10 monclient: shutdown 2024-09-10T16:30:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.926+0000 7fad5c61b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.926+0000 7fad5c61b640 1 -- 172.21.15.81:0/1834939432 >> v1:172.21.15.81:6793/0 conn(0x7fad54068960 legacy=0x7fad5413e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.926+0000 7fad5c61b640 1 -- 172.21.15.81:0/1834939432 shutdown_connections 2024-09-10T16:30:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.926+0000 7fad5c61b640 1 -- 172.21.15.81:0/1834939432 >> 172.21.15.81:0/1834939432 conn(0x7fad540a85d0 msgr2=0x7fad5413f9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.926+0000 7fad5c61b640 1 -- 172.21.15.81:0/1834939432 shutdown_connections 2024-09-10T16:30:18.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:18.926+0000 7fad5c61b640 1 -- 172.21.15.81:0/1834939432 wait complete. 2024-09-10T16:30:18.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.5 2024-09-10T16:30:18.944 DEBUG:teuthology.parallel:result is None 2024-09-10T16:30:18.944 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T16:30:18.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T16:30:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 10 monclient: get_monmap_and_config 2024-09-10T16:30:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 10 monclient: build_initial_monmap 2024-09-10T16:30:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 10 monclient: monmap: 2024-09-10T16:30:19.054 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:19.056409+0000 2024-09-10T16:30:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:19.056409+0000 2024-09-10T16:30:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:19.055 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:19.056 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:19.056 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:19.056 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 1 Processor -- start 2024-09-10T16:30:19.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 1 -- start start 2024-09-10T16:30:19.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 10 monclient: init 2024-09-10T16:30:19.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:19.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 10 monclient: _add_conns ranks=[0,1,5,7,4,3,6,2,8] 2024-09-10T16:30:19.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 10 monclient(hunting): picked mon.noname-a con 0x7f82f409e9d0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:19.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 10 monclient(hunting): picked mon.noname-f con 0x7f82f409f4c0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:19.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 10 monclient(hunting): picked mon.noname-h con 0x7f82f413bf80 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f409fd40 con 0x7f82f409e9d0 2024-09-10T16:30:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f40a01c0 con 0x7f82f409f4c0 2024-09-10T16:30:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f409fb00 con 0x7f82f413bf80 2024-09-10T16:30:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82faaa5640 10 monclient(hunting): authenticate will time out at 986.455741s 2024-09-10T16:30:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82f8841640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f82f409e9d0 0x7f82f409edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43130/0 (socket says 172.21.15.81:43130) 2024-09-10T16:30:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.050+0000 7f82f8841640 1 -- 172.21.15.81:0/2977716458 learned_addr learned my addr 172.21.15.81:0/2977716458 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 1 -- 172.21.15.81:0/2977716458 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3890830031 0 0) 0x7f82f409fd40 con 0x7f82f409e9d0 2024-09-10T16:30:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient(hunting): my global_id is 4410 2024-09-10T16:30:19.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 1 -- 172.21.15.81:0/2977716458 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82dc003450 con 0x7f82f409e9d0 2024-09-10T16:30:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 1 -- 172.21.15.81:0/2977716458 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 351600551 0 0) 0x7f82dc003450 con 0x7f82f409e9d0 2024-09-10T16:30:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 1 -- 172.21.15.81:0/2977716458 >> v1:172.21.15.189:6791/0 conn(0x7f82f413bf80 legacy=0x7f82f413e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 1 -- 172.21.15.81:0/2977716458 >> v1:172.21.15.189:6789/0 conn(0x7f82f409f4c0 legacy=0x7f82f413a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient: _finish_hunting 0 2024-09-10T16:30:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 1 monclient: found mon.noname-a 2024-09-10T16:30:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:30:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 1 -- 172.21.15.81:0/2977716458 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f409ff40 con 0x7f82f409e9d0 2024-09-10T16:30:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient: _finish_auth 0 2024-09-10T16:30:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient: _check_auth_tickets 2024-09-10T16:30:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 1 -- 172.21.15.81:0/2977716458 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f82e4001840 con 0x7f82f409e9d0 2024-09-10T16:30:19.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 5 monclient: authenticate success, global_id 4410 2024-09-10T16:30:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient: dump: 2024-09-10T16:30:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.065 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.066 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 1 -- 172.21.15.81:0/2977716458 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82e4001a60 con 0x7f82f409e9d0 2024-09-10T16:30:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 1 -- 172.21.15.81:0/2977716458 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f82e4004bf0 con 0x7f82f409e9d0 2024-09-10T16:30:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 4 set_mon_vals no callback set 2024-09-10T16:30:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:19.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f37fe640 10 monclient: dump: 2024-09-10T16:30:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.068 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient: shutdown 2024-09-10T16:30:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 1 -- 172.21.15.81:0/2977716458 >> v1:172.21.15.81:6789/0 conn(0x7f82f409e9d0 legacy=0x7f82f409edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 1 -- 172.21.15.81:0/2977716458 shutdown_connections 2024-09-10T16:30:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 1 -- 172.21.15.81:0/2977716458 >> 172.21.15.81:0/2977716458 conn(0x7f82f40a3fd0 msgr2=0x7f82f40a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 1 -- 172.21.15.81:0/2977716458 shutdown_connections 2024-09-10T16:30:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 1 -- 172.21.15.81:0/2977716458 wait complete. 2024-09-10T16:30:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient: build_initial_monmap 2024-09-10T16:30:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient: monmap: 2024-09-10T16:30:19.068 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:19.069 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:19.070 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 1 Processor -- start 2024-09-10T16:30:19.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 1 -- start start 2024-09-10T16:30:19.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient: init 2024-09-10T16:30:19.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:19.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient: _add_conns ranks=[2,6,0,3,5,8,1,4,7] 2024-09-10T16:30:19.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient(hunting): picked mon.noname-b con 0x7f82f409e9d0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:19.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient(hunting): picked mon.noname-d con 0x7f82f409f4c0 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:19.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient(hunting): picked mon.noname-a con 0x7f82f413bf80 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:19.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f4094000 con 0x7f82f413bf80 2024-09-10T16:30:19.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f40942e0 con 0x7f82f409e9d0 2024-09-10T16:30:19.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82f413bb90 con 0x7f82f409f4c0 2024-09-10T16:30:19.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient(hunting): authenticate will time out at 986.458491s 2024-09-10T16:30:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f8841640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f82f409e9d0 0x7f82f4072c00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38624/0 (socket says 172.21.15.81:38624) 2024-09-10T16:30:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f8841640 1 -- 172.21.15.81:0/255359853 learned_addr learned my addr 172.21.15.81:0/255359853 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2515253805 0 0) 0x7f82f413bb90 con 0x7f82f409f4c0 2024-09-10T16:30:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): my global_id is 4380 2024-09-10T16:30:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82e0003530 con 0x7f82f409f4c0 2024-09-10T16:30:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 602040674 0 0) 0x7f82f4094000 con 0x7f82f413bf80 2024-09-10T16:30:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): my global_id is 4419 2024-09-10T16:30:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82f413bb90 con 0x7f82f413bf80 2024-09-10T16:30:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1451728628 0 0) 0x7f82f40942e0 con 0x7f82f409e9d0 2024-09-10T16:30:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): my global_id is 4403 2024-09-10T16:30:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f82f4094000 con 0x7f82f409e9d0 2024-09-10T16:30:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2425867346 0 0) 0x7f82e0003530 con 0x7f82f409f4c0 2024-09-10T16:30:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82f40942e0 con 0x7f82f409f4c0 2024-09-10T16:30:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f82e8001a70 con 0x7f82f409f4c0 2024-09-10T16:30:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:19.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): dump: 2024-09-10T16:30:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.073 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.074 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2587222343 0 0) 0x7f82f413bb90 con 0x7f82f413bf80 2024-09-10T16:30:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82e0003530 con 0x7f82f413bf80 2024-09-10T16:30:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f82ec001c40 con 0x7f82f413bf80 2024-09-10T16:30:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): dump: 2024-09-10T16:30:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.074 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.075 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1167464721 0 0) 0x7f82f4094000 con 0x7f82f409e9d0 2024-09-10T16:30:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f82f413bb90 con 0x7f82f409e9d0 2024-09-10T16:30:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f82e40010e0 con 0x7f82f409e9d0 2024-09-10T16:30:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient(hunting): dump: 2024-09-10T16:30:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.076 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.077 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4002821102 0 0) 0x7f82f40942e0 con 0x7f82f409f4c0 2024-09-10T16:30:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 >> v1:172.21.15.81:6790/0 conn(0x7f82f409e9d0 legacy=0x7f82f4072c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 >> v1:172.21.15.81:6789/0 conn(0x7f82f413bf80 legacy=0x7f82f41d6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient: _finish_hunting 0 2024-09-10T16:30:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 monclient: found mon.d 2024-09-10T16:30:19.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:19.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:19.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82f40744a0 con 0x7f82f409f4c0 2024-09-10T16:30:19.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient: _finish_auth 0 2024-09-10T16:30:19.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient: _check_auth_tickets 2024-09-10T16:30:19.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:19.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 5 monclient: authenticate success, global_id 4380 2024-09-10T16:30:19.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient: _renew_subs 2024-09-10T16:30:19.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:19.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 1 -- 172.21.15.81:0/255359853 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f82f4073a20 con 0x7f82f409f4c0 2024-09-10T16:30:19.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient: _renew_subs 2024-09-10T16:30:19.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:19.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82faaa5640 1 -- 172.21.15.81:0/255359853 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f82f4096990 con 0x7f82f409f4c0 2024-09-10T16:30:19.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f82e80038b0 con 0x7f82f409f4c0 2024-09-10T16:30:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f82e8003da0 con 0x7f82f409f4c0 2024-09-10T16:30:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f17fa640 10 monclient: dump: 2024-09-10T16:30:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.080 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.054+0000 7f82f2ffd640 4 set_mon_vals no callback set 2024-09-10T16:30:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.058+0000 7f82daffd640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.058+0000 7f82daffd640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.058+0000 7f82daffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.058+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f82e800fcb0 con 0x7f82f409f4c0 2024-09-10T16:30:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.058+0000 7f82daffd640 1 -- 172.21.15.81:0/255359853 --> v1:172.21.15.81:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82cc005090 con 0x7f82f409f4c0 2024-09-10T16:30:19.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.058+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f82e8049bd0 con 0x7f82f409f4c0 2024-09-10T16:30:19.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.058+0000 7f82f8841640 10 monclient: get_auth_request con 0x7f82e003d9c0 auth_method 0 2024-09-10T16:30:19.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.062+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mon.6 v1:172.21.15.81:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f82e8015a00 con 0x7f82f409f4c0 2024-09-10T16:30:19.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.062+0000 7f82f17fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:19.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.062+0000 7f82f17fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:19.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.218+0000 7f82daffd640 1 -- 172.21.15.81:0/255359853 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f82cc000ba0 con 0x7f82e003d9c0 2024-09-10T16:30:19.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.234+0000 7f82f17fa640 1 -- 172.21.15.81:0/255359853 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34232 (unknown 2965378022 0 1818578088) 0x7f82cc000ba0 con 0x7f82e003d9c0 2024-09-10T16:30:19.236 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:30:19.236 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T16:30:19.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.234+0000 7f82daffd640 1 -- 172.21.15.81:0/255359853 >> v1:172.21.15.189:6812/1108603242 conn(0x7f82e003d9c0 legacy=0x7f82e003fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.234+0000 7f82daffd640 10 monclient: shutdown 2024-09-10T16:30:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.234+0000 7f82daffd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.234+0000 7f82daffd640 1 -- 172.21.15.81:0/255359853 >> v1:172.21.15.81:6792/0 conn(0x7f82f409f4c0 legacy=0x7f82f4073310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.234+0000 7f82daffd640 1 -- 172.21.15.81:0/255359853 shutdown_connections 2024-09-10T16:30:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.234+0000 7f82daffd640 1 -- 172.21.15.81:0/255359853 >> 172.21.15.81:0/255359853 conn(0x7f82f40a3fd0 msgr2=0x7f82f409a3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.234+0000 7f82daffd640 1 -- 172.21.15.81:0/255359853 shutdown_connections 2024-09-10T16:30:19.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.234+0000 7f82daffd640 1 -- 172.21.15.81:0/255359853 wait complete. 2024-09-10T16:30:19.253 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-10T16:30:18.285783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163288,"kb_used_data":1120,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067752,"statfs":{"total":579820584960,"available":579653378048,"internally_reserved":0,"allocated":1146880,"data_stored":1380568,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.980274"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334487+0000","last_change":"2024-09-10T16:30:15.334487+0000","last_active":"2024-09-10T16:30:15.334487+0000","last_peered":"2024-09-10T16:30:15.334487+0000","last_clean":"2024-09-10T16:30:15.334487+0000","last_became_active":"2024-09-10T16:30:13.320369+0000","last_became_peered":"2024-09-10T16:30:13.320369+0000","last_unstale":"2024-09-10T16:30:15.334487+0000","last_undegraded":"2024-09-10T16:30:15.334487+0000","last_fullsized":"2024-09-10T16:30:15.334487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:03.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011103879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334530+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:30:15.334530+0000","last_peered":"2024-09-10T16:30:15.334530+0000","last_clean":"2024-09-10T16:30:15.334530+0000","last_became_active":"2024-09-10T16:30:13.320284+0000","last_became_peered":"2024-09-10T16:30:13.320284+0000","last_unstale":"2024-09-10T16:30:15.334530+0000","last_undegraded":"2024-09-10T16:30:15.334530+0000","last_fullsized":"2024-09-10T16:30:15.334530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:11.783078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065529,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.335682+0000","last_change":"2024-09-10T16:30:15.335682+0000","last_active":"2024-09-10T16:30:15.335682+0000","last_peered":"2024-09-10T16:30:15.335682+0000","last_clean":"2024-09-10T16:30:15.335682+0000","last_became_active":"2024-09-10T16:30:13.317933+0000","last_became_peered":"2024-09-10T16:30:13.317933+0000","last_unstale":"2024-09-10T16:30:15.335682+0000","last_undegraded":"2024-09-10T16:30:15.335682+0000","last_fullsized":"2024-09-10T16:30:15.335682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:11.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018898459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334580+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:30:15.334580+0000","last_peered":"2024-09-10T16:30:15.334580+0000","last_clean":"2024-09-10T16:30:15.334580+0000","last_became_active":"2024-09-10T16:30:13.314196+0000","last_became_peered":"2024-09-10T16:30:13.314196+0000","last_unstale":"2024-09-10T16:30:15.334580+0000","last_undegraded":"2024-09-10T16:30:15.334580+0000","last_fullsized":"2024-09-10T16:30:15.334580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:17.356490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092995700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.343908+0000","last_change":"2024-09-10T16:30:15.343908+0000","last_active":"2024-09-10T16:30:15.343908+0000","last_peered":"2024-09-10T16:30:15.343908+0000","last_clean":"2024-09-10T16:30:15.343908+0000","last_became_active":"2024-09-10T16:30:13.322410+0000","last_became_peered":"2024-09-10T16:30:13.322410+0000","last_unstale":"2024-09-10T16:30:15.343908+0000","last_undegraded":"2024-09-10T16:30:15.343908+0000","last_fullsized":"2024-09-10T16:30:15.343908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:23.371637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024400910000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334785+0000","last_change":"2024-09-10T16:30:15.335359+0000","last_active":"2024-09-10T16:30:15.334785+0000","last_peered":"2024-09-10T16:30:15.334785+0000","last_clean":"2024-09-10T16:30:15.334785+0000","last_became_active":"2024-09-10T16:30:13.314279+0000","last_became_peered":"2024-09-10T16:30:13.314279+0000","last_unstale":"2024-09-10T16:30:15.334785+0000","last_undegraded":"2024-09-10T16:30:15.334785+0000","last_fullsized":"2024-09-10T16:30:15.334785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:19.341302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012467800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.335268+0000","last_change":"2024-09-10T16:30:15.336057+0000","last_active":"2024-09-10T16:30:15.335268+0000","last_peered":"2024-09-10T16:30:15.335268+0000","last_clean":"2024-09-10T16:30:15.335268+0000","last_became_active":"2024-09-10T16:30:13.315537+0000","last_became_peered":"2024-09-10T16:30:13.315537+0000","last_unstale":"2024-09-10T16:30:15.335268+0000","last_undegraded":"2024-09-10T16:30:15.335268+0000","last_fullsized":"2024-09-10T16:30:15.335268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:18.484028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001369903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334665+0000","last_change":"2024-09-10T16:30:15.334665+0000","last_active":"2024-09-10T16:30:15.334665+0000","last_peered":"2024-09-10T16:30:15.334665+0000","last_clean":"2024-09-10T16:30:15.334665+0000","last_became_active":"2024-09-10T16:30:13.317955+0000","last_became_peered":"2024-09-10T16:30:13.317955+0000","last_unstale":"2024-09-10T16:30:15.334665+0000","last_undegraded":"2024-09-10T16:30:15.334665+0000","last_fullsized":"2024-09-10T16:30:15.334665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:01.463525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016930140000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.332750+0000","last_change":"2024-09-10T16:30:10.241185+0000","last_active":"2024-09-10T16:30:15.332750+0000","last_peered":"2024-09-10T16:30:15.332750+0000","last_clean":"2024-09-10T16:30:15.332750+0000","last_became_active":"2024-09-10T16:30:10.239296+0000","last_became_peered":"2024-09-10T16:30:10.239296+0000","last_unstale":"2024-09-10T16:30:15.332750+0000","last_undegraded":"2024-09-10T16:30:15.332750+0000","last_fullsized":"2024-09-10T16:30:15.332750+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_clean_scrub_stamp":"2024-09-10T16:30:09.204141+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:25.346646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":582707,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":53798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":53798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":582707,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T16:30:19.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T16:30:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.366+0000 7f2585f16640 10 monclient: get_monmap_and_config 2024-09-10T16:30:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.366+0000 7f2585f16640 10 monclient: build_initial_monmap 2024-09-10T16:30:19.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.366+0000 7f2585f16640 10 monclient: monmap: 2024-09-10T16:30:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:19.373422+0000 2024-09-10T16:30:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:19.373422+0000 2024-09-10T16:30:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:19.372 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:19.373 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:19.373 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 Processor -- start 2024-09-10T16:30:19.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 -- start start 2024-09-10T16:30:19.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient: init 2024-09-10T16:30:19.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:19.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient: _add_conns ranks=[5,2,6,7,0,4,3,8,1] 2024-09-10T16:30:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient(hunting): picked mon.noname-h con 0x7f258009e9d0 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient(hunting): picked mon.noname-b con 0x7f258009f4c0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient(hunting): picked mon.noname-d con 0x7f258013bf80 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f258009fd40 con 0x7f258009f4c0 2024-09-10T16:30:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25800a01c0 con 0x7f258009e9d0 2024-09-10T16:30:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f258009fb00 con 0x7f258013bf80 2024-09-10T16:30:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient(hunting): authenticate will time out at 986.772727s 2024-09-10T16:30:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257ffff640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f258013bf80 0x7f258013e370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56214/0 (socket says 172.21.15.81:56214) 2024-09-10T16:30:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257ffff640 1 -- 172.21.15.81:0/1712556678 learned_addr learned my addr 172.21.15.81:0/1712556678 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2577fff640 1 --1- 172.21.15.81:0/1712556678 >> v1:172.21.15.81:6790/0 conn(0x7f258009f4c0 0x7f258013a860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38634/0 (socket says 172.21.15.81:38634) 2024-09-10T16:30:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 1 -- 172.21.15.81:0/1712556678 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2067650892 0 0) 0x7f258009fb00 con 0x7f258013bf80 2024-09-10T16:30:19.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient(hunting): my global_id is 4389 2024-09-10T16:30:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 1 -- 172.21.15.81:0/1712556678 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f256c004640 con 0x7f258013bf80 2024-09-10T16:30:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 1 -- 172.21.15.81:0/1712556678 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 90213581 0 0) 0x7f258009fd40 con 0x7f258009f4c0 2024-09-10T16:30:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient(hunting): my global_id is 4412 2024-09-10T16:30:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 1 -- 172.21.15.81:0/1712556678 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f258009fb00 con 0x7f258009f4c0 2024-09-10T16:30:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 1 -- 172.21.15.81:0/1712556678 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 968663090 0 0) 0x7f256c004640 con 0x7f258013bf80 2024-09-10T16:30:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 1 -- 172.21.15.81:0/1712556678 >> v1:172.21.15.189:6791/0 conn(0x7f258009e9d0 legacy=0x7f258009edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 1 -- 172.21.15.81:0/1712556678 >> v1:172.21.15.81:6790/0 conn(0x7f258009f4c0 legacy=0x7f258013a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 1 monclient: found mon.noname-d 2024-09-10T16:30:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:30:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 1 -- 172.21.15.81:0/1712556678 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f258009ff40 con 0x7f258013bf80 2024-09-10T16:30:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient: _finish_auth 0 2024-09-10T16:30:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 1 -- 172.21.15.81:0/1712556678 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2578001be0 con 0x7f258013bf80 2024-09-10T16:30:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 5 monclient: authenticate success, global_id 4389 2024-09-10T16:30:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:19.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient: dump: 2024-09-10T16:30:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.382 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.383 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 1 -- 172.21.15.81:0/1712556678 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2578001e00 con 0x7f258013bf80 2024-09-10T16:30:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 1 -- 172.21.15.81:0/1712556678 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2578004f70 con 0x7f258013bf80 2024-09-10T16:30:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257effd640 10 monclient: dump: 2024-09-10T16:30:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.383 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.384 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:19.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 4 set_mon_vals no callback set 2024-09-10T16:30:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient: shutdown 2024-09-10T16:30:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 -- 172.21.15.81:0/1712556678 >> v1:172.21.15.81:6792/0 conn(0x7f258013bf80 legacy=0x7f258013e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 -- 172.21.15.81:0/1712556678 shutdown_connections 2024-09-10T16:30:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 -- 172.21.15.81:0/1712556678 >> 172.21.15.81:0/1712556678 conn(0x7f25800a3fd0 msgr2=0x7f25800a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 -- 172.21.15.81:0/1712556678 shutdown_connections 2024-09-10T16:30:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 -- 172.21.15.81:0/1712556678 wait complete. 2024-09-10T16:30:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient: build_initial_monmap 2024-09-10T16:30:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient: monmap: 2024-09-10T16:30:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:19.385 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:19.386 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 Processor -- start 2024-09-10T16:30:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 -- start start 2024-09-10T16:30:19.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient: init 2024-09-10T16:30:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient: _add_conns ranks=[2,0,1,6,5,7,3,4,8] 2024-09-10T16:30:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient(hunting): picked mon.noname-b con 0x7f258009e9d0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient(hunting): picked mon.noname-a con 0x7f258009f4c0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient(hunting): picked mon.noname-f con 0x7f258013bf80 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2580098ef0 con 0x7f258009f4c0 2024-09-10T16:30:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2580092ff0 con 0x7f258013bf80 2024-09-10T16:30:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2580094160 con 0x7f258009e9d0 2024-09-10T16:30:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2585f16640 10 monclient(hunting): authenticate will time out at 986.775793s 2024-09-10T16:30:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257f7fe640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f258009e9d0 0x7f2580090500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38636/0 (socket says 172.21.15.81:38636) 2024-09-10T16:30:19.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f2577fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f258009f4c0 0x7f2580090c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43152/0 (socket says 172.21.15.81:43152) 2024-09-10T16:30:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.370+0000 7f257f7fe640 1 -- 172.21.15.81:0/264926338 learned_addr learned my addr 172.21.15.81:0/264926338 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 234187159 0 0) 0x7f2580094160 con 0x7f258009e9d0 2024-09-10T16:30:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): my global_id is 4421 2024-09-10T16:30:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2560003530 con 0x7f258009e9d0 2024-09-10T16:30:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2847141624 0 0) 0x7f2580098ef0 con 0x7f258009f4c0 2024-09-10T16:30:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): my global_id is 4428 2024-09-10T16:30:19.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2580094160 con 0x7f258009f4c0 2024-09-10T16:30:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1671800895 0 0) 0x7f2560003530 con 0x7f258009e9d0 2024-09-10T16:30:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2580098ef0 con 0x7f258009e9d0 2024-09-10T16:30:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2570001be0 con 0x7f258009e9d0 2024-09-10T16:30:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): dump: 2024-09-10T16:30:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.389 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.390 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3332627105 0 0) 0x7f2580094160 con 0x7f258009f4c0 2024-09-10T16:30:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2560003530 con 0x7f258009f4c0 2024-09-10T16:30:19.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2568001540 con 0x7f258009f4c0 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): dump: 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.391 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.392 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3108398733 0 0) 0x7f2580092ff0 con 0x7f258013bf80 2024-09-10T16:30:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient(hunting): my global_id is 4393 2024-09-10T16:30:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2580094160 con 0x7f258013bf80 2024-09-10T16:30:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2076550123 0 0) 0x7f2580098ef0 con 0x7f258009e9d0 2024-09-10T16:30:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 >> v1:172.21.15.189:6789/0 conn(0x7f258013bf80 legacy=0x7f25801d38f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 >> v1:172.21.15.81:6789/0 conn(0x7f258009f4c0 legacy=0x7f2580090c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient: _finish_hunting 0 2024-09-10T16:30:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 monclient: found mon.b 2024-09-10T16:30:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25800746f0 con 0x7f258009e9d0 2024-09-10T16:30:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient: _finish_auth 0 2024-09-10T16:30:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient: _check_auth_tickets 2024-09-10T16:30:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f2585f16640 5 monclient: authenticate success, global_id 4421 2024-09-10T16:30:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f2585f16640 10 monclient: _renew_subs 2024-09-10T16:30:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f2585f16640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f2585f16640 1 -- 172.21.15.81:0/264926338 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2580091e00 con 0x7f258009e9d0 2024-09-10T16:30:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f2585f16640 10 monclient: _renew_subs 2024-09-10T16:30:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f2585f16640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:19.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f2585f16640 1 -- 172.21.15.81:0/264926338 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2580093e80 con 0x7f258009e9d0 2024-09-10T16:30:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f25700038d0 con 0x7f258009e9d0 2024-09-10T16:30:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2570003ec0 con 0x7f258009e9d0 2024-09-10T16:30:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257e7fc640 4 set_mon_vals no callback set 2024-09-10T16:30:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 10 monclient: dump: 2024-09-10T16:30:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.394 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f2585f16640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f2585f16640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f2585f16640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f2585f16640 1 -- 172.21.15.81:0/264926338 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2564005090 con 0x7f258009e9d0 2024-09-10T16:30:19.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f25700040e0 con 0x7f258009e9d0 2024-09-10T16:30:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7f257004ae10 con 0x7f258009e9d0 2024-09-10T16:30:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.374+0000 7f2577fff640 10 monclient: get_auth_request con 0x7f256003d700 auth_method 0 2024-09-10T16:30:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.378+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f2570016da0 con 0x7f258009e9d0 2024-09-10T16:30:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.378+0000 7f257cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:19.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.378+0000 7f257cff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:19.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.534+0000 7f2585f16640 1 -- 172.21.15.81:0/264926338 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2564000ba0 con 0x7f256003d700 2024-09-10T16:30:19.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.538+0000 7f257cff9640 1 -- 172.21.15.81:0/264926338 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34232 (unknown 2965378022 0 1818578088) 0x7f2564000ba0 con 0x7f256003d700 2024-09-10T16:30:19.541 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:30:19.542 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T16:30:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.538+0000 7f2585f16640 1 -- 172.21.15.81:0/264926338 >> v1:172.21.15.189:6812/1108603242 conn(0x7f256003d700 legacy=0x7f256003fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.538+0000 7f2585f16640 10 monclient: shutdown 2024-09-10T16:30:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.538+0000 7f2585f16640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.538+0000 7f2585f16640 1 -- 172.21.15.81:0/264926338 >> v1:172.21.15.81:6790/0 conn(0x7f258009e9d0 legacy=0x7f2580090500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.538+0000 7f2585f16640 1 -- 172.21.15.81:0/264926338 shutdown_connections 2024-09-10T16:30:19.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.538+0000 7f2585f16640 1 -- 172.21.15.81:0/264926338 >> 172.21.15.81:0/264926338 conn(0x7f25800a3fd0 msgr2=0x7f258009a400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:19.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.538+0000 7f2585f16640 1 -- 172.21.15.81:0/264926338 shutdown_connections 2024-09-10T16:30:19.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.538+0000 7f2585f16640 1 -- 172.21.15.81:0/264926338 wait complete. 2024-09-10T16:30:19.558 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2024-09-10T16:30:18.285783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163288,"kb_used_data":1120,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067752,"statfs":{"total":579820584960,"available":579653378048,"internally_reserved":0,"allocated":1146880,"data_stored":1380568,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.980274"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334487+0000","last_change":"2024-09-10T16:30:15.334487+0000","last_active":"2024-09-10T16:30:15.334487+0000","last_peered":"2024-09-10T16:30:15.334487+0000","last_clean":"2024-09-10T16:30:15.334487+0000","last_became_active":"2024-09-10T16:30:13.320369+0000","last_became_peered":"2024-09-10T16:30:13.320369+0000","last_unstale":"2024-09-10T16:30:15.334487+0000","last_undegraded":"2024-09-10T16:30:15.334487+0000","last_fullsized":"2024-09-10T16:30:15.334487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:03.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011103879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334530+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:30:15.334530+0000","last_peered":"2024-09-10T16:30:15.334530+0000","last_clean":"2024-09-10T16:30:15.334530+0000","last_became_active":"2024-09-10T16:30:13.320284+0000","last_became_peered":"2024-09-10T16:30:13.320284+0000","last_unstale":"2024-09-10T16:30:15.334530+0000","last_undegraded":"2024-09-10T16:30:15.334530+0000","last_fullsized":"2024-09-10T16:30:15.334530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:11.783078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065529,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.335682+0000","last_change":"2024-09-10T16:30:15.335682+0000","last_active":"2024-09-10T16:30:15.335682+0000","last_peered":"2024-09-10T16:30:15.335682+0000","last_clean":"2024-09-10T16:30:15.335682+0000","last_became_active":"2024-09-10T16:30:13.317933+0000","last_became_peered":"2024-09-10T16:30:13.317933+0000","last_unstale":"2024-09-10T16:30:15.335682+0000","last_undegraded":"2024-09-10T16:30:15.335682+0000","last_fullsized":"2024-09-10T16:30:15.335682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:11.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018898459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334580+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:30:15.334580+0000","last_peered":"2024-09-10T16:30:15.334580+0000","last_clean":"2024-09-10T16:30:15.334580+0000","last_became_active":"2024-09-10T16:30:13.314196+0000","last_became_peered":"2024-09-10T16:30:13.314196+0000","last_unstale":"2024-09-10T16:30:15.334580+0000","last_undegraded":"2024-09-10T16:30:15.334580+0000","last_fullsized":"2024-09-10T16:30:15.334580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:17.356490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092995700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.343908+0000","last_change":"2024-09-10T16:30:15.343908+0000","last_active":"2024-09-10T16:30:15.343908+0000","last_peered":"2024-09-10T16:30:15.343908+0000","last_clean":"2024-09-10T16:30:15.343908+0000","last_became_active":"2024-09-10T16:30:13.322410+0000","last_became_peered":"2024-09-10T16:30:13.322410+0000","last_unstale":"2024-09-10T16:30:15.343908+0000","last_undegraded":"2024-09-10T16:30:15.343908+0000","last_fullsized":"2024-09-10T16:30:15.343908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:23.371637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024400910000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334785+0000","last_change":"2024-09-10T16:30:15.335359+0000","last_active":"2024-09-10T16:30:15.334785+0000","last_peered":"2024-09-10T16:30:15.334785+0000","last_clean":"2024-09-10T16:30:15.334785+0000","last_became_active":"2024-09-10T16:30:13.314279+0000","last_became_peered":"2024-09-10T16:30:13.314279+0000","last_unstale":"2024-09-10T16:30:15.334785+0000","last_undegraded":"2024-09-10T16:30:15.334785+0000","last_fullsized":"2024-09-10T16:30:15.334785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:19.341302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012467800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.335268+0000","last_change":"2024-09-10T16:30:15.336057+0000","last_active":"2024-09-10T16:30:15.335268+0000","last_peered":"2024-09-10T16:30:15.335268+0000","last_clean":"2024-09-10T16:30:15.335268+0000","last_became_active":"2024-09-10T16:30:13.315537+0000","last_became_peered":"2024-09-10T16:30:13.315537+0000","last_unstale":"2024-09-10T16:30:15.335268+0000","last_undegraded":"2024-09-10T16:30:15.335268+0000","last_fullsized":"2024-09-10T16:30:15.335268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:18.484028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001369903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334665+0000","last_change":"2024-09-10T16:30:15.334665+0000","last_active":"2024-09-10T16:30:15.334665+0000","last_peered":"2024-09-10T16:30:15.334665+0000","last_clean":"2024-09-10T16:30:15.334665+0000","last_became_active":"2024-09-10T16:30:13.317955+0000","last_became_peered":"2024-09-10T16:30:13.317955+0000","last_unstale":"2024-09-10T16:30:15.334665+0000","last_undegraded":"2024-09-10T16:30:15.334665+0000","last_fullsized":"2024-09-10T16:30:15.334665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:01.463525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016930140000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.332750+0000","last_change":"2024-09-10T16:30:10.241185+0000","last_active":"2024-09-10T16:30:15.332750+0000","last_peered":"2024-09-10T16:30:15.332750+0000","last_clean":"2024-09-10T16:30:15.332750+0000","last_became_active":"2024-09-10T16:30:10.239296+0000","last_became_peered":"2024-09-10T16:30:10.239296+0000","last_unstale":"2024-09-10T16:30:15.332750+0000","last_undegraded":"2024-09-10T16:30:15.332750+0000","last_fullsized":"2024-09-10T16:30:15.332750+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_clean_scrub_stamp":"2024-09-10T16:30:09.204141+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:25.346646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":582707,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":53798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":53798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":582707,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T16:30:19.559 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T16:30:19.559 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-10T16:30:19.559 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-10T16:30:19.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-10T16:30:19.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 10 monclient: get_monmap_and_config 2024-09-10T16:30:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 10 monclient: build_initial_monmap 2024-09-10T16:30:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 10 monclient: monmap: 2024-09-10T16:30:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:19.667709+0000 2024-09-10T16:30:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:19.667709+0000 2024-09-10T16:30:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:19.666 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:19.667 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:19.667 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:19.667 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:19.667 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:19.667 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:19.667 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 1 Processor -- start 2024-09-10T16:30:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 1 -- start start 2024-09-10T16:30:19.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 10 monclient: init 2024-09-10T16:30:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 10 monclient: _add_conns ranks=[8,0,4,3,2,5,1,6,7] 2024-09-10T16:30:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 10 monclient(hunting): picked mon.noname-e con 0x7faa6c0a3ef0 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 10 monclient(hunting): picked mon.noname-a con 0x7faa6c073d20 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 10 monclient(hunting): picked mon.noname-c con 0x7faa6c0a49e0 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6c073870 con 0x7faa6c073d20 2024-09-10T16:30:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6c0a5630 con 0x7faa6c0a49e0 2024-09-10T16:30:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6c073590 con 0x7faa6c0a3ef0 2024-09-10T16:30:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa7197b640 10 monclient(hunting): authenticate will time out at 987.067845s 2024-09-10T16:30:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa6affd640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7faa6c0a3ef0 0x7faa6c0a42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35232/0 (socket says 172.21.15.81:35232) 2024-09-10T16:30:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.662+0000 7faa6affd640 1 -- 172.21.15.81:0/618988803 learned_addr learned my addr 172.21.15.81:0/618988803 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 1 -- 172.21.15.81:0/618988803 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1253055484 0 0) 0x7faa6c073590 con 0x7faa6c0a3ef0 2024-09-10T16:30:19.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient(hunting): my global_id is 4328 2024-09-10T16:30:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 1 -- 172.21.15.81:0/618988803 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa58003530 con 0x7faa6c0a3ef0 2024-09-10T16:30:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 1 -- 172.21.15.81:0/618988803 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2391437388 0 0) 0x7faa6c073870 con 0x7faa6c073d20 2024-09-10T16:30:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient(hunting): my global_id is 4437 2024-09-10T16:30:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 1 -- 172.21.15.81:0/618988803 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa6c073590 con 0x7faa6c073d20 2024-09-10T16:30:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 1 -- 172.21.15.81:0/618988803 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1279878036 0 0) 0x7faa6c0a5630 con 0x7faa6c0a49e0 2024-09-10T16:30:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:19.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:19.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:19.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient(hunting): my global_id is 4423 2024-09-10T16:30:19.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 1 -- 172.21.15.81:0/618988803 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa6c073870 con 0x7faa6c0a49e0 2024-09-10T16:30:19.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 1 -- 172.21.15.81:0/618988803 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1565278767 0 0) 0x7faa58003530 con 0x7faa6c0a3ef0 2024-09-10T16:30:19.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 1 -- 172.21.15.81:0/618988803 >> v1:172.21.15.81:6791/0 conn(0x7faa6c0a49e0 legacy=0x7faa6c13f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 1 -- 172.21.15.81:0/618988803 >> v1:172.21.15.81:6789/0 conn(0x7faa6c073d20 legacy=0x7faa6c13c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:30:19.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 1 monclient: found mon.noname-e 2024-09-10T16:30:19.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:19.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:30:19.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 1 -- 172.21.15.81:0/618988803 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c0a5870 con 0x7faa6c0a3ef0 2024-09-10T16:30:19.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient: _finish_auth 0 2024-09-10T16:30:19.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:30:19.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:19.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 1 -- 172.21.15.81:0/618988803 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7faa5c001840 con 0x7faa6c0a3ef0 2024-09-10T16:30:19.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:19.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:19.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient: dump: 2024-09-10T16:30:19.678 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.678 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.679 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.679 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.679 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.679 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.679 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.679 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.679 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.680 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.680 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.680 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.680 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.680 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.680 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.680 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 5 monclient: authenticate success, global_id 4328 2024-09-10T16:30:19.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:19.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 1 -- 172.21.15.81:0/618988803 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faa5c0019e0 con 0x7faa6c0a3ef0 2024-09-10T16:30:19.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:19.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:19.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 1 -- 172.21.15.81:0/618988803 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7faa5c004bf0 con 0x7faa6c0a3ef0 2024-09-10T16:30:19.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:19.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 4 set_mon_vals no callback set 2024-09-10T16:30:19.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:19.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6a7fc640 10 monclient: dump: 2024-09-10T16:30:19.682 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.682 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.682 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.682 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.682 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.682 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.682 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.682 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.682 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.682 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.683 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient: shutdown 2024-09-10T16:30:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 1 -- 172.21.15.81:0/618988803 >> v1:172.21.15.81:6793/0 conn(0x7faa6c0a3ef0 legacy=0x7faa6c0a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 1 -- 172.21.15.81:0/618988803 shutdown_connections 2024-09-10T16:30:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 1 -- 172.21.15.81:0/618988803 >> 172.21.15.81:0/618988803 conn(0x7faa6c0a94f0 msgr2=0x7faa6c0a9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 1 -- 172.21.15.81:0/618988803 shutdown_connections 2024-09-10T16:30:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 1 -- 172.21.15.81:0/618988803 wait complete. 2024-09-10T16:30:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient: build_initial_monmap 2024-09-10T16:30:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient: monmap: 2024-09-10T16:30:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:19.684 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:19.685 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 1 Processor -- start 2024-09-10T16:30:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 1 -- start start 2024-09-10T16:30:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient: init 2024-09-10T16:30:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient: _add_conns ranks=[0,7,4,1,2,3,6,5,8] 2024-09-10T16:30:19.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient(hunting): picked mon.noname-a con 0x7faa6c073d20 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient(hunting): picked mon.noname-i con 0x7faa6c0a3ef0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient(hunting): picked mon.noname-c con 0x7faa6c0a49e0 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6c13fb20 con 0x7faa6c073d20 2024-09-10T16:30:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6c126d70 con 0x7faa6c0a49e0 2024-09-10T16:30:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faa6c125f00 con 0x7faa6c0a3ef0 2024-09-10T16:30:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient(hunting): authenticate will time out at 987.070708s 2024-09-10T16:30:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6b7fe640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7faa6c0a49e0 0x7faa6c1d3d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34604/0 (socket says 172.21.15.81:34604) 2024-09-10T16:30:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa6b7fe640 1 -- 172.21.15.81:0/2416960751 learned_addr learned my addr 172.21.15.81:0/2416960751 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3589653972 0 0) 0x7faa6c126d70 con 0x7faa6c0a49e0 2024-09-10T16:30:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:19.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): my global_id is 4432 2024-09-10T16:30:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa4c003560 con 0x7faa6c0a49e0 2024-09-10T16:30:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1079919040 0 0) 0x7faa6c13fb20 con 0x7faa6c073d20 2024-09-10T16:30:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): my global_id is 4446 2024-09-10T16:30:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faa6c126d70 con 0x7faa6c073d20 2024-09-10T16:30:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 398836900 0 0) 0x7faa4c003560 con 0x7faa6c0a49e0 2024-09-10T16:30:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa6c13fb20 con 0x7faa6c0a49e0 2024-09-10T16:30:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2541179002 0 0) 0x7faa6c126d70 con 0x7faa6c073d20 2024-09-10T16:30:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7faa4c003560 con 0x7faa6c073d20 2024-09-10T16:30:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7faa64001c50 con 0x7faa6c0a49e0 2024-09-10T16:30:19.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): dump: 2024-09-10T16:30:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.688 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.689 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7faa5c001800 con 0x7faa6c073d20 2024-09-10T16:30:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient(hunting): dump: 2024-09-10T16:30:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.689 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.690 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.690 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.690 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.690 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.690 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.690 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.690 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.690 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.690 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.690 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.690 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.690 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2875628730 0 0) 0x7faa6c13fb20 con 0x7faa6c0a49e0 2024-09-10T16:30:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 >> v1:172.21.15.189:6792/0 conn(0x7faa6c0a3ef0 legacy=0x7faa6c1d05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 >> v1:172.21.15.81:6789/0 conn(0x7faa6c073d20 legacy=0x7faa6c13f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:30:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 monclient: found mon.c 2024-09-10T16:30:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c124a10 con 0x7faa6c0a49e0 2024-09-10T16:30:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient: _finish_auth 0 2024-09-10T16:30:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:30:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 5 monclient: authenticate success, global_id 4432 2024-09-10T16:30:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient: _renew_subs 2024-09-10T16:30:19.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 1 -- 172.21.15.81:0/2416960751 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7faa6c126a90 con 0x7faa6c0a49e0 2024-09-10T16:30:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient: _renew_subs 2024-09-10T16:30:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa7197b640 1 -- 172.21.15.81:0/2416960751 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7faa6c1235a0 con 0x7faa6c0a49e0 2024-09-10T16:30:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7faa64004bf0 con 0x7faa6c0a49e0 2024-09-10T16:30:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7faa640050e0 con 0x7faa6c0a49e0 2024-09-10T16:30:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa69ffb640 4 set_mon_vals no callback set 2024-09-10T16:30:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.666+0000 7faa68ff9640 10 monclient: dump: 2024-09-10T16:30:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:19.692 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:19.693 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:19.694 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.670+0000 7faa7197b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.670+0000 7faa7197b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.670+0000 7faa7197b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.670+0000 7faa7197b640 1 -- 172.21.15.81:0/2416960751 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa50005090 con 0x7faa6c0a49e0 2024-09-10T16:30:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.670+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7faa64010ff0 con 0x7faa6c0a49e0 2024-09-10T16:30:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.670+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7faa6404afb0 con 0x7faa6c0a49e0 2024-09-10T16:30:19.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.670+0000 7faa6affd640 10 monclient: get_auth_request con 0x7faa4c03d660 auth_method 0 2024-09-10T16:30:19.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.674+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7faa64016dc0 con 0x7faa6c0a49e0 2024-09-10T16:30:19.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.674+0000 7faa68ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:19.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.674+0000 7faa68ff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.862+0000 7faa7197b640 10 start_mon_command cmd=[{"prefix": "health", "format": "json"}] 2024-09-10T16:30:19.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.862+0000 7faa7197b640 10 monclient: _send_command 2 [{"prefix": "health", "format": "json"}] 2024-09-10T16:30:19.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.862+0000 7faa7197b640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:19.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.862+0000 7faa7197b640 1 -- 172.21.15.81:0/2416960751 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7faa50005380 con 0x7faa6c0a49e0 2024-09-10T16:30:19.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.862+0000 7faa68ff9640 1 -- 172.21.15.81:0/2416960751 <== mon.4 v1:172.21.15.81:6791/0 10 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (unknown 3730786198 0 4185958460) 0x7faa6401b1a0 con 0x7faa6c0a49e0 2024-09-10T16:30:19.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.862+0000 7faa68ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "health", "format": "json"}] 2024-09-10T16:30:19.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.862+0000 7faa68ff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:19.867 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:30:19.867 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-10T16:30:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.866+0000 7faa7197b640 1 -- 172.21.15.81:0/2416960751 >> v1:172.21.15.189:6812/1108603242 conn(0x7faa4c03d660 legacy=0x7faa4c03fb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.866+0000 7faa7197b640 10 monclient: shutdown 2024-09-10T16:30:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.866+0000 7faa7197b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.866+0000 7faa7197b640 1 -- 172.21.15.81:0/2416960751 >> v1:172.21.15.81:6791/0 conn(0x7faa6c0a49e0 legacy=0x7faa6c1d3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.866+0000 7faa7197b640 1 -- 172.21.15.81:0/2416960751 shutdown_connections 2024-09-10T16:30:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.866+0000 7faa7197b640 1 -- 172.21.15.81:0/2416960751 >> 172.21.15.81:0/2416960751 conn(0x7faa6c0a94f0 msgr2=0x7faa6c140370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.866+0000 7faa7197b640 1 -- 172.21.15.81:0/2416960751 shutdown_connections 2024-09-10T16:30:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:19.866+0000 7faa7197b640 1 -- 172.21.15.81:0/2416960751 wait complete. 2024-09-10T16:30:19.883 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-10T16:30:19.883 INFO:teuthology.run_tasks:Running task mon_thrash... 2024-09-10T16:30:19.900 INFO:tasks.mon_thrash:Beginning mon_thrash... 2024-09-10T16:30:19.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T16:30:20.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 10 monclient: get_monmap_and_config 2024-09-10T16:30:20.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 10 monclient: build_initial_monmap 2024-09-10T16:30:20.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 10 monclient: monmap: 2024-09-10T16:30:20.010 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:20.010 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.010 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:20.012277+0000 2024-09-10T16:30:20.010 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:20.012277+0000 2024-09-10T16:30:20.010 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:20.011 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.011 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:20.011 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:20.011 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:20.011 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:20.011 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:20.011 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:20.012 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 1 Processor -- start 2024-09-10T16:30:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 1 -- start start 2024-09-10T16:30:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 10 monclient: init 2024-09-10T16:30:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 10 monclient: _add_conns ranks=[0,2,8,5,7,3,1,6,4] 2024-09-10T16:30:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 10 monclient(hunting): picked mon.noname-a con 0x7fa5180a3ff0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 10 monclient(hunting): picked mon.noname-b con 0x7fa5180a4ae0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 10 monclient(hunting): picked mon.noname-e con 0x7fa51813f8f0 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa518075060 con 0x7fa5180a3ff0 2024-09-10T16:30:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5180a5550 con 0x7fa5180a4ae0 2024-09-10T16:30:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa51806f630 con 0x7fa51813f8f0 2024-09-10T16:30:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa5204c8640 10 monclient(hunting): authenticate will time out at 987.411698s 2024-09-10T16:30:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa51ea65640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fa51813f8f0 0x7fa518141ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35234/0 (socket says 172.21.15.81:35234) 2024-09-10T16:30:20.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.006+0000 7fa51ea65640 1 -- 172.21.15.81:0/2295221830 learned_addr learned my addr 172.21.15.81:0/2295221830 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 1 -- 172.21.15.81:0/2295221830 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1216586212 0 0) 0x7fa518075060 con 0x7fa5180a3ff0 2024-09-10T16:30:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient(hunting): my global_id is 4455 2024-09-10T16:30:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 1 -- 172.21.15.81:0/2295221830 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa504003530 con 0x7fa5180a3ff0 2024-09-10T16:30:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 1 -- 172.21.15.81:0/2295221830 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3265094620 0 0) 0x7fa51806f630 con 0x7fa51813f8f0 2024-09-10T16:30:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient(hunting): my global_id is 4337 2024-09-10T16:30:20.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 1 -- 172.21.15.81:0/2295221830 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa518075060 con 0x7fa51813f8f0 2024-09-10T16:30:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 1 -- 172.21.15.81:0/2295221830 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1627569101 0 0) 0x7fa5180a5550 con 0x7fa5180a4ae0 2024-09-10T16:30:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient(hunting): my global_id is 4430 2024-09-10T16:30:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 1 -- 172.21.15.81:0/2295221830 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa51806f630 con 0x7fa5180a4ae0 2024-09-10T16:30:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 1 -- 172.21.15.81:0/2295221830 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1416842281 0 0) 0x7fa51806f630 con 0x7fa5180a4ae0 2024-09-10T16:30:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 1 -- 172.21.15.81:0/2295221830 >> v1:172.21.15.81:6793/0 conn(0x7fa51813f8f0 legacy=0x7fa518141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 1 -- 172.21.15.81:0/2295221830 >> v1:172.21.15.81:6789/0 conn(0x7fa5180a3ff0 legacy=0x7fa5180a43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient: _finish_hunting 0 2024-09-10T16:30:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 1 monclient: found mon.noname-b 2024-09-10T16:30:20.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:30:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 1 -- 172.21.15.81:0/2295221830 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa51806f910 con 0x7fa5180a4ae0 2024-09-10T16:30:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient: _finish_auth 0 2024-09-10T16:30:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient: _check_auth_tickets 2024-09-10T16:30:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 1 -- 172.21.15.81:0/2295221830 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa514001760 con 0x7fa5180a4ae0 2024-09-10T16:30:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient: dump: 2024-09-10T16:30:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.022 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.023 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 5 monclient: authenticate success, global_id 4430 2024-09-10T16:30:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 1 -- 172.21.15.81:0/2295221830 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa514001900 con 0x7fa5180a4ae0 2024-09-10T16:30:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 1 -- 172.21.15.81:0/2295221830 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa514003960 con 0x7fa5180a4ae0 2024-09-10T16:30:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51d262640 10 monclient: dump: 2024-09-10T16:30:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.024 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.025 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:20.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 4 set_mon_vals no callback set 2024-09-10T16:30:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient: shutdown 2024-09-10T16:30:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 1 -- 172.21.15.81:0/2295221830 >> v1:172.21.15.81:6790/0 conn(0x7fa5180a4ae0 legacy=0x7fa51813e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 1 -- 172.21.15.81:0/2295221830 shutdown_connections 2024-09-10T16:30:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 1 -- 172.21.15.81:0/2295221830 >> 172.21.15.81:0/2295221830 conn(0x7fa51809cbe0 msgr2=0x7fa5180a95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 1 -- 172.21.15.81:0/2295221830 shutdown_connections 2024-09-10T16:30:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 1 -- 172.21.15.81:0/2295221830 wait complete. 2024-09-10T16:30:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient: build_initial_monmap 2024-09-10T16:30:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient: monmap: 2024-09-10T16:30:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:20.026 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:20.027 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 1 Processor -- start 2024-09-10T16:30:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 1 -- start start 2024-09-10T16:30:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient: init 2024-09-10T16:30:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient: _add_conns ranks=[0,7,3,4,5,1,2,6,8] 2024-09-10T16:30:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient(hunting): picked mon.noname-a con 0x7fa5180a3ff0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient(hunting): picked mon.noname-i con 0x7fa5180a4ae0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient(hunting): picked mon.noname-g con 0x7fa51813f8f0 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa518129cc0 con 0x7fa5180a3ff0 2024-09-10T16:30:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa518129fa0 con 0x7fa51813f8f0 2024-09-10T16:30:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa5180738e0 con 0x7fa5180a4ae0 2024-09-10T16:30:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient(hunting): authenticate will time out at 987.414893s 2024-09-10T16:30:20.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51e264640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa5180a3ff0 0x7fa5181ce050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43182/0 (socket says 172.21.15.81:43182) 2024-09-10T16:30:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51e264640 1 -- 172.21.15.81:0/117177958 learned_addr learned my addr 172.21.15.81:0/117177958 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 527658327 0 0) 0x7fa518129cc0 con 0x7fa5180a3ff0 2024-09-10T16:30:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient(hunting): my global_id is 4464 2024-09-10T16:30:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa4fc003530 con 0x7fa5180a3ff0 2024-09-10T16:30:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4005017434 0 0) 0x7fa4fc003530 con 0x7fa5180a3ff0 2024-09-10T16:30:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa518129cc0 con 0x7fa5180a3ff0 2024-09-10T16:30:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa5080016c0 con 0x7fa5180a3ff0 2024-09-10T16:30:20.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient(hunting): dump: 2024-09-10T16:30:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.030 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.031 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3637534530 0 0) 0x7fa518129cc0 con 0x7fa5180a3ff0 2024-09-10T16:30:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 >> v1:172.21.15.189:6792/0 conn(0x7fa5180a4ae0 legacy=0x7fa5181d2cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 >> v1:172.21.15.189:6790/0 conn(0x7fa51813f8f0 legacy=0x7fa5181d63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 1 monclient: found mon.a 2024-09-10T16:30:20.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5180a6d50 con 0x7fa5180a3ff0 2024-09-10T16:30:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient: _finish_auth 0 2024-09-10T16:30:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 5 monclient: authenticate success, global_id 4464 2024-09-10T16:30:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient: _renew_subs 2024-09-10T16:30:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 1 -- 172.21.15.81:0/117177958 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa518129130 con 0x7fa5180a3ff0 2024-09-10T16:30:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient: _renew_subs 2024-09-10T16:30:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa5204c8640 1 -- 172.21.15.81:0/117177958 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa51813ec50 con 0x7fa5180a3ff0 2024-09-10T16:30:20.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa5080038b0 con 0x7fa5180a3ff0 2024-09-10T16:30:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa508003ee0 con 0x7fa5180a3ff0 2024-09-10T16:30:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa51ca61640 4 set_mon_vals no callback set 2024-09-10T16:30:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.010+0000 7fa50effd640 10 monclient: dump: 2024-09-10T16:30:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.033 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.034 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.014+0000 7fa5204c8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:20.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.014+0000 7fa5204c8640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:20.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.014+0000 7fa5204c8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:20.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.014+0000 7fa5204c8640 1 -- 172.21.15.81:0/117177958 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa500005090 con 0x7fa5180a3ff0 2024-09-10T16:30:20.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.014+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fa508004080 con 0x7fa5180a3ff0 2024-09-10T16:30:20.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.014+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(20..20 src has 1..20) ==== 3562+0+0 (unknown 1024368129 0 0) 0x7fa50804af10 con 0x7fa5180a3ff0 2024-09-10T16:30:20.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.014+0000 7fa51da63640 10 monclient: get_auth_request con 0x7fa4fc03d040 auth_method 0 2024-09-10T16:30:20.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.018+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7fa508016de0 con 0x7fa5180a3ff0 2024-09-10T16:30:20.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.018+0000 7fa50effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:20.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.018+0000 7fa50effd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:20.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.182+0000 7fa5204c8640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:20.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.182+0000 7fa5204c8640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:20.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.182+0000 7fa5204c8640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:20.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.182+0000 7fa5204c8640 1 -- 172.21.15.81:0/117177958 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa500005380 con 0x7fa5180a3ff0 2024-09-10T16:30:20.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.182+0000 7fa50effd640 1 -- 172.21.15.81:0/117177958 <== mon.0 v1:172.21.15.81:6789/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+10920 (unknown 898900276 0 31347236) 0x7fa5080166e0 con 0x7fa5180a3ff0 2024-09-10T16:30:20.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.182+0000 7fa50effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:30:20.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.182+0000 7fa50effd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:20.187 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:30:20.187 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":21,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","created":"2024-09-10T16:29:55.164545+0000","modified":"2024-09-10T16:30:20.044033+0000","last_up_change":"2024-09-10T16:30:08.199951+0000","last_in_change":"2024-09-10T16:29:57.004838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T16:30:08.333238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T16:30:12.247126+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c68b183d-5af0-4465-bf0b-1b1410e7a5c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6808","nonce":1659450435}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6809","nonce":1659450435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6811","nonce":1659450435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6810","nonce":1659450435}]},"public_addr":"172.21.15.81:6808/1659450435","cluster_addr":"172.21.15.81:6809/1659450435","heartbeat_back_addr":"172.21.15.81:6811/1659450435","heartbeat_front_addr":"172.21.15.81:6810/1659450435","state":["exists","up"]},{"osd":1,"uuid":"b0e4a6b2-56e9-4f68-8dc0-998d3dec5bc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6800","nonce":4086249229}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6801","nonce":4086249229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6803","nonce":4086249229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6802","nonce":4086249229}]},"public_addr":"172.21.15.81:6800/4086249229","cluster_addr":"172.21.15.81:6801/4086249229","heartbeat_back_addr":"172.21.15.81:6803/4086249229","heartbeat_front_addr":"172.21.15.81:6802/4086249229","state":["exists","up"]},{"osd":2,"uuid":"8021ac53-8498-4069-92a8-a6477fab55b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6804","nonce":2595021275}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6805","nonce":2595021275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6807","nonce":2595021275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6806","nonce":2595021275}]},"public_addr":"172.21.15.81:6804/2595021275","cluster_addr":"172.21.15.81:6805/2595021275","heartbeat_back_addr":"172.21.15.81:6807/2595021275","heartbeat_front_addr":"172.21.15.81:6806/2595021275","state":["exists","up"]},{"osd":3,"uuid":"c098399b-faef-460a-b448-a1c4ba227a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6804","nonce":3461775318}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6805","nonce":3461775318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6807","nonce":3461775318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6806","nonce":3461775318}]},"public_addr":"172.21.15.189:6804/3461775318","cluster_addr":"172.21.15.189:6805/3461775318","heartbeat_back_addr":"172.21.15.189:6807/3461775318","heartbeat_front_addr":"172.21.15.189:6806/3461775318","state":["exists","up"]},{"osd":4,"uuid":"f9ea0631-7d1d-4b3a-9806-684dfc66c44e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6808","nonce":1206180154}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6809","nonce":1206180154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6811","nonce":1206180154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6810","nonce":1206180154}]},"public_addr":"172.21.15.189:6808/1206180154","cluster_addr":"172.21.15.189:6809/1206180154","heartbeat_back_addr":"172.21.15.189:6811/1206180154","heartbeat_front_addr":"172.21.15.189:6810/1206180154","state":["exists","up"]},{"osd":5,"uuid":"e32e3250-fe69-4ef0-8553-974e89bf80e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6800","nonce":1814191784}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6801","nonce":1814191784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6803","nonce":1814191784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6802","nonce":1814191784}]},"public_addr":"172.21.15.189:6800/1814191784","cluster_addr":"172.21.15.189:6801/1814191784","heartbeat_back_addr":"172.21.15.189:6803/1814191784","heartbeat_front_addr":"172.21.15.189:6802/1814191784","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.542123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.718470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.484310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.507370+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.609326+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.643721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T16:30:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.186+0000 7fa5204c8640 1 -- 172.21.15.81:0/117177958 >> v1:172.21.15.189:6812/1108603242 conn(0x7fa4fc03d040 legacy=0x7fa4fc03f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.186+0000 7fa5204c8640 10 monclient: shutdown 2024-09-10T16:30:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.186+0000 7fa5204c8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.186+0000 7fa5204c8640 1 -- 172.21.15.81:0/117177958 >> v1:172.21.15.81:6789/0 conn(0x7fa5180a3ff0 legacy=0x7fa5181ce050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.186+0000 7fa5204c8640 1 -- 172.21.15.81:0/117177958 shutdown_connections 2024-09-10T16:30:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.186+0000 7fa5204c8640 1 -- 172.21.15.81:0/117177958 >> 172.21.15.81:0/117177958 conn(0x7fa51809cbe0 msgr2=0x7fa51809f500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.186+0000 7fa5204c8640 1 -- 172.21.15.81:0/117177958 shutdown_connections 2024-09-10T16:30:20.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.186+0000 7fa5204c8640 1 -- 172.21.15.81:0/117177958 wait complete. 2024-09-10T16:30:20.204 INFO:tasks.mon_thrash.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-10T16:30:08.333238+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 6.059999942779541, 'score_stable': 6.059999942779541, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-09-10T16:30:12.247126+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 2, 'snap_epoch': 20, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-10T16:30:20.205 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-10T16:30:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.322+0000 7f2d86a3c640 10 monclient: get_monmap_and_config 2024-09-10T16:30:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.322+0000 7f2d86a3c640 10 monclient: build_initial_monmap 2024-09-10T16:30:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.322+0000 7f2d86a3c640 10 monclient: monmap: 2024-09-10T16:30:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:20.329173+0000 2024-09-10T16:30:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:20.329173+0000 2024-09-10T16:30:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:20.328 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.322+0000 7f2d86a3c640 1 Processor -- start 2024-09-10T16:30:20.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.322+0000 7f2d86a3c640 1 -- start start 2024-09-10T16:30:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.322+0000 7f2d86a3c640 10 monclient: init 2024-09-10T16:30:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 10 monclient: _add_conns ranks=[7,3,1,8,6,0,4,5,2] 2024-09-10T16:30:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 10 monclient(hunting): picked mon.noname-i con 0x7f2d80138d00 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 10 monclient(hunting): picked mon.noname-g con 0x7f2d800a7a50 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 10 monclient(hunting): picked mon.noname-f con 0x7f2d8009ca10 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d801397b0 con 0x7f2d8009ca10 2024-09-10T16:30:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d8009d140 con 0x7f2d800a7a50 2024-09-10T16:30:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d8009db70 con 0x7f2d80138d00 2024-09-10T16:30:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 10 monclient(hunting): authenticate will time out at 987.728669s 2024-09-10T16:30:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d84fd9640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f2d8009ca10 0x7f2d801417b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.81:39054/0 (socket says 172.21.15.81:39054) 2024-09-10T16:30:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7ffff640 1 --1- >> v1:172.21.15.189:6792/0 conn(0x7f2d80138d00 0x7f2d800a7340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6792/0 says I am v1:172.21.15.81:43292/0 (socket says 172.21.15.81:43292) 2024-09-10T16:30:20.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7f7fe640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f2d800a7a50 0x7f2d8013e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.81:34998/0 (socket says 172.21.15.81:34998) 2024-09-10T16:30:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d84fd9640 1 -- 172.21.15.81:0/4009409749 learned_addr learned my addr 172.21.15.81:0/4009409749 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 1 -- 172.21.15.81:0/4009409749 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 807374235 0 0) 0x7f2d8009db70 con 0x7f2d80138d00 2024-09-10T16:30:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient(hunting): my global_id is 4399 2024-09-10T16:30:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 1 -- 172.21.15.81:0/4009409749 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d68003530 con 0x7f2d80138d00 2024-09-10T16:30:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 1 -- 172.21.15.81:0/4009409749 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1462527880 0 0) 0x7f2d8009d140 con 0x7f2d800a7a50 2024-09-10T16:30:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient(hunting): my global_id is 4341 2024-09-10T16:30:20.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 1 -- 172.21.15.81:0/4009409749 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d8009db70 con 0x7f2d800a7a50 2024-09-10T16:30:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 1 -- 172.21.15.81:0/4009409749 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4119834651 0 0) 0x7f2d801397b0 con 0x7f2d8009ca10 2024-09-10T16:30:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient(hunting): my global_id is 4402 2024-09-10T16:30:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 1 -- 172.21.15.81:0/4009409749 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d8009d140 con 0x7f2d8009ca10 2024-09-10T16:30:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 1 -- 172.21.15.81:0/4009409749 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2746107410 0 0) 0x7f2d68003530 con 0x7f2d80138d00 2024-09-10T16:30:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 1 -- 172.21.15.81:0/4009409749 >> v1:172.21.15.189:6790/0 conn(0x7f2d800a7a50 legacy=0x7f2d8013e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 1 -- 172.21.15.81:0/4009409749 >> v1:172.21.15.189:6789/0 conn(0x7f2d8009ca10 legacy=0x7f2d801417b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 1 monclient: found mon.noname-i 2024-09-10T16:30:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:20.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.189:6792/0 2024-09-10T16:30:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 1 -- 172.21.15.81:0/4009409749 --> v1:172.21.15.189:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8009de50 con 0x7f2d80138d00 2024-09-10T16:30:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient: _finish_auth 0 2024-09-10T16:30:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 1 -- 172.21.15.81:0/4009409749 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2d74001840 con 0x7f2d80138d00 2024-09-10T16:30:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-10T16:30:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient: dump: 2024-09-10T16:30:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.337 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 5 monclient: authenticate success, global_id 4399 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 1 -- 172.21.15.81:0/4009409749 <== mon.7 v1:172.21.15.189:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2d74001a60 con 0x7f2d80138d00 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:20.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:20.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 4 set_mon_vals no callback set 2024-09-10T16:30:20.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 1 -- 172.21.15.81:0/4009409749 <== mon.7 v1:172.21.15.189:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2d74004b30 con 0x7f2d80138d00 2024-09-10T16:30:20.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:20.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:30:20.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d7effd640 10 monclient: dump: 2024-09-10T16:30:20.339 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.339 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.339 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.339 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.340 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.340 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.340 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.340 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.340 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.340 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.340 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.340 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.340 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.340 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.340 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.340 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 10 monclient: shutdown 2024-09-10T16:30:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 1 -- 172.21.15.81:0/4009409749 >> v1:172.21.15.189:6792/0 conn(0x7f2d80138d00 legacy=0x7f2d800a7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 1 -- 172.21.15.81:0/4009409749 shutdown_connections 2024-09-10T16:30:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 1 -- 172.21.15.81:0/4009409749 >> 172.21.15.81:0/4009409749 conn(0x7f2d800ab930 msgr2=0x7f2d800abd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 1 -- 172.21.15.81:0/4009409749 shutdown_connections 2024-09-10T16:30:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 1 -- 172.21.15.81:0/4009409749 wait complete. 2024-09-10T16:30:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 10 monclient: build_initial_monmap 2024-09-10T16:30:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.326+0000 7f2d86a3c640 10 monclient: monmap: 2024-09-10T16:30:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:20.341 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:20.342 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:20.342 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:20.342 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:20.342 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:20.342 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:20.342 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:20.342 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:20.342 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:20.342 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:20.342 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:20.342 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 1 Processor -- start 2024-09-10T16:30:20.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 1 -- start start 2024-09-10T16:30:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 monclient: init 2024-09-10T16:30:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 monclient: _add_conns ranks=[3,5,1,2,4,6,7,0,8] 2024-09-10T16:30:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 monclient(hunting): picked mon.noname-g con 0x7f2d8009ca10 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 monclient(hunting): picked mon.noname-h con 0x7f2d800a7a50 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 monclient(hunting): picked mon.noname-f con 0x7f2d80138d00 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d80138af0 con 0x7f2d80138d00 2024-09-10T16:30:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d801cedf0 con 0x7f2d8009ca10 2024-09-10T16:30:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d80130f30 con 0x7f2d800a7a50 2024-09-10T16:30:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 monclient(hunting): authenticate will time out at 987.732977s 2024-09-10T16:30:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7ffff640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f2d8009ca10 0x7f2d801cdfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.81:35006/0 (socket says 172.21.15.81:35006) 2024-09-10T16:30:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7ffff640 1 -- 172.21.15.81:0/2395232719 learned_addr learned my addr 172.21.15.81:0/2395232719 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:20.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4146646039 0 0) 0x7f2d801cedf0 con 0x7f2d8009ca10 2024-09-10T16:30:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): my global_id is 4350 2024-09-10T16:30:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d6c003530 con 0x7f2d8009ca10 2024-09-10T16:30:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1298053184 0 0) 0x7f2d8009d140 con 0x7f2d80138d00 2024-09-10T16:30:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): my global_id is 4411 2024-09-10T16:30:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d801cedf0 con 0x7f2d80138d00 2024-09-10T16:30:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3289027218 0 0) 0x7f2d80130f30 con 0x7f2d800a7a50 2024-09-10T16:30:20.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): my global_id is 4397 2024-09-10T16:30:20.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d8009d140 con 0x7f2d800a7a50 2024-09-10T16:30:20.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 466510163 0 0) 0x7f2d6c003530 con 0x7f2d8009ca10 2024-09-10T16:30:20.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d80130f30 con 0x7f2d8009ca10 2024-09-10T16:30:20.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2d74001c10 con 0x7f2d8009ca10 2024-09-10T16:30:20.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:20.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-10T16:30:20.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): dump: 2024-09-10T16:30:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.348 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.349 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3790895944 0 0) 0x7f2d801cedf0 con 0x7f2d80138d00 2024-09-10T16:30:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d6c003530 con 0x7f2d80138d00 2024-09-10T16:30:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2d78001da0 con 0x7f2d80138d00 2024-09-10T16:30:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-10T16:30:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): dump: 2024-09-10T16:30:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.349 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.350 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2108037796 0 0) 0x7f2d8009d140 con 0x7f2d800a7a50 2024-09-10T16:30:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d801cedf0 con 0x7f2d800a7a50 2024-09-10T16:30:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2d700019d0 con 0x7f2d800a7a50 2024-09-10T16:30:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-10T16:30:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient(hunting): dump: 2024-09-10T16:30:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.351 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.352 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3399328614 0 0) 0x7f2d80130f30 con 0x7f2d8009ca10 2024-09-10T16:30:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 >> v1:172.21.15.189:6791/0 conn(0x7f2d800a7a50 legacy=0x7f2d801ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 >> v1:172.21.15.189:6789/0 conn(0x7f2d80138d00 legacy=0x7f2d801d6230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient: _finish_hunting 0 2024-09-10T16:30:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 monclient: found mon.g 2024-09-10T16:30:20.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:20.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:30:20.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d80131230 con 0x7f2d8009ca10 2024-09-10T16:30:20.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient: _finish_auth 0 2024-09-10T16:30:20.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient: _check_auth_tickets 2024-09-10T16:30:20.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:20.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 5 monclient: authenticate success, global_id 4350 2024-09-10T16:30:20.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 monclient: _renew_subs 2024-09-10T16:30:20.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:30:20.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 1 -- 172.21.15.81:0/2395232719 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2d80131510 con 0x7f2d8009ca10 2024-09-10T16:30:20.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 monclient: _renew_subs 2024-09-10T16:30:20.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:30:20.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 1 -- 172.21.15.81:0/2395232719 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2d80132290 con 0x7f2d8009ca10 2024-09-10T16:30:20.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.3 v1:172.21.15.189:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2d74001180 con 0x7f2d8009ca10 2024-09-10T16:30:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.3 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2d74001940 con 0x7f2d8009ca10 2024-09-10T16:30:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7dffb640 4 set_mon_vals no callback set 2024-09-10T16:30:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:30:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d7cff9640 10 monclient: dump: 2024-09-10T16:30:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.354 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.355 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:30:20.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.330+0000 7f2d86a3c640 1 -- 172.21.15.81:0/2395232719 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d60005090 con 0x7f2d8009ca10 2024-09-10T16:30:20.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.334+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.3 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f2d74010e90 con 0x7f2d8009ca10 2024-09-10T16:30:20.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.334+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.3 v1:172.21.15.189:6790/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 4113815040 0 0) 0x7f2d7404abb0 con 0x7f2d8009ca10 2024-09-10T16:30:20.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.334+0000 7f2d7f7fe640 10 monclient: get_auth_request con 0x7f2d6c03d9f0 auth_method 0 2024-09-10T16:30:20.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.346+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.3 v1:172.21.15.189:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f2d7404ae20 con 0x7f2d8009ca10 2024-09-10T16:30:20.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.346+0000 7f2d7cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:20.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.346+0000 7f2d7cff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.518+0000 7f2d86a3c640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-09-10T16:30:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.518+0000 7f2d86a3c640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-09-10T16:30:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.518+0000 7f2d86a3c640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:30:20.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.518+0000 7f2d86a3c640 1 -- 172.21.15.81:0/2395232719 --> v1:172.21.15.189:6790/0 -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2d60005b90 con 0x7f2d8009ca10 2024-09-10T16:30:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.518+0000 7f2d7cff9640 1 -- 172.21.15.81:0/2395232719 <== mon.3 v1:172.21.15.189:6790/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v21) ==== 93+0+10 (unknown 3303410134 0 2170607528) 0x7f2d7401f290 con 0x7f2d8009ca10 2024-09-10T16:30:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.518+0000 7f2d7cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}] 2024-09-10T16:30:20.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.518+0000 7f2d7cff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:20.522 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-10T16:30:20.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.522+0000 7f2d86a3c640 1 -- 172.21.15.81:0/2395232719 >> v1:172.21.15.189:6812/1108603242 conn(0x7f2d6c03d9f0 legacy=0x7f2d6c03feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.522+0000 7f2d86a3c640 10 monclient: shutdown 2024-09-10T16:30:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.522+0000 7f2d86a3c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.522+0000 7f2d86a3c640 1 -- 172.21.15.81:0/2395232719 >> v1:172.21.15.189:6790/0 conn(0x7f2d8009ca10 legacy=0x7f2d801cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.522+0000 7f2d86a3c640 1 -- 172.21.15.81:0/2395232719 shutdown_connections 2024-09-10T16:30:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.522+0000 7f2d86a3c640 1 -- 172.21.15.81:0/2395232719 >> 172.21.15.81:0/2395232719 conn(0x7f2d800ab930 msgr2=0x7f2d80137630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.522+0000 7f2d86a3c640 1 -- 172.21.15.81:0/2395232719 shutdown_connections 2024-09-10T16:30:20.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.522+0000 7f2d86a3c640 1 -- 172.21.15.81:0/2395232719 wait complete. 2024-09-10T16:30:20.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-09-10T16:30:20.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.654+0000 7f2f5f759640 10 monclient: get_monmap_and_config 2024-09-10T16:30:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.654+0000 7f2f5f759640 10 monclient: build_initial_monmap 2024-09-10T16:30:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.654+0000 7f2f5f759640 10 monclient: monmap: 2024-09-10T16:30:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:20.660775+0000 2024-09-10T16:30:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:20.660775+0000 2024-09-10T16:30:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:20.659 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:20.660 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:20.660 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 1 Processor -- start 2024-09-10T16:30:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 1 -- start start 2024-09-10T16:30:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient: init 2024-09-10T16:30:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient: _add_conns ranks=[8,2,4,6,0,7,1,3,5] 2024-09-10T16:30:20.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient(hunting): picked mon.noname-e con 0x7f2f5809ca10 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient(hunting): picked mon.noname-b con 0x7f2f580a5cb0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient(hunting): picked mon.noname-c con 0x7f2f58135bd0 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f58136020 con 0x7f2f580a5cb0 2024-09-10T16:30:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5809d790 con 0x7f2f58135bd0 2024-09-10T16:30:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f5809da70 con 0x7f2f5809ca10 2024-09-10T16:30:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient(hunting): authenticate will time out at 988.060808s 2024-09-10T16:30:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5dcf6640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f2f58135bd0 0x7f2f581416a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34618/0 (socket says 172.21.15.81:34618) 2024-09-10T16:30:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5dcf6640 1 -- 172.21.15.81:0/532714511 learned_addr learned my addr 172.21.15.81:0/532714511 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5ccf4640 1 --1- 172.21.15.81:0/532714511 >> v1:172.21.15.81:6790/0 conn(0x7f2f580a5cb0 0x7f2f5813df70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38650/0 (socket says 172.21.15.81:38650) 2024-09-10T16:30:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5d4f5640 1 --1- 172.21.15.81:0/532714511 >> v1:172.21.15.81:6793/0 conn(0x7f2f5809ca10 0x7f2f580a55a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35242/0 (socket says 172.21.15.81:35242) 2024-09-10T16:30:20.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 1 -- 172.21.15.81:0/532714511 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033729112 0 0) 0x7f2f5809da70 con 0x7f2f5809ca10 2024-09-10T16:30:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient(hunting): my global_id is 4346 2024-09-10T16:30:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 1 -- 172.21.15.81:0/532714511 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f44003530 con 0x7f2f5809ca10 2024-09-10T16:30:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 1 -- 172.21.15.81:0/532714511 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1685102849 0 0) 0x7f2f58136020 con 0x7f2f580a5cb0 2024-09-10T16:30:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient(hunting): my global_id is 4439 2024-09-10T16:30:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 1 -- 172.21.15.81:0/532714511 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f5809da70 con 0x7f2f580a5cb0 2024-09-10T16:30:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 1 -- 172.21.15.81:0/532714511 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3783134602 0 0) 0x7f2f5809d790 con 0x7f2f58135bd0 2024-09-10T16:30:20.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient(hunting): my global_id is 4441 2024-09-10T16:30:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 1 -- 172.21.15.81:0/532714511 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f58136020 con 0x7f2f58135bd0 2024-09-10T16:30:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 1 -- 172.21.15.81:0/532714511 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2290453945 0 0) 0x7f2f44003530 con 0x7f2f5809ca10 2024-09-10T16:30:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 1 -- 172.21.15.81:0/532714511 >> v1:172.21.15.81:6791/0 conn(0x7f2f58135bd0 legacy=0x7f2f581416a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 1 -- 172.21.15.81:0/532714511 >> v1:172.21.15.81:6790/0 conn(0x7f2f580a5cb0 legacy=0x7f2f5813df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient: _finish_hunting 0 2024-09-10T16:30:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 1 monclient: found mon.noname-e 2024-09-10T16:30:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:30:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 1 -- 172.21.15.81:0/532714511 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f5809dd50 con 0x7f2f5809ca10 2024-09-10T16:30:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient: _finish_auth 0 2024-09-10T16:30:20.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient: _check_auth_tickets 2024-09-10T16:30:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 1 -- 172.21.15.81:0/532714511 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2f54001770 con 0x7f2f5809ca10 2024-09-10T16:30:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient: dump: 2024-09-10T16:30:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.670 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 5 monclient: authenticate success, global_id 4346 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 1 -- 172.21.15.81:0/532714511 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f54001910 con 0x7f2f5809ca10 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 1 -- 172.21.15.81:0/532714511 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2f540047f0 con 0x7f2f5809ca10 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:20.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f4ffff640 10 monclient: dump: 2024-09-10T16:30:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.672 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.673 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 4 set_mon_vals no callback set 2024-09-10T16:30:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient: shutdown 2024-09-10T16:30:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 1 -- 172.21.15.81:0/532714511 >> v1:172.21.15.81:6793/0 conn(0x7f2f5809ca10 legacy=0x7f2f580a55a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 1 -- 172.21.15.81:0/532714511 shutdown_connections 2024-09-10T16:30:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 1 -- 172.21.15.81:0/532714511 >> 172.21.15.81:0/532714511 conn(0x7f2f5806dc90 msgr2=0x7f2f580aba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:20.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 1 -- 172.21.15.81:0/532714511 shutdown_connections 2024-09-10T16:30:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 1 -- 172.21.15.81:0/532714511 wait complete. 2024-09-10T16:30:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient: build_initial_monmap 2024-09-10T16:30:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient: monmap: 2024-09-10T16:30:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:20.676 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:20.677 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 1 Processor -- start 2024-09-10T16:30:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 1 -- start start 2024-09-10T16:30:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient: init 2024-09-10T16:30:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient: _add_conns ranks=[2,4,0,7,5,3,6,1,8] 2024-09-10T16:30:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient(hunting): picked mon.noname-b con 0x7f2f5809ca10 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:20.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient(hunting): picked mon.noname-c con 0x7f2f580a5cb0 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.658+0000 7f2f5f759640 10 monclient(hunting): picked mon.noname-a con 0x7f2f58135bd0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f581cebf0 con 0x7f2f58135bd0 2024-09-10T16:30:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f580aaa60 con 0x7f2f5809ca10 2024-09-10T16:30:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f580a8f30 con 0x7f2f580a5cb0 2024-09-10T16:30:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 10 monclient(hunting): authenticate will time out at 988.064043s 2024-09-10T16:30:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5d4f5640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f2f5809ca10 0x7f2f581cddd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38652/0 (socket says 172.21.15.81:38652) 2024-09-10T16:30:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5ccf4640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f2f580a5cb0 0x7f2f581ce4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34624/0 (socket says 172.21.15.81:34624) 2024-09-10T16:30:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5d4f5640 1 -- 172.21.15.81:0/833319737 learned_addr learned my addr 172.21.15.81:0/833319737 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2059984191 0 0) 0x7f2f580a8f30 con 0x7f2f580a5cb0 2024-09-10T16:30:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): my global_id is 4450 2024-09-10T16:30:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f3c003530 con 0x7f2f580a5cb0 2024-09-10T16:30:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3546613835 0 0) 0x7f2f581cebf0 con 0x7f2f58135bd0 2024-09-10T16:30:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): my global_id is 4473 2024-09-10T16:30:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f580a8f30 con 0x7f2f58135bd0 2024-09-10T16:30:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2834027598 0 0) 0x7f2f580aaa60 con 0x7f2f5809ca10 2024-09-10T16:30:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): my global_id is 4448 2024-09-10T16:30:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f581cebf0 con 0x7f2f5809ca10 2024-09-10T16:30:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 634811547 0 0) 0x7f2f3c003530 con 0x7f2f580a5cb0 2024-09-10T16:30:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f580aaa60 con 0x7f2f580a5cb0 2024-09-10T16:30:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1542403867 0 0) 0x7f2f580a8f30 con 0x7f2f58135bd0 2024-09-10T16:30:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2f3c003530 con 0x7f2f58135bd0 2024-09-10T16:30:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2f48001620 con 0x7f2f580a5cb0 2024-09-10T16:30:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): dump: 2024-09-10T16:30:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.680 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.681 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:20.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2f50001d40 con 0x7f2f58135bd0 2024-09-10T16:30:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient(hunting): dump: 2024-09-10T16:30:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.682 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.683 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3640151758 0 0) 0x7f2f580aaa60 con 0x7f2f580a5cb0 2024-09-10T16:30:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 >> v1:172.21.15.81:6790/0 conn(0x7f2f5809ca10 legacy=0x7f2f581cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 >> v1:172.21.15.81:6789/0 conn(0x7f2f58135bd0 legacy=0x7f2f581d6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient: _finish_hunting 0 2024-09-10T16:30:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 monclient: found mon.c 2024-09-10T16:30:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f580a53e0 con 0x7f2f580a5cb0 2024-09-10T16:30:20.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient: _finish_auth 0 2024-09-10T16:30:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient: _check_auth_tickets 2024-09-10T16:30:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 5 monclient: authenticate success, global_id 4450 2024-09-10T16:30:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 10 monclient: _renew_subs 2024-09-10T16:30:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 1 -- 172.21.15.81:0/833319737 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2f5809fb60 con 0x7f2f580a5cb0 2024-09-10T16:30:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 10 monclient: _renew_subs 2024-09-10T16:30:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 1 -- 172.21.15.81:0/833319737 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f2f580a09d0 con 0x7f2f580a5cb0 2024-09-10T16:30:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2f48004aa0 con 0x7f2f580a5cb0 2024-09-10T16:30:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2f48004f90 con 0x7f2f580a5cb0 2024-09-10T16:30:20.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4f7fe640 4 set_mon_vals no callback set 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 10 monclient: dump: 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.685 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.686 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5f759640 1 -- 172.21.15.81:0/833319737 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f38005090 con 0x7f2f580a5cb0 2024-09-10T16:30:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f2f48010ea0 con 0x7f2f580a5cb0 2024-09-10T16:30:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 4113815040 0 0) 0x7f2f4804ad40 con 0x7f2f580a5cb0 2024-09-10T16:30:20.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.662+0000 7f2f5d4f5640 10 monclient: get_auth_request con 0x7f2f3c03d520 auth_method 0 2024-09-10T16:30:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.666+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f2f48016cc0 con 0x7f2f580a5cb0 2024-09-10T16:30:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.666+0000 7f2f4dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:20.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.666+0000 7f2f4dffb640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:20.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.822+0000 7f2f5f759640 10 start_mon_command cmd=[{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-09-10T16:30:20.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.822+0000 7f2f5f759640 10 monclient: _send_command 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-09-10T16:30:20.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.822+0000 7f2f5f759640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:20.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.822+0000 7f2f5f759640 1 -- 172.21.15.81:0/833319737 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) -- 0x7f2f38005c50 con 0x7f2f580a5cb0 2024-09-10T16:30:20.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.822+0000 7f2f4dffb640 1 -- 172.21.15.81:0/833319737 <== mon.4 v1:172.21.15.81:6791/0 10 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v21) ==== 92+0+10 (unknown 4161178158 0 265718887) 0x7f2f480165c0 con 0x7f2f580a5cb0 2024-09-10T16:30:20.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.822+0000 7f2f4dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}] 2024-09-10T16:30:20.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.826+0000 7f2f4dffb640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:20.828 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 8 2024-09-10T16:30:20.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.826+0000 7f2f5f759640 1 -- 172.21.15.81:0/833319737 >> v1:172.21.15.189:6812/1108603242 conn(0x7f2f3c03d520 legacy=0x7f2f3c03f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.826+0000 7f2f5f759640 10 monclient: shutdown 2024-09-10T16:30:20.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.826+0000 7f2f5f759640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:20.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.826+0000 7f2f5f759640 1 -- 172.21.15.81:0/833319737 >> v1:172.21.15.81:6791/0 conn(0x7f2f580a5cb0 legacy=0x7f2f581ce4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.826+0000 7f2f5f759640 1 -- 172.21.15.81:0/833319737 shutdown_connections 2024-09-10T16:30:20.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.826+0000 7f2f5f759640 1 -- 172.21.15.81:0/833319737 >> 172.21.15.81:0/833319737 conn(0x7f2f5806dc90 msgr2=0x7f2f58133d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:20.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.826+0000 7f2f5f759640 1 -- 172.21.15.81:0/833319737 shutdown_connections 2024-09-10T16:30:20.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.826+0000 7f2f5f759640 1 -- 172.21.15.81:0/833319737 wait complete. 2024-09-10T16:30:20.845 INFO:tasks.mon_thrash.ceph_manager:waiting for clean 2024-09-10T16:30:20.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T16:30:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.950+0000 7f695488b640 10 monclient: get_monmap_and_config 2024-09-10T16:30:20.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.950+0000 7f695488b640 10 monclient: build_initial_monmap 2024-09-10T16:30:20.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.950+0000 7f695488b640 10 monclient: monmap: 2024-09-10T16:30:20.955 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:20.955 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.955 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:20.956483+0000 2024-09-10T16:30:20.955 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:20.956483+0000 2024-09-10T16:30:20.955 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:20.955 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.955 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:20.955 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:20.955 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:20.955 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:20.955 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:20.955 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:20.955 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:20.956 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:20.956 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:20.956 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.950+0000 7f695488b640 1 Processor -- start 2024-09-10T16:30:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.950+0000 7f695488b640 1 -- start start 2024-09-10T16:30:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.950+0000 7f695488b640 10 monclient: init 2024-09-10T16:30:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient: _add_conns ranks=[4,1,3,6,5,2,0,7,8] 2024-09-10T16:30:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient(hunting): picked mon.noname-c con 0x7f695009ca10 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient(hunting): picked mon.noname-f con 0x7f69500a56e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient(hunting): picked mon.noname-g con 0x7f69500a5b00 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69501362b0 con 0x7f69500a56e0 2024-09-10T16:30:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69500a80b0 con 0x7f69500a5b00 2024-09-10T16:30:20.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f695009de70 con 0x7f695009ca10 2024-09-10T16:30:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient(hunting): authenticate will time out at 988.356385s 2024-09-10T16:30:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694e59c640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f695009ca10 0x7f6950135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34632/0 (socket says 172.21.15.81:34632) 2024-09-10T16:30:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694e59c640 1 -- 172.21.15.81:0/2867034068 learned_addr learned my addr 172.21.15.81:0/2867034068 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 1 -- 172.21.15.81:0/2867034068 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2498448861 0 0) 0x7f695009de70 con 0x7f695009ca10 2024-09-10T16:30:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient(hunting): my global_id is 4459 2024-09-10T16:30:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 1 -- 172.21.15.81:0/2867034068 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6930003530 con 0x7f695009ca10 2024-09-10T16:30:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 1 -- 172.21.15.81:0/2867034068 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1112377434 0 0) 0x7f6930003530 con 0x7f695009ca10 2024-09-10T16:30:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 1 -- 172.21.15.81:0/2867034068 >> v1:172.21.15.189:6790/0 conn(0x7f69500a5b00 legacy=0x7f6950141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 1 -- 172.21.15.81:0/2867034068 >> v1:172.21.15.189:6789/0 conn(0x7f69500a56e0 legacy=0x7f695013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient: _finish_hunting 0 2024-09-10T16:30:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 1 monclient: found mon.noname-c 2024-09-10T16:30:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:30:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 1 -- 172.21.15.81:0/2867034068 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695009e150 con 0x7f695009ca10 2024-09-10T16:30:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient: _finish_auth 0 2024-09-10T16:30:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient: _check_auth_tickets 2024-09-10T16:30:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 5 monclient: authenticate success, global_id 4459 2024-09-10T16:30:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 1 -- 172.21.15.81:0/2867034068 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6940001840 con 0x7f695009ca10 2024-09-10T16:30:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:20.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient: dump: 2024-09-10T16:30:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.964 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.965 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 1 -- 172.21.15.81:0/2867034068 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6940001a60 con 0x7f695009ca10 2024-09-10T16:30:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 4 set_mon_vals no callback set 2024-09-10T16:30:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 1 -- 172.21.15.81:0/2867034068 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6940004bf0 con 0x7f695009ca10 2024-09-10T16:30:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694dd9b640 10 monclient: dump: 2024-09-10T16:30:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.965 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.966 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.966 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.966 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.966 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.966 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.966 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.966 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.966 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.966 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.966 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.966 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.966 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.966 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.966 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient: shutdown 2024-09-10T16:30:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 -- 172.21.15.81:0/2867034068 >> v1:172.21.15.81:6791/0 conn(0x7f695009ca10 legacy=0x7f6950135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 -- 172.21.15.81:0/2867034068 shutdown_connections 2024-09-10T16:30:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 -- 172.21.15.81:0/2867034068 >> 172.21.15.81:0/2867034068 conn(0x7f695006dc90 msgr2=0x7f69500ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 -- 172.21.15.81:0/2867034068 shutdown_connections 2024-09-10T16:30:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 -- 172.21.15.81:0/2867034068 wait complete. 2024-09-10T16:30:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient: build_initial_monmap 2024-09-10T16:30:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient: monmap: 2024-09-10T16:30:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:20.967 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:20.968 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 Processor -- start 2024-09-10T16:30:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 -- start start 2024-09-10T16:30:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient: init 2024-09-10T16:30:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient: _add_conns ranks=[2,1,3,8,6,0,7,5,4] 2024-09-10T16:30:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient(hunting): picked mon.noname-b con 0x7f695009ca10 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient(hunting): picked mon.noname-f con 0x7f69500a56e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient(hunting): picked mon.noname-g con 0x7f69500a5b00 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69501388e0 con 0x7f69500a56e0 2024-09-10T16:30:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69500aa4c0 con 0x7f695009ca10 2024-09-10T16:30:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6950142b40 con 0x7f69500a5b00 2024-09-10T16:30:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient(hunting): authenticate will time out at 988.359108s 2024-09-10T16:30:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694e59c640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f695009ca10 0x7f6950136f10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38654/0 (socket says 172.21.15.81:38654) 2024-09-10T16:30:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694e59c640 1 -- 172.21.15.81:0/347129728 learned_addr learned my addr 172.21.15.81:0/347129728 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 818580128 0 0) 0x7f69500aa4c0 con 0x7f695009ca10 2024-09-10T16:30:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient(hunting): my global_id is 4457 2024-09-10T16:30:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6934003530 con 0x7f695009ca10 2024-09-10T16:30:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4175507545 0 0) 0x7f6934003530 con 0x7f695009ca10 2024-09-10T16:30:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f69500aa4c0 con 0x7f695009ca10 2024-09-10T16:30:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6940004b30 con 0x7f695009ca10 2024-09-10T16:30:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.970 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.971 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 256823460 0 0) 0x7f69500aa4c0 con 0x7f695009ca10 2024-09-10T16:30:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 >> v1:172.21.15.189:6790/0 conn(0x7f69500a5b00 legacy=0x7f6950137d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 >> v1:172.21.15.189:6789/0 conn(0x7f69500a56e0 legacy=0x7f6950137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 1 monclient: found mon.b 2024-09-10T16:30:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f695013ac40 con 0x7f695009ca10 2024-09-10T16:30:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 5 monclient: authenticate success, global_id 4457 2024-09-10T16:30:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient: _renew_subs 2024-09-10T16:30:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 -- 172.21.15.81:0/347129728 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6950139440 con 0x7f695009ca10 2024-09-10T16:30:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient: _renew_subs 2024-09-10T16:30:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f695488b640 1 -- 172.21.15.81:0/347129728 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f69501d6fc0 con 0x7f695009ca10 2024-09-10T16:30:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6940001960 con 0x7f695009ca10 2024-09-10T16:30:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f69400051f0 con 0x7f695009ca10 2024-09-10T16:30:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f694d59a640 4 set_mon_vals no callback set 2024-09-10T16:30:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.954+0000 7f6946ffd640 10 monclient: dump: 2024-09-10T16:30:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:20.974 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.958+0000 7f695488b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.958+0000 7f695488b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.958+0000 7f695488b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.958+0000 7f695488b640 1 -- 172.21.15.81:0/347129728 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6928005090 con 0x7f695009ca10 2024-09-10T16:30:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.958+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f6940011100 con 0x7f695009ca10 2024-09-10T16:30:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.958+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 4113815040 0 0) 0x7f694004ae90 con 0x7f695009ca10 2024-09-10T16:30:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.958+0000 7f6947fff640 10 monclient: get_auth_request con 0x7f693403d040 auth_method 0 2024-09-10T16:30:20.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.962+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f6940016d80 con 0x7f695009ca10 2024-09-10T16:30:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.962+0000 7f6946ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:20.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:20.962+0000 7f6946ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:21.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.118+0000 7f695488b640 1 -- 172.21.15.81:0/347129728 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6928000ba0 con 0x7f693403d040 2024-09-10T16:30:21.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.122+0000 7f6946ffd640 1 -- 172.21.15.81:0/347129728 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34160 (unknown 2965378022 0 1476957762) 0x7f6928000ba0 con 0x7f693403d040 2024-09-10T16:30:21.125 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:30:21.125 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T16:30:21.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.122+0000 7f695488b640 1 -- 172.21.15.81:0/347129728 >> v1:172.21.15.189:6812/1108603242 conn(0x7f693403d040 legacy=0x7f693403f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.122+0000 7f695488b640 10 monclient: shutdown 2024-09-10T16:30:21.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.122+0000 7f695488b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:21.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.122+0000 7f695488b640 1 -- 172.21.15.81:0/347129728 >> v1:172.21.15.81:6790/0 conn(0x7f695009ca10 legacy=0x7f6950136f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.122+0000 7f695488b640 1 -- 172.21.15.81:0/347129728 shutdown_connections 2024-09-10T16:30:21.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.122+0000 7f695488b640 1 -- 172.21.15.81:0/347129728 >> 172.21.15.81:0/347129728 conn(0x7f695006dc90 msgr2=0x7f6950134d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:21.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.122+0000 7f695488b640 1 -- 172.21.15.81:0/347129728 shutdown_connections 2024-09-10T16:30:21.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.122+0000 7f695488b640 1 -- 172.21.15.81:0/347129728 wait complete. 2024-09-10T16:30:21.141 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-10T16:30:20.286412+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163288,"kb_used_data":1120,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067752,"statfs":{"total":579820584960,"available":579653378048,"internally_reserved":0,"allocated":1146880,"data_stored":1380568,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001791"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334487+0000","last_change":"2024-09-10T16:30:15.334487+0000","last_active":"2024-09-10T16:30:15.334487+0000","last_peered":"2024-09-10T16:30:15.334487+0000","last_clean":"2024-09-10T16:30:15.334487+0000","last_became_active":"2024-09-10T16:30:13.320369+0000","last_became_peered":"2024-09-10T16:30:13.320369+0000","last_unstale":"2024-09-10T16:30:15.334487+0000","last_undegraded":"2024-09-10T16:30:15.334487+0000","last_fullsized":"2024-09-10T16:30:15.334487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:03.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011103879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334530+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:30:15.334530+0000","last_peered":"2024-09-10T16:30:15.334530+0000","last_clean":"2024-09-10T16:30:15.334530+0000","last_became_active":"2024-09-10T16:30:13.320284+0000","last_became_peered":"2024-09-10T16:30:13.320284+0000","last_unstale":"2024-09-10T16:30:15.334530+0000","last_undegraded":"2024-09-10T16:30:15.334530+0000","last_fullsized":"2024-09-10T16:30:15.334530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:11.783078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065529,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.335682+0000","last_change":"2024-09-10T16:30:15.335682+0000","last_active":"2024-09-10T16:30:15.335682+0000","last_peered":"2024-09-10T16:30:15.335682+0000","last_clean":"2024-09-10T16:30:15.335682+0000","last_became_active":"2024-09-10T16:30:13.317933+0000","last_became_peered":"2024-09-10T16:30:13.317933+0000","last_unstale":"2024-09-10T16:30:15.335682+0000","last_undegraded":"2024-09-10T16:30:15.335682+0000","last_fullsized":"2024-09-10T16:30:15.335682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:11.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018898459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334580+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:30:15.334580+0000","last_peered":"2024-09-10T16:30:15.334580+0000","last_clean":"2024-09-10T16:30:15.334580+0000","last_became_active":"2024-09-10T16:30:13.314196+0000","last_became_peered":"2024-09-10T16:30:13.314196+0000","last_unstale":"2024-09-10T16:30:15.334580+0000","last_undegraded":"2024-09-10T16:30:15.334580+0000","last_fullsized":"2024-09-10T16:30:15.334580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:17.356490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092995700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.343908+0000","last_change":"2024-09-10T16:30:15.343908+0000","last_active":"2024-09-10T16:30:15.343908+0000","last_peered":"2024-09-10T16:30:15.343908+0000","last_clean":"2024-09-10T16:30:15.343908+0000","last_became_active":"2024-09-10T16:30:13.322410+0000","last_became_peered":"2024-09-10T16:30:13.322410+0000","last_unstale":"2024-09-10T16:30:15.343908+0000","last_undegraded":"2024-09-10T16:30:15.343908+0000","last_fullsized":"2024-09-10T16:30:15.343908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:23.371637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024400910000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334785+0000","last_change":"2024-09-10T16:30:15.335359+0000","last_active":"2024-09-10T16:30:15.334785+0000","last_peered":"2024-09-10T16:30:15.334785+0000","last_clean":"2024-09-10T16:30:15.334785+0000","last_became_active":"2024-09-10T16:30:13.314279+0000","last_became_peered":"2024-09-10T16:30:13.314279+0000","last_unstale":"2024-09-10T16:30:15.334785+0000","last_undegraded":"2024-09-10T16:30:15.334785+0000","last_fullsized":"2024-09-10T16:30:15.334785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:19.341302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012467800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.335268+0000","last_change":"2024-09-10T16:30:15.336057+0000","last_active":"2024-09-10T16:30:15.335268+0000","last_peered":"2024-09-10T16:30:15.335268+0000","last_clean":"2024-09-10T16:30:15.335268+0000","last_became_active":"2024-09-10T16:30:13.315537+0000","last_became_peered":"2024-09-10T16:30:13.315537+0000","last_unstale":"2024-09-10T16:30:15.335268+0000","last_undegraded":"2024-09-10T16:30:15.335268+0000","last_fullsized":"2024-09-10T16:30:15.335268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:18.484028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001369903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334665+0000","last_change":"2024-09-10T16:30:15.334665+0000","last_active":"2024-09-10T16:30:15.334665+0000","last_peered":"2024-09-10T16:30:15.334665+0000","last_clean":"2024-09-10T16:30:15.334665+0000","last_became_active":"2024-09-10T16:30:13.317955+0000","last_became_peered":"2024-09-10T16:30:13.317955+0000","last_unstale":"2024-09-10T16:30:15.334665+0000","last_undegraded":"2024-09-10T16:30:15.334665+0000","last_fullsized":"2024-09-10T16:30:15.334665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:01.463525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016930140000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.332750+0000","last_change":"2024-09-10T16:30:10.241185+0000","last_active":"2024-09-10T16:30:15.332750+0000","last_peered":"2024-09-10T16:30:15.332750+0000","last_clean":"2024-09-10T16:30:15.332750+0000","last_became_active":"2024-09-10T16:30:10.239296+0000","last_became_peered":"2024-09-10T16:30:10.239296+0000","last_unstale":"2024-09-10T16:30:15.332750+0000","last_undegraded":"2024-09-10T16:30:15.332750+0000","last_fullsized":"2024-09-10T16:30:15.332750+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_clean_scrub_stamp":"2024-09-10T16:30:09.204141+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:25.346646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":582707,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":53798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":53798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":582707,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T16:30:21.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T16:30:21.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.246+0000 7fdb0c501640 10 monclient: get_monmap_and_config 2024-09-10T16:30:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.246+0000 7fdb0c501640 10 monclient: build_initial_monmap 2024-09-10T16:30:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.246+0000 7fdb0c501640 10 monclient: monmap: 2024-09-10T16:30:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:21.252753+0000 2024-09-10T16:30:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:21.252753+0000 2024-09-10T16:30:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:21.251 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:21.252 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:21.252 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:21.252 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:21.252 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:21.252 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:21.252 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:21.252 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.246+0000 7fdb0c501640 1 Processor -- start 2024-09-10T16:30:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.246+0000 7fdb0c501640 1 -- start start 2024-09-10T16:30:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.246+0000 7fdb0c501640 10 monclient: init 2024-09-10T16:30:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 10 monclient: _add_conns ranks=[3,7,1,8,2,0,5,4,6] 2024-09-10T16:30:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 10 monclient(hunting): picked mon.noname-g con 0x7fdb040a5550 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 10 monclient(hunting): picked mon.noname-i con 0x7fdb04135ad0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 10 monclient(hunting): picked mon.noname-f con 0x7fdb04135ee0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb040ab570 con 0x7fdb04135ee0 2024-09-10T16:30:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb0409d720 con 0x7fdb040a5550 2024-09-10T16:30:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb0409da00 con 0x7fdb04135ad0 2024-09-10T16:30:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 10 monclient(hunting): authenticate will time out at 988.652717s 2024-09-10T16:30:21.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb09a9c640 1 --1- >> v1:172.21.15.189:6792/0 conn(0x7fdb04135ad0 0x7fdb0413df10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6792/0 says I am v1:172.21.15.81:43300/0 (socket says 172.21.15.81:43300) 2024-09-10T16:30:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb09a9c640 1 -- 172.21.15.81:0/1666011405 learned_addr learned my addr 172.21.15.81:0/1666011405 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0a29d640 1 --1- 172.21.15.81:0/1666011405 >> v1:172.21.15.189:6790/0 conn(0x7fdb040a5550 0x7fdb040a5930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.81:35040/0 (socket says 172.21.15.81:35040) 2024-09-10T16:30:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0aa9e640 1 --1- 172.21.15.81:0/1666011405 >> v1:172.21.15.189:6789/0 conn(0x7fdb04135ee0 0x7fdb04141640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.81:39102/0 (socket says 172.21.15.81:39102) 2024-09-10T16:30:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 1 -- 172.21.15.81:0/1666011405 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1628848965 0 0) 0x7fdb0409da00 con 0x7fdb04135ad0 2024-09-10T16:30:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient(hunting): my global_id is 4408 2024-09-10T16:30:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 1 -- 172.21.15.81:0/1666011405 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaf0003530 con 0x7fdb04135ad0 2024-09-10T16:30:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 1 -- 172.21.15.81:0/1666011405 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2470153326 0 0) 0x7fdb040ab570 con 0x7fdb04135ee0 2024-09-10T16:30:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient(hunting): my global_id is 4438 2024-09-10T16:30:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 1 -- 172.21.15.81:0/1666011405 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb0409da00 con 0x7fdb04135ee0 2024-09-10T16:30:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 1 -- 172.21.15.81:0/1666011405 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 237397067 0 0) 0x7fdb0409d720 con 0x7fdb040a5550 2024-09-10T16:30:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient(hunting): my global_id is 4377 2024-09-10T16:30:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 1 -- 172.21.15.81:0/1666011405 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb040ab570 con 0x7fdb040a5550 2024-09-10T16:30:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 1 -- 172.21.15.81:0/1666011405 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2775085492 0 0) 0x7fdaf0003530 con 0x7fdb04135ad0 2024-09-10T16:30:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 1 -- 172.21.15.81:0/1666011405 >> v1:172.21.15.189:6790/0 conn(0x7fdb040a5550 legacy=0x7fdb040a5930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 1 -- 172.21.15.81:0/1666011405 >> v1:172.21.15.189:6789/0 conn(0x7fdb04135ee0 legacy=0x7fdb04141640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient: _finish_hunting 0 2024-09-10T16:30:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 1 monclient: found mon.noname-i 2024-09-10T16:30:21.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient: _send_mon_message to mon.noname-i at v1:172.21.15.189:6792/0 2024-09-10T16:30:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 1 -- 172.21.15.81:0/1666011405 --> v1:172.21.15.189:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb0409cd30 con 0x7fdb04135ad0 2024-09-10T16:30:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient: _finish_auth 0 2024-09-10T16:30:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient: _check_auth_tickets 2024-09-10T16:30:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 1 -- 172.21.15.81:0/1666011405 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdb00001bc0 con 0x7fdb04135ad0 2024-09-10T16:30:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient: got monmap 1 from mon.noname-i (according to old e1) 2024-09-10T16:30:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient: dump: 2024-09-10T16:30:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.258 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.259 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 5 monclient: authenticate success, global_id 4408 2024-09-10T16:30:21.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:21.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 1 -- 172.21.15.81:0/1666011405 <== mon.7 v1:172.21.15.189:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdb00001de0 con 0x7fdb04135ad0 2024-09-10T16:30:21.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:21.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:21.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 1 -- 172.21.15.81:0/1666011405 <== mon.7 v1:172.21.15.189:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdb00004f70 con 0x7fdb04135ad0 2024-09-10T16:30:21.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 4 set_mon_vals no callback set 2024-09-10T16:30:21.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:21.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:30:21.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0929b640 10 monclient: dump: 2024-09-10T16:30:21.260 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.260 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.260 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.260 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.260 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.261 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 10 monclient: shutdown 2024-09-10T16:30:21.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 1 -- 172.21.15.81:0/1666011405 >> v1:172.21.15.189:6792/0 conn(0x7fdb04135ad0 legacy=0x7fdb0413df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 1 -- 172.21.15.81:0/1666011405 shutdown_connections 2024-09-10T16:30:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 1 -- 172.21.15.81:0/1666011405 >> 172.21.15.81:0/1666011405 conn(0x7fdb0406dab0 msgr2=0x7fdb040ab9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 1 -- 172.21.15.81:0/1666011405 shutdown_connections 2024-09-10T16:30:21.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 1 -- 172.21.15.81:0/1666011405 wait complete. 2024-09-10T16:30:21.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 10 monclient: build_initial_monmap 2024-09-10T16:30:21.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 10 monclient: monmap: 2024-09-10T16:30:21.265 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:21.265 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:21.266 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:21.267 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.250+0000 7fdb0c501640 1 Processor -- start 2024-09-10T16:30:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 1 -- start start 2024-09-10T16:30:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 monclient: init 2024-09-10T16:30:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 monclient: _add_conns ranks=[8,6,1,2,4,0,3,7,5] 2024-09-10T16:30:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 monclient(hunting): picked mon.noname-e con 0x7fdb040a5550 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 monclient(hunting): picked mon.noname-d con 0x7fdb04135ad0 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 monclient(hunting): picked mon.noname-f con 0x7fdb04135ee0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb0409f300 con 0x7fdb04135ee0 2024-09-10T16:30:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb0409f510 con 0x7fdb04135ad0 2024-09-10T16:30:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb040a0130 con 0x7fdb040a5550 2024-09-10T16:30:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:21.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 monclient(hunting): authenticate will time out at 988.656589s 2024-09-10T16:30:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0a29d640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fdb040a5550 0x7fdb0409e4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35252/0 (socket says 172.21.15.81:35252) 2024-09-10T16:30:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb09a9c640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fdb04135ad0 0x7fdb0409ebf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56218/0 (socket says 172.21.15.81:56218) 2024-09-10T16:30:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0a29d640 1 -- 172.21.15.81:0/4079299313 learned_addr learned my addr 172.21.15.81:0/4079299313 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2775414024 0 0) 0x7fdb040a0130 con 0x7fdb040a5550 2024-09-10T16:30:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): my global_id is 4355 2024-09-10T16:30:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdae8003530 con 0x7fdb040a5550 2024-09-10T16:30:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 725939969 0 0) 0x7fdb0409f510 con 0x7fdb04135ad0 2024-09-10T16:30:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): my global_id is 4398 2024-09-10T16:30:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb040a0130 con 0x7fdb04135ad0 2024-09-10T16:30:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2088573814 0 0) 0x7fdae8003530 con 0x7fdb040a5550 2024-09-10T16:30:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdb0409f510 con 0x7fdb040a5550 2024-09-10T16:30:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdaf4001aa0 con 0x7fdb040a5550 2024-09-10T16:30:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): dump: 2024-09-10T16:30:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.269 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.270 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:21.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1529429077 0 0) 0x7fdb040a0130 con 0x7fdb04135ad0 2024-09-10T16:30:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdae8003530 con 0x7fdb04135ad0 2024-09-10T16:30:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1450906627 0 0) 0x7fdb0409f300 con 0x7fdb04135ee0 2024-09-10T16:30:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): my global_id is 4447 2024-09-10T16:30:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdb040a0130 con 0x7fdb04135ee0 2024-09-10T16:30:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdb00004eb0 con 0x7fdb04135ad0 2024-09-10T16:30:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient(hunting): dump: 2024-09-10T16:30:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.271 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.272 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.272 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4186553886 0 0) 0x7fdb0409f510 con 0x7fdb040a5550 2024-09-10T16:30:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 >> v1:172.21.15.81:6792/0 conn(0x7fdb04135ad0 legacy=0x7fdb0409ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 >> v1:172.21.15.189:6789/0 conn(0x7fdb04135ee0 legacy=0x7fdb041d5eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 monclient: found mon.e 2024-09-10T16:30:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb040a0410 con 0x7fdb040a5550 2024-09-10T16:30:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 5 monclient: authenticate success, global_id 4355 2024-09-10T16:30:21.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 monclient: _renew_subs 2024-09-10T16:30:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 1 -- 172.21.15.81:0/4079299313 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdb04132490 con 0x7fdb040a5550 2024-09-10T16:30:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 monclient: _renew_subs 2024-09-10T16:30:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 1 -- 172.21.15.81:0/4079299313 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fdb040a5250 con 0x7fdb040a5550 2024-09-10T16:30:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb0c501640 1 -- 172.21.15.81:0/4079299313 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb040008e0 con 0x7fdb040a5550 2024-09-10T16:30:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdaf4004aa0 con 0x7fdb040a5550 2024-09-10T16:30:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdaf4004fd0 con 0x7fdb040a5550 2024-09-10T16:30:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:21.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb08a9a640 4 set_mon_vals no callback set 2024-09-10T16:30:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 10 monclient: dump: 2024-09-10T16:30:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.275 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.276 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fdaf4005230 con 0x7fdb040a5550 2024-09-10T16:30:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 4113815040 0 0) 0x7fdaf404ad20 con 0x7fdb040a5550 2024-09-10T16:30:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.254+0000 7fdb09a9c640 10 monclient: get_auth_request con 0x7fdae803d870 auth_method 0 2024-09-10T16:30:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.258+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 <== mon.8 v1:172.21.15.81:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7fdaf4016b70 con 0x7fdb040a5550 2024-09-10T16:30:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.258+0000 7fdafaffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:21.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.258+0000 7fdafaffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:21.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.430+0000 7fdb0c501640 1 -- 172.21.15.81:0/4079299313 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdb040a0650 con 0x7fdae803d870 2024-09-10T16:30:21.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.434+0000 7fdafaffd640 1 -- 172.21.15.81:0/4079299313 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34160 (unknown 2965378022 0 1476957762) 0x7fdb040a0650 con 0x7fdae803d870 2024-09-10T16:30:21.437 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:30:21.438 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T16:30:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.434+0000 7fdb0c501640 1 -- 172.21.15.81:0/4079299313 >> v1:172.21.15.189:6812/1108603242 conn(0x7fdae803d870 legacy=0x7fdae803fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.434+0000 7fdb0c501640 10 monclient: shutdown 2024-09-10T16:30:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.434+0000 7fdb0c501640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.434+0000 7fdb0c501640 1 -- 172.21.15.81:0/4079299313 >> v1:172.21.15.81:6793/0 conn(0x7fdb040a5550 legacy=0x7fdb0409e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.434+0000 7fdb0c501640 1 -- 172.21.15.81:0/4079299313 shutdown_connections 2024-09-10T16:30:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.434+0000 7fdb0c501640 1 -- 172.21.15.81:0/4079299313 >> 172.21.15.81:0/4079299313 conn(0x7fdb0406dab0 msgr2=0x7fdb040a7570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.434+0000 7fdb0c501640 1 -- 172.21.15.81:0/4079299313 shutdown_connections 2024-09-10T16:30:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.434+0000 7fdb0c501640 1 -- 172.21.15.81:0/4079299313 wait complete. 2024-09-10T16:30:21.454 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-10T16:30:20.286412+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":163288,"kb_used_data":1120,"kb_used_omap":9,"kb_used_meta":162038,"kb_avail":566067752,"statfs":{"total":579820584960,"available":579653378048,"internally_reserved":0,"allocated":1146880,"data_stored":1380568,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":165927584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001791"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334487+0000","last_change":"2024-09-10T16:30:15.334487+0000","last_active":"2024-09-10T16:30:15.334487+0000","last_peered":"2024-09-10T16:30:15.334487+0000","last_clean":"2024-09-10T16:30:15.334487+0000","last_became_active":"2024-09-10T16:30:13.320369+0000","last_became_peered":"2024-09-10T16:30:13.320369+0000","last_unstale":"2024-09-10T16:30:15.334487+0000","last_undegraded":"2024-09-10T16:30:15.334487+0000","last_fullsized":"2024-09-10T16:30:15.334487+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:03.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011103879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334530+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:30:15.334530+0000","last_peered":"2024-09-10T16:30:15.334530+0000","last_clean":"2024-09-10T16:30:15.334530+0000","last_became_active":"2024-09-10T16:30:13.320284+0000","last_became_peered":"2024-09-10T16:30:13.320284+0000","last_unstale":"2024-09-10T16:30:15.334530+0000","last_undegraded":"2024-09-10T16:30:15.334530+0000","last_fullsized":"2024-09-10T16:30:15.334530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:11.783078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065529,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.335682+0000","last_change":"2024-09-10T16:30:15.335682+0000","last_active":"2024-09-10T16:30:15.335682+0000","last_peered":"2024-09-10T16:30:15.335682+0000","last_clean":"2024-09-10T16:30:15.335682+0000","last_became_active":"2024-09-10T16:30:13.317933+0000","last_became_peered":"2024-09-10T16:30:13.317933+0000","last_unstale":"2024-09-10T16:30:15.335682+0000","last_undegraded":"2024-09-10T16:30:15.335682+0000","last_fullsized":"2024-09-10T16:30:15.335682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:11.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018898459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334580+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:30:15.334580+0000","last_peered":"2024-09-10T16:30:15.334580+0000","last_clean":"2024-09-10T16:30:15.334580+0000","last_became_active":"2024-09-10T16:30:13.314196+0000","last_became_peered":"2024-09-10T16:30:13.314196+0000","last_unstale":"2024-09-10T16:30:15.334580+0000","last_undegraded":"2024-09-10T16:30:15.334580+0000","last_fullsized":"2024-09-10T16:30:15.334580+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:17.356490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092995700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"20'2","reported_seq":22,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.343908+0000","last_change":"2024-09-10T16:30:15.343908+0000","last_active":"2024-09-10T16:30:15.343908+0000","last_peered":"2024-09-10T16:30:15.343908+0000","last_clean":"2024-09-10T16:30:15.343908+0000","last_became_active":"2024-09-10T16:30:13.322410+0000","last_became_peered":"2024-09-10T16:30:13.322410+0000","last_unstale":"2024-09-10T16:30:15.343908+0000","last_undegraded":"2024-09-10T16:30:15.343908+0000","last_fullsized":"2024-09-10T16:30:15.343908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:23.371637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024400910000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334785+0000","last_change":"2024-09-10T16:30:15.335359+0000","last_active":"2024-09-10T16:30:15.334785+0000","last_peered":"2024-09-10T16:30:15.334785+0000","last_clean":"2024-09-10T16:30:15.334785+0000","last_became_active":"2024-09-10T16:30:13.314279+0000","last_became_peered":"2024-09-10T16:30:13.314279+0000","last_unstale":"2024-09-10T16:30:15.334785+0000","last_undegraded":"2024-09-10T16:30:15.334785+0000","last_fullsized":"2024-09-10T16:30:15.334785+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:19.341302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012467800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.335268+0000","last_change":"2024-09-10T16:30:15.336057+0000","last_active":"2024-09-10T16:30:15.335268+0000","last_peered":"2024-09-10T16:30:15.335268+0000","last_clean":"2024-09-10T16:30:15.335268+0000","last_became_active":"2024-09-10T16:30:13.315537+0000","last_became_peered":"2024-09-10T16:30:13.315537+0000","last_unstale":"2024-09-10T16:30:15.335268+0000","last_undegraded":"2024-09-10T16:30:15.335268+0000","last_fullsized":"2024-09-10T16:30:15.335268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:18.484028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001369903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"18'1","reported_seq":21,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.334665+0000","last_change":"2024-09-10T16:30:15.334665+0000","last_active":"2024-09-10T16:30:15.334665+0000","last_peered":"2024-09-10T16:30:15.334665+0000","last_clean":"2024-09-10T16:30:15.334665+0000","last_became_active":"2024-09-10T16:30:13.317955+0000","last_became_peered":"2024-09-10T16:30:13.317955+0000","last_unstale":"2024-09-10T16:30:15.334665+0000","last_undegraded":"2024-09-10T16:30:15.334665+0000","last_fullsized":"2024-09-10T16:30:15.334665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:01.463525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016930140000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"15'72","reported_seq":111,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-09-10T16:30:15.332750+0000","last_change":"2024-09-10T16:30:10.241185+0000","last_active":"2024-09-10T16:30:15.332750+0000","last_peered":"2024-09-10T16:30:15.332750+0000","last_clean":"2024-09-10T16:30:15.332750+0000","last_became_active":"2024-09-10T16:30:10.239296+0000","last_became_peered":"2024-09-10T16:30:10.239296+0000","last_unstale":"2024-09-10T16:30:15.332750+0000","last_undegraded":"2024-09-10T16:30:15.332750+0000","last_fullsized":"2024-09-10T16:30:15.332750+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_clean_scrub_stamp":"2024-09-10T16:30:09.204141+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:25.346646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":582707,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":53798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":172032,"data_stored":53779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":172,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":176128,"data_stored":53798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640262,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":225280,"data_stored":582707,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T16:30:21.455 INFO:tasks.mon_thrash.ceph_manager:clean! 2024-09-10T16:30:21.455 DEBUG:tasks.mon_thrash:Yielding 2024-09-10T16:30:21.455 INFO:teuthology.run_tasks:Running task exec... 2024-09-10T16:30:21.466 INFO:teuthology.task.exec:Executing custom commands... 2024-09-10T16:30:21.466 INFO:teuthology.task.exec:Running commands on role client.0 host ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T16:30:21.467 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:30:21.467 INFO:tasks.mon_thrash.mon_thrasher:start thrashing 2024-09-10T16:30:21.467 INFO:tasks.mon_thrash.mon_thrasher:seed: 1725985821, revive delay: 90.0, thrash delay: 1.0 thrash many: True, maintain quorum: True store thrash: False, probability: 50 freeze mon: prob 10.0 duration 15.0 2024-09-10T16:30:21.468 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-10T16:30:21.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T16:30:21.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 10 monclient: get_monmap_and_config 2024-09-10T16:30:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 10 monclient: build_initial_monmap 2024-09-10T16:30:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 10 monclient: monmap: 2024-09-10T16:30:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:21.582724+0000 2024-09-10T16:30:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:21.582724+0000 2024-09-10T16:30:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:21.581 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:21.582 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:21.582 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 1 Processor -- start 2024-09-10T16:30:21.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 1 -- start start 2024-09-10T16:30:21.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 10 monclient: init 2024-09-10T16:30:21.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:21.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 10 monclient: _add_conns ranks=[4,3,1,6,5,2,8,7,0] 2024-09-10T16:30:21.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 10 monclient(hunting): picked mon.noname-c con 0x7f9a3c09ca10 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:21.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 10 monclient(hunting): picked mon.noname-g con 0x7f9a3c0a56e0 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:21.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 10 monclient(hunting): picked mon.noname-f con 0x7f9a3c0a5b00 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:21.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a3c1362b0 con 0x7f9a3c0a5b00 2024-09-10T16:30:21.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a3c0a80b0 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a3c09de70 con 0x7f9a3c09ca10 2024-09-10T16:30:21.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:21.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 10 monclient(hunting): authenticate will time out at 988.981959s 2024-09-10T16:30:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3a59c640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f9a3c09ca10 0x7f9a3c135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34634/0 (socket says 172.21.15.81:34634) 2024-09-10T16:30:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3a59c640 1 -- 172.21.15.81:0/2461003250 learned_addr learned my addr 172.21.15.81:0/2461003250 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 1 -- 172.21.15.81:0/2461003250 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1791267478 0 0) 0x7f9a3c09de70 con 0x7f9a3c09ca10 2024-09-10T16:30:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient(hunting): my global_id is 4468 2024-09-10T16:30:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 1 -- 172.21.15.81:0/2461003250 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a28003530 con 0x7f9a3c09ca10 2024-09-10T16:30:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 1 -- 172.21.15.81:0/2461003250 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3516786872 0 0) 0x7f9a3c1362b0 con 0x7f9a3c0a5b00 2024-09-10T16:30:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient(hunting): my global_id is 4465 2024-09-10T16:30:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 1 -- 172.21.15.81:0/2461003250 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a3c09de70 con 0x7f9a3c0a5b00 2024-09-10T16:30:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 1 -- 172.21.15.81:0/2461003250 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 356499534 0 0) 0x7f9a28003530 con 0x7f9a3c09ca10 2024-09-10T16:30:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 1 -- 172.21.15.81:0/2461003250 >> v1:172.21.15.189:6790/0 conn(0x7f9a3c0a56e0 legacy=0x7f9a3c13df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 1 -- 172.21.15.81:0/2461003250 >> v1:172.21.15.189:6789/0 conn(0x7f9a3c0a5b00 legacy=0x7f9a3c141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient: _finish_hunting 0 2024-09-10T16:30:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 1 monclient: found mon.noname-c 2024-09-10T16:30:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:30:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 1 -- 172.21.15.81:0/2461003250 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3c09e150 con 0x7f9a3c09ca10 2024-09-10T16:30:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient: _finish_auth 0 2024-09-10T16:30:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient: _check_auth_tickets 2024-09-10T16:30:21.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 1 -- 172.21.15.81:0/2461003250 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9a2c001bc0 con 0x7f9a3c09ca10 2024-09-10T16:30:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient: dump: 2024-09-10T16:30:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.592 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.593 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 5 monclient: authenticate success, global_id 4468 2024-09-10T16:30:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 1 -- 172.21.15.81:0/2461003250 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a2c001de0 con 0x7f9a3c09ca10 2024-09-10T16:30:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 1 -- 172.21.15.81:0/2461003250 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9a2c002050 con 0x7f9a3c09ca10 2024-09-10T16:30:21.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a3959a640 10 monclient: dump: 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.594 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.595 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 4 set_mon_vals no callback set 2024-09-10T16:30:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 10 monclient: shutdown 2024-09-10T16:30:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 1 -- 172.21.15.81:0/2461003250 >> v1:172.21.15.81:6791/0 conn(0x7f9a3c09ca10 legacy=0x7f9a3c135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 1 -- 172.21.15.81:0/2461003250 shutdown_connections 2024-09-10T16:30:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 1 -- 172.21.15.81:0/2461003250 >> 172.21.15.81:0/2461003250 conn(0x7f9a3c06dc90 msgr2=0x7f9a3c0ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 1 -- 172.21.15.81:0/2461003250 shutdown_connections 2024-09-10T16:30:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.578+0000 7f9a40985640 1 -- 172.21.15.81:0/2461003250 wait complete. 2024-09-10T16:30:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient: build_initial_monmap 2024-09-10T16:30:21.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient: monmap: 2024-09-10T16:30:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:21.596 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:21.597 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 1 Processor -- start 2024-09-10T16:30:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 1 -- start start 2024-09-10T16:30:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient: init 2024-09-10T16:30:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient: _add_conns ranks=[2,6,1,0,8,5,3,4,7] 2024-09-10T16:30:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient(hunting): picked mon.noname-b con 0x7f9a3c09ca10 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient(hunting): picked mon.noname-d con 0x7f9a3c0a56e0 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient(hunting): picked mon.noname-f con 0x7f9a3c0a5b00 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a3c12fd80 con 0x7f9a3c0a5b00 2024-09-10T16:30:21.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a3c1ce2b0 con 0x7f9a3c09ca10 2024-09-10T16:30:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a3c135180 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient(hunting): authenticate will time out at 988.985218s 2024-09-10T16:30:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a39d9b640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f9a3c0a56e0 0x7f9a3c1cdba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56222/0 (socket says 172.21.15.81:56222) 2024-09-10T16:30:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a39d9b640 1 -- 172.21.15.81:0/2802882931 learned_addr learned my addr 172.21.15.81:0/2802882931 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2981732226 0 0) 0x7f9a3c135180 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): my global_id is 4416 2024-09-10T16:30:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a1c003530 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3377633576 0 0) 0x7f9a3c1ce2b0 con 0x7f9a3c09ca10 2024-09-10T16:30:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): my global_id is 4475 2024-09-10T16:30:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a3c135180 con 0x7f9a3c09ca10 2024-09-10T16:30:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1822557230 0 0) 0x7f9a1c003530 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a3c1ce2b0 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9a24001b40 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.599 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.600 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:21.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1046966136 0 0) 0x7f9a3c12fd80 con 0x7f9a3c0a5b00 2024-09-10T16:30:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient(hunting): my global_id is 4474 2024-09-10T16:30:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a1c003530 con 0x7f9a3c0a5b00 2024-09-10T16:30:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 398711362 0 0) 0x7f9a3c135180 con 0x7f9a3c09ca10 2024-09-10T16:30:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a3c12fd80 con 0x7f9a3c09ca10 2024-09-10T16:30:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2936255162 0 0) 0x7f9a3c1ce2b0 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 >> v1:172.21.15.81:6790/0 conn(0x7f9a3c09ca10 legacy=0x7f9a3c1cd490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 >> v1:172.21.15.189:6789/0 conn(0x7f9a3c0a5b00 legacy=0x7f9a3c1d5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 monclient: found mon.d 2024-09-10T16:30:21.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:21.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:21.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a3c0aa000 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:21.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:21.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:21.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 5 monclient: authenticate success, global_id 4416 2024-09-10T16:30:21.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient: _renew_subs 2024-09-10T16:30:21.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:21.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 1 -- 172.21.15.81:0/2802882931 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9a3c1320e0 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient: _renew_subs 2024-09-10T16:30:21.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:21.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 1 -- 172.21.15.81:0/2802882931 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f9a3c1308e0 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a240038d0 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9a24003ec0 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a38d99640 4 set_mon_vals no callback set 2024-09-10T16:30:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 10 monclient: dump: 2024-09-10T16:30:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.603 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.604 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f9a24004060 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:21.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a40985640 1 -- 172.21.15.81:0/2802882931 --> v1:172.21.15.81:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a3c0008e0 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 4113815040 0 0) 0x7f9a2404ae00 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.582+0000 7f9a3a59c640 10 monclient: get_auth_request con 0x7f9a1c03d3c0 auth_method 0 2024-09-10T16:30:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.586+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 <== mon.6 v1:172.21.15.81:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f9a24016cb0 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.586+0000 7f9a32ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:21.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.586+0000 7f9a32ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:21.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.814+0000 7f9a40985640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-10T16:30:21.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.814+0000 7f9a40985640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-10T16:30:21.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.814+0000 7f9a40985640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:21.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.814+0000 7f9a40985640 1 -- 172.21.15.81:0/2802882931 --> v1:172.21.15.81:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f9a3c142d70 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.818+0000 7f9a32ffd640 1 -- 172.21.15.81:0/2802882931 <== mon.6 v1:172.21.15.81:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 1836347372) 0x7f9a240165b0 con 0x7f9a3c0a56e0 2024-09-10T16:30:21.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.818+0000 7f9a32ffd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-10T16:30:21.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.818+0000 7f9a32ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:21.821 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":6,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"b","quorum_age":26,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","modified":"2024-09-10T16:29:22.909160Z","created":"2024-09-10T16:29:22.909160Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6790","nonce":0}]},"addr":"172.21.15.189:6790/0","public_addr":"172.21.15.189:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6791","nonce":0}]},"addr":"172.21.15.81:6791/0","public_addr":"172.21.15.81:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6791","nonce":0}]},"addr":"172.21.15.189:6791/0","public_addr":"172.21.15.189:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6792","nonce":0}]},"addr":"172.21.15.81:6792/0","public_addr":"172.21.15.81:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6792","nonce":0}]},"addr":"172.21.15.189:6792/0","public_addr":"172.21.15.189:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6793","nonce":0}]},"addr":"172.21.15.81:6793/0","public_addr":"172.21.15.81:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T16:30:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.818+0000 7f9a40985640 1 -- 172.21.15.81:0/2802882931 >> v1:172.21.15.189:6812/1108603242 conn(0x7f9a1c03d3c0 legacy=0x7f9a1c03f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.818+0000 7f9a40985640 10 monclient: shutdown 2024-09-10T16:30:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.818+0000 7f9a40985640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.818+0000 7f9a40985640 1 -- 172.21.15.81:0/2802882931 >> v1:172.21.15.81:6792/0 conn(0x7f9a3c0a56e0 legacy=0x7f9a3c1cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.818+0000 7f9a40985640 1 -- 172.21.15.81:0/2802882931 shutdown_connections 2024-09-10T16:30:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.818+0000 7f9a40985640 1 -- 172.21.15.81:0/2802882931 >> 172.21.15.81:0/2802882931 conn(0x7f9a3c06dc90 msgr2=0x7f9a3c0a82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.818+0000 7f9a40985640 1 -- 172.21.15.81:0/2802882931 shutdown_connections 2024-09-10T16:30:21.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.818+0000 7f9a40985640 1 -- 172.21.15.81:0/2802882931 wait complete. 2024-09-10T16:30:21.838 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-10T16:30:21.838 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T16:30:21.838 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-10T16:30:21.838 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T16:30:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 10 monclient: get_monmap_and_config 2024-09-10T16:30:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 10 monclient: build_initial_monmap 2024-09-10T16:30:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 10 monclient: monmap: 2024-09-10T16:30:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:21.954831+0000 2024-09-10T16:30:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:21.954831+0000 2024-09-10T16:30:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:21.953 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:21.954 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:21.954 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 1 Processor -- start 2024-09-10T16:30:21.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 1 -- start start 2024-09-10T16:30:21.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 10 monclient: init 2024-09-10T16:30:21.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:21.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 10 monclient: _add_conns ranks=[6,1,5,3,2,4,7,8,0] 2024-09-10T16:30:21.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 10 monclient(hunting): picked mon.noname-d con 0x7fa13409ca10 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 10 monclient(hunting): picked mon.noname-f con 0x7fa1340a56e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 10 monclient(hunting): picked mon.noname-h con 0x7fa1340a5b00 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1341362b0 con 0x7fa1340a56e0 2024-09-10T16:30:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1340a80b0 con 0x7fa1340a5b00 2024-09-10T16:30:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa13409de70 con 0x7fa13409ca10 2024-09-10T16:30:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 10 monclient(hunting): authenticate will time out at 989.354593s 2024-09-10T16:30:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa138f8e640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fa13409ca10 0x7fa134135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56224/0 (socket says 172.21.15.81:56224) 2024-09-10T16:30:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa138f8e640 1 -- 172.21.15.81:0/1379654313 learned_addr learned my addr 172.21.15.81:0/1379654313 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 1 -- 172.21.15.81:0/1379654313 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 958618134 0 0) 0x7fa13409de70 con 0x7fa13409ca10 2024-09-10T16:30:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient(hunting): my global_id is 4425 2024-09-10T16:30:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 1 -- 172.21.15.81:0/1379654313 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa120003530 con 0x7fa13409ca10 2024-09-10T16:30:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 1 -- 172.21.15.81:0/1379654313 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2609607724 0 0) 0x7fa120003530 con 0x7fa13409ca10 2024-09-10T16:30:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 1 -- 172.21.15.81:0/1379654313 >> v1:172.21.15.189:6791/0 conn(0x7fa1340a5b00 legacy=0x7fa134141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 1 -- 172.21.15.81:0/1379654313 >> v1:172.21.15.189:6789/0 conn(0x7fa1340a56e0 legacy=0x7fa13413df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient: _finish_hunting 0 2024-09-10T16:30:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 1 monclient: found mon.noname-d 2024-09-10T16:30:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:30:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 1 -- 172.21.15.81:0/1379654313 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa13409e150 con 0x7fa13409ca10 2024-09-10T16:30:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient: _finish_auth 0 2024-09-10T16:30:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient: _check_auth_tickets 2024-09-10T16:30:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:21.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 1 -- 172.21.15.81:0/1379654313 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa124001bc0 con 0x7fa13409ca10 2024-09-10T16:30:21.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:21.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:21.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient: dump: 2024-09-10T16:30:21.963 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.963 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.963 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.963 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.963 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.963 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.963 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.963 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.963 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.963 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.964 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 5 monclient: authenticate success, global_id 4425 2024-09-10T16:30:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 1 -- 172.21.15.81:0/1379654313 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa124001de0 con 0x7fa13409ca10 2024-09-10T16:30:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 1 -- 172.21.15.81:0/1379654313 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa124004f70 con 0x7fa13409ca10 2024-09-10T16:30:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:21.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 4 set_mon_vals no callback set 2024-09-10T16:30:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa1337fe640 10 monclient: dump: 2024-09-10T16:30:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.965 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.966 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.966 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.966 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.966 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.966 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.966 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.966 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 10 monclient: shutdown 2024-09-10T16:30:21.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:21.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 1 -- 172.21.15.81:0/1379654313 >> v1:172.21.15.81:6792/0 conn(0x7fa13409ca10 legacy=0x7fa134135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 1 -- 172.21.15.81:0/1379654313 shutdown_connections 2024-09-10T16:30:21.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.950+0000 7fa13b1f2640 1 -- 172.21.15.81:0/1379654313 >> 172.21.15.81:0/1379654313 conn(0x7fa13406dc90 msgr2=0x7fa1340ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 1 -- 172.21.15.81:0/1379654313 shutdown_connections 2024-09-10T16:30:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 1 -- 172.21.15.81:0/1379654313 wait complete. 2024-09-10T16:30:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 monclient: build_initial_monmap 2024-09-10T16:30:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 monclient: monmap: 2024-09-10T16:30:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:21.967 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:21.968 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 1 Processor -- start 2024-09-10T16:30:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 1 -- start start 2024-09-10T16:30:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 monclient: init 2024-09-10T16:30:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 monclient: _add_conns ranks=[3,2,4,1,8,5,7,0,6] 2024-09-10T16:30:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 monclient(hunting): picked mon.noname-g con 0x7fa13409ca10 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:21.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 monclient(hunting): picked mon.noname-b con 0x7fa1340a56e0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 monclient(hunting): picked mon.noname-c con 0x7fa1340a5b00 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa134132490 con 0x7fa1340a56e0 2024-09-10T16:30:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1340aa1c0 con 0x7fa13409ca10 2024-09-10T16:30:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1340a5460 con 0x7fa1340a5b00 2024-09-10T16:30:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 monclient(hunting): authenticate will time out at 989.357403s 2024-09-10T16:30:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa133fff640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fa1340a56e0 0x7fa13412eda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38668/0 (socket says 172.21.15.81:38668) 2024-09-10T16:30:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa133fff640 1 -- 172.21.15.81:0/2391561719 learned_addr learned my addr 172.21.15.81:0/2391561719 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4284826369 0 0) 0x7fa1340a5460 con 0x7fa1340a5b00 2024-09-10T16:30:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): my global_id is 4477 2024-09-10T16:30:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa114003530 con 0x7fa1340a5b00 2024-09-10T16:30:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3367214298 0 0) 0x7fa134132490 con 0x7fa1340a56e0 2024-09-10T16:30:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): my global_id is 4484 2024-09-10T16:30:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1340a5460 con 0x7fa1340a56e0 2024-09-10T16:30:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2042780815 0 0) 0x7fa114003530 con 0x7fa1340a5b00 2024-09-10T16:30:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa134132490 con 0x7fa1340a5b00 2024-09-10T16:30:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa12c0019c0 con 0x7fa1340a5b00 2024-09-10T16:30:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): dump: 2024-09-10T16:30:21.970 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.971 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.972 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1201458833 0 0) 0x7fa1340aa1c0 con 0x7fa13409ca10 2024-09-10T16:30:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): my global_id is 4413 2024-09-10T16:30:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa114003530 con 0x7fa13409ca10 2024-09-10T16:30:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3072866566 0 0) 0x7fa1340a5460 con 0x7fa1340a56e0 2024-09-10T16:30:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa1340aa1c0 con 0x7fa1340a56e0 2024-09-10T16:30:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa11c001a40 con 0x7fa1340a56e0 2024-09-10T16:30:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:21.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): dump: 2024-09-10T16:30:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.973 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.974 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3099974219 0 0) 0x7fa134132490 con 0x7fa1340a5b00 2024-09-10T16:30:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 >> v1:172.21.15.189:6790/0 conn(0x7fa13409ca10 legacy=0x7fa13412e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 >> v1:172.21.15.81:6790/0 conn(0x7fa1340a56e0 legacy=0x7fa13412eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient: _finish_hunting 0 2024-09-10T16:30:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 monclient: found mon.c 2024-09-10T16:30:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa134131620 con 0x7fa1340a5b00 2024-09-10T16:30:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient: _finish_auth 0 2024-09-10T16:30:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient: _check_auth_tickets 2024-09-10T16:30:21.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 5 monclient: authenticate success, global_id 4477 2024-09-10T16:30:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 monclient: _renew_subs 2024-09-10T16:30:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa134130130 con 0x7fa1340a5b00 2024-09-10T16:30:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 monclient: _renew_subs 2024-09-10T16:30:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:30:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa1341321b0 con 0x7fa1340a5b00 2024-09-10T16:30:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa12c001cc0 con 0x7fa1340a5b00 2024-09-10T16:30:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa12c003c10 con 0x7fa1340a5b00 2024-09-10T16:30:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa132ffd640 4 set_mon_vals no callback set 2024-09-10T16:30:21.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient: dump: 2024-09-10T16:30:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.976 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.977 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa13b1f2640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa1180065d0 con 0x7fa118002870 2024-09-10T16:30:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fa12c003e30 con 0x7fa1340a5b00 2024-09-10T16:30:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 4113815040 0 0) 0x7fa12c049be0 con 0x7fa1340a5b00 2024-09-10T16:30:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3647686002 0 0) 0x7fa1180065d0 con 0x7fa118002870 2024-09-10T16:30:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient(hunting): my global_id is 4491 2024-09-10T16:30:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa134132490 con 0x7fa118002870 2024-09-10T16:30:21.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4103441416 0 0) 0x7fa134132490 con 0x7fa118002870 2024-09-10T16:30:21.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa1180065d0 con 0x7fa118002870 2024-09-10T16:30:21.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa133fff640 10 monclient: get_auth_request con 0x7fa11403d800 auth_method 0 2024-09-10T16:30:21.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa124004ef0 con 0x7fa118002870 2024-09-10T16:30:21.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:21.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:21.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.954+0000 7fa1317fa640 10 monclient: dump: 2024-09-10T16:30:21.978 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.978 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.978 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.978 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.978 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.978 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.978 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.979 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.979 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.979 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.979 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.979 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.979 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.979 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.979 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.979 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.958+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2631210324 0 0) 0x7fa1180065d0 con 0x7fa118002870 2024-09-10T16:30:21.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.958+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa11800a170 con 0x7fa118002870 2024-09-10T16:30:21.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.958+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa124001950 con 0x7fa118002870 2024-09-10T16:30:21.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.958+0000 7fa1317fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:21.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.958+0000 7fa1317fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:21.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.958+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 >> v1:172.21.15.81:6789/0 conn(0x7fa118002870 legacy=0x7fa118004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:21.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.958+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 >> v1:172.21.15.81:6789/0 conn(0x7fa118002870 legacy=0x7fa118004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:21.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa13b1f2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:21.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa13b1f2640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa118009e80 con 0x7fa118009140 2024-09-10T16:30:21.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4072890073 0 0) 0x7fa118009e80 con 0x7fa118009140 2024-09-10T16:30:21.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 10 monclient(hunting): _negotiate 2024-09-10T16:30:21.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:21.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:21.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 10 monclient(hunting): my global_id is 4500 2024-09-10T16:30:21.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1180065d0 con 0x7fa118009140 2024-09-10T16:30:21.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1886201661 0 0) 0x7fa1180065d0 con 0x7fa118009140 2024-09-10T16:30:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa118009e80 con 0x7fa118009140 2024-09-10T16:30:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa124005230 con 0x7fa118009140 2024-09-10T16:30:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 10 monclient: dump: 2024-09-10T16:30:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:21.982 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:21.983 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 578767884 0 0) 0x7fa118009e80 con 0x7fa118009140 2024-09-10T16:30:21.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 --> v1:172.21.15.81:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa11800c420 con 0x7fa118009140 2024-09-10T16:30:21.983 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 6, 2024-09-10T16:30:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 31911, 2024-09-10T16:30:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:30:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:21.984 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 26, 2024-09-10T16:30:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:21.985 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:21.986 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:21.987 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:21.988 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.989 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.990 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:21.991 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:21.992 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:21.993 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.994 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:21.995 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:21.996 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:21.997 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:21.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:21.999 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.000 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.001 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:22.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.003 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:22.003 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:22.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 3768258425) 0x7fa124008110 con 0x7fa118009140 2024-09-10T16:30:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 >> v1:172.21.15.81:6789/0 conn(0x7fa118009140 legacy=0x7fa1180095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.962+0000 7fa1317fa640 1 -- 172.21.15.81:0/2391561719 >> v1:172.21.15.81:6789/0 conn(0x7fa118009140 legacy=0x7fa1180095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.966+0000 7fa13b1f2640 1 -- 172.21.15.81:0/2391561719 >> v1:172.21.15.189:6812/1108603242 conn(0x7fa11403d800 legacy=0x7fa11403fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.966+0000 7fa13b1f2640 10 monclient: shutdown 2024-09-10T16:30:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.966+0000 7fa13b1f2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.966+0000 7fa13b1f2640 1 -- 172.21.15.81:0/2391561719 >> v1:172.21.15.81:6791/0 conn(0x7fa1340a5b00 legacy=0x7fa1341d5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.966+0000 7fa13978f640 1 -- 172.21.15.81:0/2391561719 reap_dead start 2024-09-10T16:30:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.966+0000 7fa13978f640 1 -- 172.21.15.81:0/2391561719 reap_dead start 2024-09-10T16:30:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.966+0000 7fa13b1f2640 1 -- 172.21.15.81:0/2391561719 shutdown_connections 2024-09-10T16:30:22.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.966+0000 7fa13b1f2640 1 -- 172.21.15.81:0/2391561719 >> 172.21.15.81:0/2391561719 conn(0x7fa13406dc90 msgr2=0x7fa1340aac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.966+0000 7fa13b1f2640 1 -- 172.21.15.81:0/2391561719 shutdown_connections 2024-09-10T16:30:22.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:21.966+0000 7fa13b1f2640 1 -- 172.21.15.81:0/2391561719 wait complete. 2024-09-10T16:30:22.006 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:30:22.006 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-10T16:30:22.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T16:30:22.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 10 monclient: get_monmap_and_config 2024-09-10T16:30:22.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 10 monclient: build_initial_monmap 2024-09-10T16:30:22.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 10 monclient: monmap: 2024-09-10T16:30:22.126 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:22.126 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.126 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:22.128133+0000 2024-09-10T16:30:22.126 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:22.128133+0000 2024-09-10T16:30:22.126 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:22.127 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:22.127 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 1 Processor -- start 2024-09-10T16:30:22.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 1 -- start start 2024-09-10T16:30:22.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 10 monclient: init 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 10 monclient: _add_conns ranks=[8,2,5,0,3,7,6,4,1] 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 10 monclient(hunting): picked mon.noname-e con 0x7fa0b4068960 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 10 monclient(hunting): picked mon.noname-b con 0x7fa0b40a3740 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 10 monclient(hunting): picked mon.noname-h con 0x7fa0b40a3b20 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b409f900 con 0x7fa0b40a3740 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b40a4780 con 0x7fa0b40a3b20 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b40a06c0 con 0x7fa0b4068960 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0bc0d0640 10 monclient(hunting): authenticate will time out at 989.527544s 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0b9e6c640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fa0b4068960 0x7fa0b40a3030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35260/0 (socket says 172.21.15.81:35260) 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0b966b640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fa0b40a3740 0x7fa0b413e5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38684/0 (socket says 172.21.15.81:38684) 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0b9e6c640 1 -- 172.21.15.81:0/2284768955 learned_addr learned my addr 172.21.15.81:0/2284768955 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.122+0000 7fa0b8e6a640 1 -- 172.21.15.81:0/2284768955 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3320547222 0 0) 0x7fa0b409f900 con 0x7fa0b40a3740 2024-09-10T16:30:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient(hunting): my global_id is 4493 2024-09-10T16:30:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 1 -- 172.21.15.81:0/2284768955 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0a0003530 con 0x7fa0b40a3740 2024-09-10T16:30:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 1 -- 172.21.15.81:0/2284768955 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1616264055 0 0) 0x7fa0b40a06c0 con 0x7fa0b4068960 2024-09-10T16:30:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient(hunting): my global_id is 4382 2024-09-10T16:30:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 1 -- 172.21.15.81:0/2284768955 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0b409f900 con 0x7fa0b4068960 2024-09-10T16:30:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 1 -- 172.21.15.81:0/2284768955 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 848830800 0 0) 0x7fa0b40a4780 con 0x7fa0b40a3b20 2024-09-10T16:30:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient(hunting): my global_id is 4433 2024-09-10T16:30:22.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 1 -- 172.21.15.81:0/2284768955 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0b40a06c0 con 0x7fa0b40a3b20 2024-09-10T16:30:22.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 1 -- 172.21.15.81:0/2284768955 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2035769614 0 0) 0x7fa0a0003530 con 0x7fa0b40a3740 2024-09-10T16:30:22.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 1 -- 172.21.15.81:0/2284768955 >> v1:172.21.15.81:6793/0 conn(0x7fa0b4068960 legacy=0x7fa0b40a3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 1 -- 172.21.15.81:0/2284768955 >> v1:172.21.15.189:6791/0 conn(0x7fa0b40a3b20 legacy=0x7fa0b4141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient: _finish_hunting 0 2024-09-10T16:30:22.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 1 monclient: found mon.noname-b 2024-09-10T16:30:22.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:22.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:30:22.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 1 -- 172.21.15.81:0/2284768955 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b409fe20 con 0x7fa0b40a3740 2024-09-10T16:30:22.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient: _finish_auth 0 2024-09-10T16:30:22.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient: _check_auth_tickets 2024-09-10T16:30:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 1 -- 172.21.15.81:0/2284768955 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa0a4001840 con 0x7fa0b40a3740 2024-09-10T16:30:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient: dump: 2024-09-10T16:30:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.138 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 5 monclient: authenticate success, global_id 4493 2024-09-10T16:30:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 1 -- 172.21.15.81:0/2284768955 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa0a40019e0 con 0x7fa0b40a3740 2024-09-10T16:30:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 1 -- 172.21.15.81:0/2284768955 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa0a4004b30 con 0x7fa0b40a3740 2024-09-10T16:30:22.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 4 set_mon_vals no callback set 2024-09-10T16:30:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0b8e6a640 10 monclient: dump: 2024-09-10T16:30:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.139 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.140 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.140 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.140 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.140 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.140 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.140 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient: shutdown 2024-09-10T16:30:22.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:22.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/2284768955 >> v1:172.21.15.81:6790/0 conn(0x7fa0b40a3740 legacy=0x7fa0b413e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/2284768955 shutdown_connections 2024-09-10T16:30:22.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/2284768955 >> 172.21.15.81:0/2284768955 conn(0x7fa0b40a8800 msgr2=0x7fa0b40a8c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:22.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/2284768955 shutdown_connections 2024-09-10T16:30:22.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/2284768955 wait complete. 2024-09-10T16:30:22.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient: build_initial_monmap 2024-09-10T16:30:22.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient: monmap: 2024-09-10T16:30:22.141 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:22.141 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:22.141 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:22.141 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:22.141 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:22.141 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:22.141 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:22.141 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:22.141 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:22.141 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:22.141 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 1 Processor -- start 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 1 -- start start 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient: init 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient: _add_conns ranks=[3,7,2,8,1,6,5,4,0] 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient(hunting): picked mon.noname-g con 0x7fa0b4068960 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient(hunting): picked mon.noname-i con 0x7fa0b40a3740 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient(hunting): picked mon.noname-b con 0x7fa0b40a3b20 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b4096000 con 0x7fa0b40a3b20 2024-09-10T16:30:22.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b4098360 con 0x7fa0b4068960 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0b4097ac0 con 0x7fa0b40a3740 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient(hunting): authenticate will time out at 989.530580s 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0ba66d640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fa0b40a3b20 0x7fa0b41d5b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38686/0 (socket says 172.21.15.81:38686) 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0ba66d640 1 -- 172.21.15.81:0/251617242 learned_addr learned my addr 172.21.15.81:0/251617242 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2288646345 0 0) 0x7fa0b4096000 con 0x7fa0b40a3b20 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient(hunting): my global_id is 4502 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa098003530 con 0x7fa0b40a3b20 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1036011896 0 0) 0x7fa098003530 con 0x7fa0b40a3b20 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa0b4096000 con 0x7fa0b40a3b20 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa0ac001e20 con 0x7fa0b40a3b20 2024-09-10T16:30:22.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient(hunting): dump: 2024-09-10T16:30:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.145 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 414734208 0 0) 0x7fa0b4096000 con 0x7fa0b40a3b20 2024-09-10T16:30:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 >> v1:172.21.15.189:6792/0 conn(0x7fa0b40a3740 legacy=0x7fa0b409a8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 >> v1:172.21.15.189:6790/0 conn(0x7fa0b4068960 legacy=0x7fa0b41cd7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:30:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 1 monclient: found mon.b 2024-09-10T16:30:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:22.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0b4096b60 con 0x7fa0b40a3b20 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient: _finish_auth 0 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 5 monclient: authenticate success, global_id 4502 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient: _renew_subs 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/251617242 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa0b409afb0 con 0x7fa0b40a3b20 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient: _renew_subs 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/251617242 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa0b41d7470 con 0x7fa0b40a3b20 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa0ac003c50 con 0x7fa0b40a3b20 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa0ac004280 con 0x7fa0b40a3b20 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0abfff640 4 set_mon_vals no callback set 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.126+0000 7fa0aa7fc640 10 monclient: dump: 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.148 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0bc0d0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/251617242 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa09c0065d0 con 0x7fa09c002870 2024-09-10T16:30:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fa0ac004420 con 0x7fa0b40a3b20 2024-09-10T16:30:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 4113815040 0 0) 0x7fa0ac04b130 con 0x7fa0b40a3b20 2024-09-10T16:30:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4152108935 0 0) 0x7fa09c0065d0 con 0x7fa09c002870 2024-09-10T16:30:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 10 monclient(hunting): my global_id is 4511 2024-09-10T16:30:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0b4096000 con 0x7fa09c002870 2024-09-10T16:30:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 766653291 0 0) 0x7fa0b4096000 con 0x7fa09c002870 2024-09-10T16:30:22.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa09c0065d0 con 0x7fa09c002870 2024-09-10T16:30:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa0b0001560 con 0x7fa09c002870 2024-09-10T16:30:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 10 monclient: dump: 2024-09-10T16:30:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.149 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.150 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0b966b640 10 monclient: get_auth_request con 0x7fa09803ce80 auth_method 0 2024-09-10T16:30:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3243678597 0 0) 0x7fa09c0065d0 con 0x7fa09c002870 2024-09-10T16:30:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 --> v1:172.21.15.81:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa09c00a170 con 0x7fa09c002870 2024-09-10T16:30:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa0b0001780 con 0x7fa09c002870 2024-09-10T16:30:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 >> v1:172.21.15.81:6790/0 conn(0x7fa09c002870 legacy=0x7fa09c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.130+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 >> v1:172.21.15.81:6790/0 conn(0x7fa09c002870 legacy=0x7fa09c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0bc0d0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/251617242 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa09c009e50 con 0x7fa09c009110 2024-09-10T16:30:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1777597702 0 0) 0x7fa09c009e50 con 0x7fa09c009110 2024-09-10T16:30:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0aa7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0aa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0aa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0aa7fc640 10 monclient(hunting): my global_id is 4520 2024-09-10T16:30:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa09c0065d0 con 0x7fa09c009110 2024-09-10T16:30:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1621218728 0 0) 0x7fa09c0065d0 con 0x7fa09c009110 2024-09-10T16:30:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa09c009e50 con 0x7fa09c009110 2024-09-10T16:30:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa0b0004da0 con 0x7fa09c009110 2024-09-10T16:30:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0aa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0aa7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0aa7fc640 10 monclient: dump: 2024-09-10T16:30:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.154 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1733675743 0 0) 0x7fa09c009e50 con 0x7fa09c009110 2024-09-10T16:30:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.134+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 --> v1:172.21.15.81:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa09c00c400 con 0x7fa09c009110 2024-09-10T16:30:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7879 (unknown 0 0 1773018348) 0x7fa0b0006270 con 0x7fa09c009110 2024-09-10T16:30:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0aa7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0aa7fc640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 >> v1:172.21.15.81:6790/0 conn(0x7fa09c009110 legacy=0x7fa09c0095a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0aa7fc640 1 -- 172.21.15.81:0/251617242 >> v1:172.21.15.81:6790/0 conn(0x7fa09c009110 legacy=0x7fa09c0095a0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:22.155 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-09-10T16:30:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 6, 2024-09-10T16:30:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 32103, 2024-09-10T16:30:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:30:22.155 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 26, 2024-09-10T16:30:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.156 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.157 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:22.158 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.159 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:22.160 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.161 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:22.164 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.165 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.166 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.167 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.168 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:22.170 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:22.171 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.171 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.171 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.171 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:22.171 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:22.171 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.171 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.171 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:22.171 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:22.172 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:30:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.173 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.174 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:22.175 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/251617242 >> v1:172.21.15.189:6812/1108603242 conn(0x7fa09803ce80 legacy=0x7fa09803f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0bc0d0640 10 monclient: shutdown 2024-09-10T16:30:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0bc0d0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/251617242 >> v1:172.21.15.81:6790/0 conn(0x7fa0b40a3b20 legacy=0x7fa0b41d5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0ba66d640 1 -- 172.21.15.81:0/251617242 reap_dead start 2024-09-10T16:30:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0ba66d640 1 -- 172.21.15.81:0/251617242 reap_dead start 2024-09-10T16:30:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/251617242 shutdown_connections 2024-09-10T16:30:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/251617242 >> 172.21.15.81:0/251617242 conn(0x7fa0b40a8800 msgr2=0x7fa0b4071100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/251617242 shutdown_connections 2024-09-10T16:30:22.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.138+0000 7fa0bc0d0640 1 -- 172.21.15.81:0/251617242 wait complete. 2024-09-10T16:30:22.177 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:30:22.177 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-10T16:30:22.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T16:30:22.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.282+0000 7f15ca4f6640 10 monclient: get_monmap_and_config 2024-09-10T16:30:22.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.282+0000 7f15ca4f6640 10 monclient: build_initial_monmap 2024-09-10T16:30:22.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.282+0000 7f15ca4f6640 10 monclient: monmap: 2024-09-10T16:30:22.288 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:22.288 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.288 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:22.289514+0000 2024-09-10T16:30:22.288 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:22.289514+0000 2024-09-10T16:30:22.288 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:22.288 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.288 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:22.288 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:22.288 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:22.288 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:22.288 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:22.288 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:22.288 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:22.289 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:22.289 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:22.289 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 1 Processor -- start 2024-09-10T16:30:22.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 1 -- start start 2024-09-10T16:30:22.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 10 monclient: init 2024-09-10T16:30:22.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:22.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 10 monclient: _add_conns ranks=[4,5,1,6,3,0,8,7,2] 2024-09-10T16:30:22.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 10 monclient(hunting): picked mon.noname-c con 0x7f15c40a0a90 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:22.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 10 monclient(hunting): picked mon.noname-h con 0x7f15c40a35f0 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:22.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 10 monclient(hunting): picked mon.noname-f con 0x7f15c40a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:22.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c409df70 con 0x7f15c40a3a40 2024-09-10T16:30:22.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c409fa30 con 0x7f15c40a0a90 2024-09-10T16:30:22.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c409fd10 con 0x7f15c40a35f0 2024-09-10T16:30:22.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:22.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 10 monclient(hunting): authenticate will time out at 989.689330s 2024-09-10T16:30:22.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c3fff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f15c40a0a90 0x7f15c40a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34642/0 (socket says 172.21.15.81:34642) 2024-09-10T16:30:22.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c3fff640 1 -- 172.21.15.81:0/3782571437 learned_addr learned my addr 172.21.15.81:0/3782571437 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:22.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 1 -- 172.21.15.81:0/3782571437 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 635266050 0 0) 0x7f15c409fa30 con 0x7f15c40a0a90 2024-09-10T16:30:22.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient(hunting): my global_id is 4486 2024-09-10T16:30:22.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 1 -- 172.21.15.81:0/3782571437 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15ac003530 con 0x7f15c40a0a90 2024-09-10T16:30:22.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 1 -- 172.21.15.81:0/3782571437 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2938913440 0 0) 0x7f15ac003530 con 0x7f15c40a0a90 2024-09-10T16:30:22.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 1 -- 172.21.15.81:0/3782571437 >> v1:172.21.15.189:6791/0 conn(0x7f15c40a35f0 legacy=0x7f15c413c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 1 -- 172.21.15.81:0/3782571437 >> v1:172.21.15.189:6789/0 conn(0x7f15c40a3a40 legacy=0x7f15c413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:22.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 1 monclient: found mon.noname-c 2024-09-10T16:30:22.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:22.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:30:22.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 1 -- 172.21.15.81:0/3782571437 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c409fff0 con 0x7f15c40a0a90 2024-09-10T16:30:22.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:22.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:22.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:22.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 5 monclient: authenticate success, global_id 4486 2024-09-10T16:30:22.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 1 -- 172.21.15.81:0/3782571437 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f15b4001840 con 0x7f15c40a0a90 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient: dump: 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.298 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.299 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.299 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.299 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:22.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 1 -- 172.21.15.81:0/3782571437 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15b4001a60 con 0x7f15c40a0a90 2024-09-10T16:30:22.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:22.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:22.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 4 set_mon_vals no callback set 2024-09-10T16:30:22.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 1 -- 172.21.15.81:0/3782571437 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f15b4004bf0 con 0x7f15c40a0a90 2024-09-10T16:30:22.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:22.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15c2ffd640 10 monclient: dump: 2024-09-10T16:30:22.299 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.299 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.300 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.300 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.300 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.300 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.300 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.300 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.300 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.300 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.300 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.300 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.300 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.300 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.300 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.300 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 10 monclient: shutdown 2024-09-10T16:30:22.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:22.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 1 -- 172.21.15.81:0/3782571437 >> v1:172.21.15.81:6791/0 conn(0x7f15c40a0a90 legacy=0x7f15c40a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 1 -- 172.21.15.81:0/3782571437 shutdown_connections 2024-09-10T16:30:22.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 1 -- 172.21.15.81:0/3782571437 >> 172.21.15.81:0/3782571437 conn(0x7f15c40a3fd0 msgr2=0x7f15c40a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:22.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 1 -- 172.21.15.81:0/3782571437 shutdown_connections 2024-09-10T16:30:22.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 1 -- 172.21.15.81:0/3782571437 wait complete. 2024-09-10T16:30:22.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 10 monclient: build_initial_monmap 2024-09-10T16:30:22.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 10 monclient: monmap: 2024-09-10T16:30:22.301 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:22.301 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:22.301 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:22.301 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:22.301 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:22.302 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:22.302 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:22.302 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:22.302 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:22.302 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:22.302 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:22.302 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:22.302 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:22.302 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:22.302 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:22.302 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 1 Processor -- start 2024-09-10T16:30:22.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 1 -- start start 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 10 monclient: init 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.286+0000 7f15ca4f6640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 10 monclient: _add_conns ranks=[6,8,1,7,3,4,5,0,2] 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 10 monclient(hunting): picked mon.noname-d con 0x7f15c40a0a90 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 10 monclient(hunting): picked mon.noname-e con 0x7f15c40a35f0 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 10 monclient(hunting): picked mon.noname-f con 0x7f15c40a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c4096cd0 con 0x7f15c40a3a40 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c4073aa0 con 0x7f15c40a0a90 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f15c4096430 con 0x7f15c40a35f0 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 10 monclient(hunting): authenticate will time out at 989.692078s 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c37fe640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f15c40a35f0 0x7f15c41d08d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35274/0 (socket says 172.21.15.81:35274) 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c37fe640 1 -- 172.21.15.81:0/2915624688 learned_addr learned my addr 172.21.15.81:0/2915624688 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2906911144 0 0) 0x7f15c4096430 con 0x7f15c40a35f0 2024-09-10T16:30:22.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): my global_id is 4391 2024-09-10T16:30:22.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15b0003560 con 0x7f15c40a35f0 2024-09-10T16:30:22.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 254494831 0 0) 0x7f15c4073aa0 con 0x7f15c40a0a90 2024-09-10T16:30:22.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): my global_id is 4434 2024-09-10T16:30:22.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15c4096430 con 0x7f15c40a0a90 2024-09-10T16:30:22.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 626963224 0 0) 0x7f15b0003560 con 0x7f15c40a35f0 2024-09-10T16:30:22.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15c4073aa0 con 0x7f15c40a35f0 2024-09-10T16:30:22.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f15b8001b80 con 0x7f15c40a35f0 2024-09-10T16:30:22.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): dump: 2024-09-10T16:30:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.305 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.306 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2607729007 0 0) 0x7f15c4096cd0 con 0x7f15c40a3a40 2024-09-10T16:30:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): my global_id is 4501 2024-09-10T16:30:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15b0003560 con 0x7f15c40a3a40 2024-09-10T16:30:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 214277252 0 0) 0x7f15c4073aa0 con 0x7f15c40a35f0 2024-09-10T16:30:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 >> v1:172.21.15.81:6792/0 conn(0x7f15c40a0a90 legacy=0x7f15c409a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 >> v1:172.21.15.189:6789/0 conn(0x7f15c40a3a40 legacy=0x7f15c41d4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 monclient: found mon.e 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15c4096710 con 0x7f15c40a35f0 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient: _finish_auth 0 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 5 monclient: authenticate success, global_id 4391 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 10 monclient: _renew_subs 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f15c40954d0 con 0x7f15c40a35f0 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 10 monclient: _renew_subs 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:22.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f15c409a930 con 0x7f15c40a35f0 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f15b80038d0 con 0x7f15c40a35f0 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c27fc640 4 set_mon_vals no callback set 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f15b8003e40 con 0x7f15c40a35f0 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient: dump: 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.308 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.309 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15ca4f6640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f15a40065d0 con 0x7f15a4002870 2024-09-10T16:30:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f15b8004060 con 0x7f15c40a35f0 2024-09-10T16:30:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(21..21 src has 1..21) ==== 3534+0+0 (unknown 4113815040 0 0) 0x7f15b804ae40 con 0x7f15c40a35f0 2024-09-10T16:30:22.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 368136114 0 0) 0x7f15a40065d0 con 0x7f15a4002870 2024-09-10T16:30:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient(hunting): my global_id is 4495 2024-09-10T16:30:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15c4073aa0 con 0x7f15a4002870 2024-09-10T16:30:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3527207520 0 0) 0x7f15c4073aa0 con 0x7f15a4002870 2024-09-10T16:30:22.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15a40065d0 con 0x7f15a4002870 2024-09-10T16:30:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f15b4001b60 con 0x7f15a4002870 2024-09-10T16:30:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c8a93640 10 monclient: get_auth_request con 0x7f15b003d040 auth_method 0 2024-09-10T16:30:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient: dump: 2024-09-10T16:30:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.313 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3817437425 0 0) 0x7f15a40065d0 con 0x7f15a4002870 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.81:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f15a400a170 con 0x7f15a4002870 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f15b4007480 con 0x7f15a4002870 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 >> v1:172.21.15.81:6791/0 conn(0x7f15a4002870 legacy=0x7f15a4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.290+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 >> v1:172.21.15.81:6791/0 conn(0x7f15a4002870 legacy=0x7f15a4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15ca4f6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15ca4f6640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f15a4009e60 con 0x7f15a4009120 2024-09-10T16:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3997398525 0 0) 0x7f15a4009e60 con 0x7f15a4009120 2024-09-10T16:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 10 monclient(hunting): my global_id is 4504 2024-09-10T16:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f15a40065d0 con 0x7f15a4009120 2024-09-10T16:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2424961669 0 0) 0x7f15a40065d0 con 0x7f15a4009120 2024-09-10T16:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f15a4009e60 con 0x7f15a4009120 2024-09-10T16:30:22.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f15b4005680 con 0x7f15a4009120 2024-09-10T16:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 10 monclient: dump: 2024-09-10T16:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.317 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 813256163 0 0) 0x7f15a4009e60 con 0x7f15a4009120 2024-09-10T16:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 --> v1:172.21.15.81:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f15a400c400 con 0x7f15a4009120 2024-09-10T16:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7710 (unknown 0 0 3187680568) 0x7f15b4007630 con 0x7f15a4009120 2024-09-10T16:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 >> v1:172.21.15.81:6791/0 conn(0x7f15a4009120 legacy=0x7f15a40095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c0ff9640 1 -- 172.21.15.81:0/2915624688 >> v1:172.21.15.81:6791/0 conn(0x7f15a4009120 legacy=0x7f15a40095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:22.319 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:22.319 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:22.319 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:22.319 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:22.319 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 6, 2024-09-10T16:30:22.319 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 32255, 2024-09-10T16:30:22.319 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:22.319 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:22.319 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:22.319 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:22.319 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:30:22.319 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:22.319 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:22.320 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:22.320 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:22.320 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:22.320 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.320 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 27, 2024-09-10T16:30:22.320 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:22.320 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:22.320 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:22.320 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.320 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.320 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.320 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.320 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.320 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.321 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.321 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.321 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.321 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.321 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.321 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.321 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:22.321 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:22.321 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.321 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.321 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.321 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.321 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.321 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.322 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.322 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.322 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.322 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.322 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.322 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.322 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:22.322 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:22.322 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:22.322 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:22.322 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:22.322 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:22.322 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.323 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.324 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.324 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.324 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.324 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.324 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.324 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.324 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.324 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:22.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.324 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:22.324 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.324 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:22.324 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:22.324 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.325 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.325 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:22.325 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.325 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.325 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:22.326 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.329 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.331 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:22.332 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.333 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.337 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.338 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.339 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.340 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:30:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:30:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.341 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.342 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:22.342 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.342 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.342 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:22.342 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15ca4f6640 1 -- 172.21.15.81:0/2915624688 >> v1:172.21.15.189:6812/1108603242 conn(0x7f15b003d040 legacy=0x7f15b003f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15ca4f6640 10 monclient: shutdown 2024-09-10T16:30:22.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15ca4f6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15ca4f6640 1 -- 172.21.15.81:0/2915624688 >> v1:172.21.15.81:6793/0 conn(0x7f15c40a35f0 legacy=0x7f15c41d08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c8a93640 1 -- 172.21.15.81:0/2915624688 reap_dead start 2024-09-10T16:30:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15c8a93640 1 -- 172.21.15.81:0/2915624688 reap_dead start 2024-09-10T16:30:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15ca4f6640 1 -- 172.21.15.81:0/2915624688 shutdown_connections 2024-09-10T16:30:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15ca4f6640 1 -- 172.21.15.81:0/2915624688 >> 172.21.15.81:0/2915624688 conn(0x7f15c40a3fd0 msgr2=0x7f15c4074170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15ca4f6640 1 -- 172.21.15.81:0/2915624688 shutdown_connections 2024-09-10T16:30:22.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.298+0000 7f15ca4f6640 1 -- 172.21.15.81:0/2915624688 wait complete. 2024-09-10T16:30:22.344 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:30:22.344 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-10T16:30:22.345 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-10T16:30:22.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient: get_monmap_and_config 2024-09-10T16:30:22.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient: build_initial_monmap 2024-09-10T16:30:22.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient: monmap: 2024-09-10T16:30:22.460 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:22.462297+0000 2024-09-10T16:30:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:22.462297+0000 2024-09-10T16:30:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:22.461 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:22.462 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:22.462 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:22.462 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:22.462 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:22.462 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 1 Processor -- start 2024-09-10T16:30:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 1 -- start start 2024-09-10T16:30:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient: init 2024-09-10T16:30:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient: _add_conns ranks=[2,1,7,6,8,5,0,3,4] 2024-09-10T16:30:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient(hunting): picked mon.noname-b con 0x7eff2c09b4c0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient(hunting): picked mon.noname-f con 0x7eff2c0a2620 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient(hunting): picked mon.noname-i con 0x7eff2c13c320 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2c0a15d0 con 0x7eff2c0a2620 2024-09-10T16:30:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2c0a0d30 con 0x7eff2c09b4c0 2024-09-10T16:30:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2c0a1010 con 0x7eff2c13c320 2024-09-10T16:30:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient(hunting): authenticate will time out at 989.861644s 2024-09-10T16:30:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff31307640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7eff2c09b4c0 0x7eff2c09b8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38702/0 (socket says 172.21.15.81:38702) 2024-09-10T16:30:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff31307640 1 -- 172.21.15.81:0/1461640540 learned_addr learned my addr 172.21.15.81:0/1461640540 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 1 -- 172.21.15.81:0/1461640540 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1590491751 0 0) 0x7eff2c0a0d30 con 0x7eff2c09b4c0 2024-09-10T16:30:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient(hunting): my global_id is 4529 2024-09-10T16:30:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 1 -- 172.21.15.81:0/1461640540 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff18003530 con 0x7eff2c09b4c0 2024-09-10T16:30:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 1 -- 172.21.15.81:0/1461640540 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 313489055 0 0) 0x7eff18003530 con 0x7eff2c09b4c0 2024-09-10T16:30:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 1 -- 172.21.15.81:0/1461640540 >> v1:172.21.15.189:6792/0 conn(0x7eff2c13c320 legacy=0x7eff2c13e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 1 -- 172.21.15.81:0/1461640540 >> v1:172.21.15.189:6789/0 conn(0x7eff2c0a2620 legacy=0x7eff2c13ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient: _finish_hunting 0 2024-09-10T16:30:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 1 monclient: found mon.noname-b 2024-09-10T16:30:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:30:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 1 -- 172.21.15.81:0/1461640540 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2c0a12f0 con 0x7eff2c09b4c0 2024-09-10T16:30:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient: _finish_auth 0 2024-09-10T16:30:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient: _check_auth_tickets 2024-09-10T16:30:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 1 -- 172.21.15.81:0/1461640540 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7eff28001840 con 0x7eff2c09b4c0 2024-09-10T16:30:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 5 monclient: authenticate success, global_id 4529 2024-09-10T16:30:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient: dump: 2024-09-10T16:30:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.475 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 1 -- 172.21.15.81:0/1461640540 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff28001a60 con 0x7eff2c09b4c0 2024-09-10T16:30:22.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 1 -- 172.21.15.81:0/1461640540 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7eff28004bf0 con 0x7eff2c09b4c0 2024-09-10T16:30:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 4 set_mon_vals no callback set 2024-09-10T16:30:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff23fff640 10 monclient: dump: 2024-09-10T16:30:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.478 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.479 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.479 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.479 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.479 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.479 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient: shutdown 2024-09-10T16:30:22.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:22.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 1 -- 172.21.15.81:0/1461640540 >> v1:172.21.15.81:6790/0 conn(0x7eff2c09b4c0 legacy=0x7eff2c09b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 1 -- 172.21.15.81:0/1461640540 shutdown_connections 2024-09-10T16:30:22.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 1 -- 172.21.15.81:0/1461640540 >> 172.21.15.81:0/1461640540 conn(0x7eff2c0a85d0 msgr2=0x7eff2c0a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:22.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 1 -- 172.21.15.81:0/1461640540 shutdown_connections 2024-09-10T16:30:22.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 1 -- 172.21.15.81:0/1461640540 wait complete. 2024-09-10T16:30:22.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient: build_initial_monmap 2024-09-10T16:30:22.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 10 monclient: monmap: 2024-09-10T16:30:22.481 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:22.481 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:22.482 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:22.482 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:22.482 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:22.482 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:22.482 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:22.482 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:22.483 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:22.484 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:22.484 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.458+0000 7eff3356b640 1 Processor -- start 2024-09-10T16:30:22.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 1 -- start start 2024-09-10T16:30:22.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 10 monclient: init 2024-09-10T16:30:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 10 monclient: _add_conns ranks=[2,8,0,7,4,6,3,1,5] 2024-09-10T16:30:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 10 monclient(hunting): picked mon.noname-b con 0x7eff2c09b4c0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 10 monclient(hunting): picked mon.noname-e con 0x7eff2c0a2620 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:22.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 10 monclient(hunting): picked mon.noname-a con 0x7eff2c13c320 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2c073ab0 con 0x7eff2c13c320 2024-09-10T16:30:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2c13fbf0 con 0x7eff2c09b4c0 2024-09-10T16:30:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff2c074d00 con 0x7eff2c0a2620 2024-09-10T16:30:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 10 monclient(hunting): authenticate will time out at 989.864522s 2024-09-10T16:30:22.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff31307640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7eff2c09b4c0 0x7eff2c1cad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38704/0 (socket says 172.21.15.81:38704) 2024-09-10T16:30:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff31307640 1 -- 172.21.15.81:0/2919663905 learned_addr learned my addr 172.21.15.81:0/2919663905 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1640847880 0 0) 0x7eff2c0a12f0 con 0x7eff2c09b4c0 2024-09-10T16:30:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): my global_id is 4538 2024-09-10T16:30:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff10003530 con 0x7eff2c09b4c0 2024-09-10T16:30:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1381526448 0 0) 0x7eff2c073ab0 con 0x7eff2c13c320 2024-09-10T16:30:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): my global_id is 4509 2024-09-10T16:30:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff2c0a12f0 con 0x7eff2c13c320 2024-09-10T16:30:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 483720009 0 0) 0x7eff2c074d00 con 0x7eff2c0a2620 2024-09-10T16:30:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): my global_id is 4400 2024-09-10T16:30:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff2c073ab0 con 0x7eff2c0a2620 2024-09-10T16:30:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 746136210 0 0) 0x7eff10003530 con 0x7eff2c09b4c0 2024-09-10T16:30:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff2c074d00 con 0x7eff2c09b4c0 2024-09-10T16:30:22.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7eff28004b30 con 0x7eff2c09b4c0 2024-09-10T16:30:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): dump: 2024-09-10T16:30:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.491 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.492 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.492 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.492 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.492 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.492 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.492 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.493 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.493 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.493 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.493 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.493 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.494 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.494 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:22.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 233472329 0 0) 0x7eff2c0a12f0 con 0x7eff2c13c320 2024-09-10T16:30:22.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff10003530 con 0x7eff2c13c320 2024-09-10T16:30:22.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 509017141 0 0) 0x7eff2c073ab0 con 0x7eff2c0a2620 2024-09-10T16:30:22.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff2c0a12f0 con 0x7eff2c0a2620 2024-09-10T16:30:22.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7eff24001cd0 con 0x7eff2c13c320 2024-09-10T16:30:22.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:22.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:22.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): dump: 2024-09-10T16:30:22.496 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.496 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.496 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.496 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.496 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.496 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.497 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.497 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.497 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.497 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.497 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.498 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.498 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.498 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.498 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.498 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7eff1c001920 con 0x7eff2c0a2620 2024-09-10T16:30:22.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:22.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:22.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): dump: 2024-09-10T16:30:22.499 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.499 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.499 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.500 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.501 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.501 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.501 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.501 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.501 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.501 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.502 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.502 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3031413849 0 0) 0x7eff2c074d00 con 0x7eff2c09b4c0 2024-09-10T16:30:22.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 >> v1:172.21.15.81:6793/0 conn(0x7eff2c0a2620 legacy=0x7eff2c1cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 >> v1:172.21.15.81:6789/0 conn(0x7eff2c13c320 legacy=0x7eff2c1d2f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:30:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 monclient: found mon.b 2024-09-10T16:30:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2c1cbb40 con 0x7eff2c09b4c0 2024-09-10T16:30:22.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient: _finish_auth 0 2024-09-10T16:30:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:30:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 5 monclient: authenticate success, global_id 4538 2024-09-10T16:30:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 10 monclient: _renew_subs 2024-09-10T16:30:22.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7eff2c13f730 con 0x7eff2c09b4c0 2024-09-10T16:30:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 10 monclient: _renew_subs 2024-09-10T16:30:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7eff2c074a20 con 0x7eff2c09b4c0 2024-09-10T16:30:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7eff280011c0 con 0x7eff2c09b4c0 2024-09-10T16:30:22.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7eff28001940 con 0x7eff2c09b4c0 2024-09-10T16:30:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff237fe640 4 set_mon_vals no callback set 2024-09-10T16:30:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:22.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient: dump: 2024-09-10T16:30:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.507 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.508 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.509 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:22.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff3356b640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7eff0c0065d0 con 0x7eff0c002870 2024-09-10T16:30:22.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7eff28010f60 con 0x7eff2c09b4c0 2024-09-10T16:30:22.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 956220458 0 0) 0x7eff2804b020 con 0x7eff2c09b4c0 2024-09-10T16:30:22.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3764092213 0 0) 0x7eff0c0065d0 con 0x7eff0c002870 2024-09-10T16:30:22.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient(hunting): my global_id is 4443 2024-09-10T16:30:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff2c074d00 con 0x7eff0c002870 2024-09-10T16:30:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff31b08640 10 monclient: get_auth_request con 0x7eff1003da30 auth_method 0 2024-09-10T16:30:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 781867952 0 0) 0x7eff2c074d00 con 0x7eff0c002870 2024-09-10T16:30:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff0c0065d0 con 0x7eff0c002870 2024-09-10T16:30:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7eff1c003940 con 0x7eff0c002870 2024-09-10T16:30:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:22.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient: dump: 2024-09-10T16:30:22.512 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.512 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.512 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.512 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.512 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.512 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.512 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.513 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.513 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.513 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.513 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.513 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.513 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.513 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.513 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.514 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1550036873 0 0) 0x7eff0c0065d0 con 0x7eff0c002870 2024-09-10T16:30:22.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7eff0c00a170 con 0x7eff0c002870 2024-09-10T16:30:22.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7eff1c005b60 con 0x7eff0c002870 2024-09-10T16:30:22.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:22.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:22.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 >> v1:172.21.15.81:6792/0 conn(0x7eff0c002870 legacy=0x7eff0c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.462+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 >> v1:172.21.15.81:6792/0 conn(0x7eff0c002870 legacy=0x7eff0c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:22.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff3356b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:22.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff3356b640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7eff0c009e10 con 0x7eff0c0090f0 2024-09-10T16:30:22.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1009027157 0 0) 0x7eff0c009e10 con 0x7eff0c0090f0 2024-09-10T16:30:22.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 10 monclient(hunting): my global_id is 4452 2024-09-10T16:30:22.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7eff0c0065d0 con 0x7eff0c0090f0 2024-09-10T16:30:22.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1215975249 0 0) 0x7eff0c0065d0 con 0x7eff0c0090f0 2024-09-10T16:30:22.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7eff0c009e10 con 0x7eff0c0090f0 2024-09-10T16:30:22.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7eff1c005490 con 0x7eff0c0090f0 2024-09-10T16:30:22.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:22.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 10 monclient: dump: 2024-09-10T16:30:22.519 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.519 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.520 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.521 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.521 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3837819980 0 0) 0x7eff0c009e10 con 0x7eff0c0090f0 2024-09-10T16:30:22.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 --> v1:172.21.15.81:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7eff0c00c3b0 con 0x7eff0c0090f0 2024-09-10T16:30:22.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7710 (unknown 0 0 2612965913) 0x7eff1c005640 con 0x7eff0c0090f0 2024-09-10T16:30:22.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:22.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:22.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 >> v1:172.21.15.81:6792/0 conn(0x7eff0c0090f0 legacy=0x7eff0c009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff21ffb640 1 -- 172.21.15.81:0/2919663905 >> v1:172.21.15.81:6792/0 conn(0x7eff0c0090f0 legacy=0x7eff0c009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:22.523 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:22.523 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 6, 2024-09-10T16:30:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 32431, 2024-09-10T16:30:22.524 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:30:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:22.525 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.526 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 27, 2024-09-10T16:30:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.527 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.528 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:22.529 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.531 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:22.532 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:22.533 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:22.534 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.535 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.536 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.537 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.540 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.541 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.542 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:22.544 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.545 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.546 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.548 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.550 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.553 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:30:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.554 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:30:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.556 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:22.556 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:22.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff3356b640 1 -- 172.21.15.81:0/2919663905 >> v1:172.21.15.189:6812/1108603242 conn(0x7eff1003da30 legacy=0x7eff1003fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff3356b640 10 monclient: shutdown 2024-09-10T16:30:22.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff3356b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:22.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff3356b640 1 -- 172.21.15.81:0/2919663905 >> v1:172.21.15.81:6790/0 conn(0x7eff2c09b4c0 legacy=0x7eff2c1cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff31b08640 1 -- 172.21.15.81:0/2919663905 reap_dead start 2024-09-10T16:30:22.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff31b08640 1 -- 172.21.15.81:0/2919663905 reap_dead start 2024-09-10T16:30:22.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff3356b640 1 -- 172.21.15.81:0/2919663905 shutdown_connections 2024-09-10T16:30:22.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff3356b640 1 -- 172.21.15.81:0/2919663905 >> 172.21.15.81:0/2919663905 conn(0x7eff2c0a85d0 msgr2=0x7eff2c13c700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:22.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff3356b640 1 -- 172.21.15.81:0/2919663905 shutdown_connections 2024-09-10T16:30:22.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.470+0000 7eff3356b640 1 -- 172.21.15.81:0/2919663905 wait complete. 2024-09-10T16:30:22.558 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:30:22.558 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-10T16:30:22.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-10T16:30:22.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.674+0000 7f6ff9bf2640 10 monclient: get_monmap_and_config 2024-09-10T16:30:22.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.674+0000 7f6ff9bf2640 10 monclient: build_initial_monmap 2024-09-10T16:30:22.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 10 monclient: monmap: 2024-09-10T16:30:22.681 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:22.681 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.681 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:22.682092+0000 2024-09-10T16:30:22.681 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:22.682092+0000 2024-09-10T16:30:22.681 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:22.681 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.681 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:22.681 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:22.681 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:22.681 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:22.682 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 1 Processor -- start 2024-09-10T16:30:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 1 -- start start 2024-09-10T16:30:22.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 10 monclient: init 2024-09-10T16:30:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 10 monclient: _add_conns ranks=[2,8,5,1,0,4,3,7,6] 2024-09-10T16:30:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 10 monclient(hunting): picked mon.noname-b con 0x7f6ff409ca10 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 10 monclient(hunting): picked mon.noname-e con 0x7f6ff40a56e0 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 10 monclient(hunting): picked mon.noname-h con 0x7f6ff40a5b00 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:22.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff41362b0 con 0x7f6ff409ca10 2024-09-10T16:30:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff40a80b0 con 0x7f6ff40a5b00 2024-09-10T16:30:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff409de70 con 0x7f6ff40a56e0 2024-09-10T16:30:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 10 monclient(hunting): authenticate will time out at 990.081549s 2024-09-10T16:30:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff2ffd640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f6ff40a56e0 0x7f6ff413df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35302/0 (socket says 172.21.15.81:35302) 2024-09-10T16:30:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff2ffd640 1 -- 172.21.15.81:0/2856654141 learned_addr learned my addr 172.21.15.81:0/2856654141 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 1 -- 172.21.15.81:0/2856654141 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1866880109 0 0) 0x7f6ff409de70 con 0x7f6ff40a56e0 2024-09-10T16:30:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient(hunting): my global_id is 4409 2024-09-10T16:30:22.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 1 -- 172.21.15.81:0/2856654141 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd8003530 con 0x7f6ff40a56e0 2024-09-10T16:30:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 1 -- 172.21.15.81:0/2856654141 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 128293529 0 0) 0x7f6ff41362b0 con 0x7f6ff409ca10 2024-09-10T16:30:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient(hunting): my global_id is 4547 2024-09-10T16:30:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 1 -- 172.21.15.81:0/2856654141 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ff409de70 con 0x7f6ff409ca10 2024-09-10T16:30:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 1 -- 172.21.15.81:0/2856654141 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1641578008 0 0) 0x7f6ff409de70 con 0x7f6ff409ca10 2024-09-10T16:30:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 1 -- 172.21.15.81:0/2856654141 >> v1:172.21.15.81:6793/0 conn(0x7f6ff40a56e0 legacy=0x7f6ff413df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 1 -- 172.21.15.81:0/2856654141 >> v1:172.21.15.189:6791/0 conn(0x7f6ff40a5b00 legacy=0x7f6ff4141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-10T16:30:22.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient: _finish_hunting 0 2024-09-10T16:30:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 1 monclient: found mon.noname-b 2024-09-10T16:30:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:30:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 1 -- 172.21.15.81:0/2856654141 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff409e150 con 0x7f6ff409ca10 2024-09-10T16:30:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient: _finish_auth 0 2024-09-10T16:30:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient: _check_auth_tickets 2024-09-10T16:30:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 1 -- 172.21.15.81:0/2856654141 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6fe4001820 con 0x7f6ff409ca10 2024-09-10T16:30:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient: dump: 2024-09-10T16:30:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.693 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.694 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 5 monclient: authenticate success, global_id 4547 2024-09-10T16:30:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 1 -- 172.21.15.81:0/2856654141 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fe40019c0 con 0x7f6ff409ca10 2024-09-10T16:30:22.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 1 -- 172.21.15.81:0/2856654141 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6fe4003620 con 0x7f6ff409ca10 2024-09-10T16:30:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff27fc640 10 monclient: dump: 2024-09-10T16:30:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.695 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.696 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 4 set_mon_vals no callback set 2024-09-10T16:30:22.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 10 monclient: shutdown 2024-09-10T16:30:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/2856654141 >> v1:172.21.15.81:6790/0 conn(0x7f6ff409ca10 legacy=0x7f6ff4135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/2856654141 shutdown_connections 2024-09-10T16:30:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/2856654141 >> 172.21.15.81:0/2856654141 conn(0x7f6ff406dc90 msgr2=0x7f6ff40ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/2856654141 shutdown_connections 2024-09-10T16:30:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/2856654141 wait complete. 2024-09-10T16:30:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 10 monclient: build_initial_monmap 2024-09-10T16:30:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.678+0000 7f6ff9bf2640 10 monclient: monmap: 2024-09-10T16:30:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:22.697 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:22.698 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:22.699 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 1 Processor -- start 2024-09-10T16:30:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 1 -- start start 2024-09-10T16:30:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 10 monclient: init 2024-09-10T16:30:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 10 monclient: _add_conns ranks=[0,1,7,4,5,3,6,8,2] 2024-09-10T16:30:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 10 monclient(hunting): picked mon.noname-a con 0x7f6ff409ca10 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 10 monclient(hunting): picked mon.noname-f con 0x7f6ff40a56e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 10 monclient(hunting): picked mon.noname-i con 0x7f6ff40a5b00 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff409f120 con 0x7f6ff409ca10 2024-09-10T16:30:22.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff409f400 con 0x7f6ff40a56e0 2024-09-10T16:30:22.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ff4132ab0 con 0x7f6ff40a5b00 2024-09-10T16:30:22.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:22.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 10 monclient(hunting): authenticate will time out at 990.084882s 2024-09-10T16:30:22.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff37fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6ff409ca10 0x7f6ff4130450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43222/0 (socket says 172.21.15.81:43222) 2024-09-10T16:30:22.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff37fe640 1 -- 172.21.15.81:0/67874159 learned_addr learned my addr 172.21.15.81:0/67874159 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:22.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1411966139 0 0) 0x7f6ff409f120 con 0x7f6ff409ca10 2024-09-10T16:30:22.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): my global_id is 4518 2024-09-10T16:30:22.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fdc003530 con 0x7f6ff409ca10 2024-09-10T16:30:22.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1438608043 0 0) 0x7f6fdc003530 con 0x7f6ff409ca10 2024-09-10T16:30:22.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6ff409f120 con 0x7f6ff409ca10 2024-09-10T16:30:22.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6fe40016e0 con 0x7f6ff409ca10 2024-09-10T16:30:22.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:22.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:22.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): dump: 2024-09-10T16:30:22.701 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.701 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.701 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.701 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.701 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.702 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3486494111 0 0) 0x7f6ff4132ab0 con 0x7f6ff40a5b00 2024-09-10T16:30:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): my global_id is 4453 2024-09-10T16:30:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fdc003530 con 0x7f6ff40a5b00 2024-09-10T16:30:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1571907717 0 0) 0x7f6ff409f400 con 0x7f6ff40a56e0 2024-09-10T16:30:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): my global_id is 4519 2024-09-10T16:30:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ff4132ab0 con 0x7f6ff40a56e0 2024-09-10T16:30:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2897177736 0 0) 0x7f6ff409f120 con 0x7f6ff409ca10 2024-09-10T16:30:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 >> v1:172.21.15.189:6792/0 conn(0x7f6ff40a5b00 legacy=0x7f6ff41d5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 >> v1:172.21.15.189:6789/0 conn(0x7f6ff40a56e0 legacy=0x7f6ff4130b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient: _finish_hunting 0 2024-09-10T16:30:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 monclient: found mon.a 2024-09-10T16:30:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ff4132000 con 0x7f6ff409ca10 2024-09-10T16:30:22.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient: _finish_auth 0 2024-09-10T16:30:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient: _check_auth_tickets 2024-09-10T16:30:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 5 monclient: authenticate success, global_id 4518 2024-09-10T16:30:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 10 monclient: _renew_subs 2024-09-10T16:30:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6ff40aa3e0 con 0x7f6ff409ca10 2024-09-10T16:30:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 10 monclient: _renew_subs 2024-09-10T16:30:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f6ff4135160 con 0x7f6ff409ca10 2024-09-10T16:30:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6fe4001900 con 0x7f6ff409ca10 2024-09-10T16:30:22.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6fe4003ed0 con 0x7f6ff409ca10 2024-09-10T16:30:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff1ffb640 4 set_mon_vals no callback set 2024-09-10T16:30:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient: dump: 2024-09-10T16:30:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.706 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.707 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:22.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6fd00065d0 con 0x7f6fd0002870 2024-09-10T16:30:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f6fe4004070 con 0x7f6ff409ca10 2024-09-10T16:30:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 956220458 0 0) 0x7f6fe404aff0 con 0x7f6ff409ca10 2024-09-10T16:30:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4089302720 0 0) 0x7f6fd00065d0 con 0x7f6fd0002870 2024-09-10T16:30:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient(hunting): my global_id is 4418 2024-09-10T16:30:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6ff409f120 con 0x7f6fd0002870 2024-09-10T16:30:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3642902098 0 0) 0x7f6ff409f120 con 0x7f6fd0002870 2024-09-10T16:30:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fd00065d0 con 0x7f6fd0002870 2024-09-10T16:30:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6fe00015a0 con 0x7f6fd0002870 2024-09-10T16:30:22.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient: dump: 2024-09-10T16:30:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.709 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.710 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6ff3fff640 10 monclient: get_auth_request con 0x7f6fdc03d100 auth_method 0 2024-09-10T16:30:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1648386949 0 0) 0x7f6fd00065d0 con 0x7f6fd0002870 2024-09-10T16:30:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.81:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6fd000a170 con 0x7f6fd0002870 2024-09-10T16:30:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6fe0001850 con 0x7f6fd0002870 2024-09-10T16:30:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:22.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:22.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 >> v1:172.21.15.81:6793/0 conn(0x7f6fd0002870 legacy=0x7f6fd0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.682+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 >> v1:172.21.15.81:6793/0 conn(0x7f6fd0002870 legacy=0x7f6fd0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:22.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6ff9bf2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:22.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6fd0009e80 con 0x7f6fd0009140 2024-09-10T16:30:22.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 728195875 0 0) 0x7f6fd0009e80 con 0x7f6fd0009140 2024-09-10T16:30:22.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 10 monclient(hunting): my global_id is 4427 2024-09-10T16:30:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6fd00065d0 con 0x7f6fd0009140 2024-09-10T16:30:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3933504085 0 0) 0x7f6fd00065d0 con 0x7f6fd0009140 2024-09-10T16:30:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6fd0009e80 con 0x7f6fd0009140 2024-09-10T16:30:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6fe0004d60 con 0x7f6fd0009140 2024-09-10T16:30:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 10 monclient: dump: 2024-09-10T16:30:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.713 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.714 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1296825229 0 0) 0x7f6fd0009e80 con 0x7f6fd0009140 2024-09-10T16:30:22.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 --> v1:172.21.15.81:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6fd000c420 con 0x7f6fd0009140 2024-09-10T16:30:22.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 3331959747) 0x7f6fe0006250 con 0x7f6fd0009140 2024-09-10T16:30:22.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:22.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:22.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 >> v1:172.21.15.81:6793/0 conn(0x7f6fd0009140 legacy=0x7f6fd00095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6febfff640 1 -- 172.21.15.81:0/67874159 >> v1:172.21.15.81:6793/0 conn(0x7f6fd0009140 legacy=0x7f6fd00095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:22.715 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:22.715 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:22.715 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 6, 2024-09-10T16:30:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 32651, 2024-09-10T16:30:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:30:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:22.716 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 27, 2024-09-10T16:30:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.717 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.719 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:22.720 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.721 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:22.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.726 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.727 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.728 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:22.729 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.731 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:22.732 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:22.733 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.734 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.736 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.737 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.738 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:22.739 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/67874159 >> v1:172.21.15.189:6812/1108603242 conn(0x7f6fdc03d100 legacy=0x7f6fdc03f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6ff9bf2640 10 monclient: shutdown 2024-09-10T16:30:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6ff9bf2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/67874159 >> v1:172.21.15.81:6789/0 conn(0x7f6ff409ca10 legacy=0x7f6ff4130450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6ff3fff640 1 -- 172.21.15.81:0/67874159 reap_dead start 2024-09-10T16:30:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6ff3fff640 1 -- 172.21.15.81:0/67874159 reap_dead start 2024-09-10T16:30:22.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/67874159 shutdown_connections 2024-09-10T16:30:22.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/67874159 >> 172.21.15.81:0/67874159 conn(0x7f6ff406dc90 msgr2=0x7f6ff40aa5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:22.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/67874159 shutdown_connections 2024-09-10T16:30:22.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.690+0000 7f6ff9bf2640 1 -- 172.21.15.81:0/67874159 wait complete. 2024-09-10T16:30:22.741 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:30:22.741 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-10T16:30:22.741 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-10T16:30:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 10 monclient: get_monmap_and_config 2024-09-10T16:30:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 10 monclient: build_initial_monmap 2024-09-10T16:30:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 10 monclient: monmap: 2024-09-10T16:30:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:22.853 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:22.855287+0000 2024-09-10T16:30:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:22.855287+0000 2024-09-10T16:30:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:22.854 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:22.855 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 1 Processor -- start 2024-09-10T16:30:22.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 1 -- start start 2024-09-10T16:30:22.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 10 monclient: init 2024-09-10T16:30:22.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:22.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 10 monclient: _add_conns ranks=[1,6,7,5,3,4,0,2,8] 2024-09-10T16:30:22.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 10 monclient(hunting): picked mon.noname-f con 0x7fa2f00a3650 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:22.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 10 monclient(hunting): picked mon.noname-d con 0x7fa2f009df40 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:22.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 10 monclient(hunting): picked mon.noname-i con 0x7fa2f00a4140 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:22.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f00a52e0 con 0x7fa2f00a3650 2024-09-10T16:30:22.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f00a1c30 con 0x7fa2f009df40 2024-09-10T16:30:22.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f009ccc0 con 0x7fa2f00a4140 2024-09-10T16:30:22.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:22.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f74e8640 10 monclient(hunting): authenticate will time out at 990.255098s 2024-09-10T16:30:22.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f4a83640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fa2f009df40 0x7fa2f013c450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56270/0 (socket says 172.21.15.81:56270) 2024-09-10T16:30:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2f4a83640 1 -- 172.21.15.81:0/3174721546 learned_addr learned my addr 172.21.15.81:0/3174721546 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 1 -- 172.21.15.81:0/3174721546 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 609237344 0 0) 0x7fa2e4001120 con 0x7fa2f009df40 2024-09-10T16:30:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient(hunting): my global_id is 4461 2024-09-10T16:30:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 1 -- 172.21.15.81:0/3174721546 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2dc003530 con 0x7fa2f009df40 2024-09-10T16:30:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 1 -- 172.21.15.81:0/3174721546 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2126605217 0 0) 0x7fa2f00a52e0 con 0x7fa2f00a3650 2024-09-10T16:30:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient(hunting): my global_id is 4528 2024-09-10T16:30:22.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 1 -- 172.21.15.81:0/3174721546 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2e4001120 con 0x7fa2f00a3650 2024-09-10T16:30:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 1 -- 172.21.15.81:0/3174721546 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1039578938 0 0) 0x7fa2f009ccc0 con 0x7fa2f00a4140 2024-09-10T16:30:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient(hunting): my global_id is 4462 2024-09-10T16:30:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 1 -- 172.21.15.81:0/3174721546 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2f00a52e0 con 0x7fa2f00a4140 2024-09-10T16:30:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 1 -- 172.21.15.81:0/3174721546 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1470963454 0 0) 0x7fa2dc003530 con 0x7fa2f009df40 2024-09-10T16:30:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 1 -- 172.21.15.81:0/3174721546 >> v1:172.21.15.189:6792/0 conn(0x7fa2f00a4140 legacy=0x7fa2f013fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 1 -- 172.21.15.81:0/3174721546 >> v1:172.21.15.189:6789/0 conn(0x7fa2f00a3650 legacy=0x7fa2f00a3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient: _finish_hunting 0 2024-09-10T16:30:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 1 monclient: found mon.noname-d 2024-09-10T16:30:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:22.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:30:22.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 1 -- 172.21.15.81:0/3174721546 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f009cfa0 con 0x7fa2f009df40 2024-09-10T16:30:22.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient: _finish_auth 0 2024-09-10T16:30:22.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 10 monclient: _check_auth_tickets 2024-09-10T16:30:22.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.850+0000 7fa2e3fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:22.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e3fff640 1 -- 172.21.15.81:0/3174721546 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa2e4001a10 con 0x7fa2f009df40 2024-09-10T16:30:22.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e3fff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:22.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e3fff640 10 monclient: dump: 2024-09-10T16:30:22.864 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.864 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.864 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.864 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.864 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.864 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.865 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.865 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.865 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.865 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.865 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.865 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.865 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.865 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.865 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.865 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 5 monclient: authenticate success, global_id 4461 2024-09-10T16:30:22.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:22.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e3fff640 1 -- 172.21.15.81:0/3174721546 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa2e4001c30 con 0x7fa2f009df40 2024-09-10T16:30:22.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e3fff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:22.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e3fff640 1 -- 172.21.15.81:0/3174721546 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa2e4004bf0 con 0x7fa2f009df40 2024-09-10T16:30:22.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e3fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e3fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:22.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e3fff640 10 monclient: dump: 2024-09-10T16:30:22.866 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.866 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.866 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.866 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.867 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.867 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.867 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.867 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.867 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.867 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.867 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.867 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.867 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.867 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.867 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.867 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 4 set_mon_vals no callback set 2024-09-10T16:30:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient: shutdown 2024-09-10T16:30:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 1 -- 172.21.15.81:0/3174721546 >> v1:172.21.15.81:6792/0 conn(0x7fa2f009df40 legacy=0x7fa2f013c450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 1 -- 172.21.15.81:0/3174721546 shutdown_connections 2024-09-10T16:30:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 1 -- 172.21.15.81:0/3174721546 >> 172.21.15.81:0/3174721546 conn(0x7fa2f00a8240 msgr2=0x7fa2f00a4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 1 -- 172.21.15.81:0/3174721546 shutdown_connections 2024-09-10T16:30:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 1 -- 172.21.15.81:0/3174721546 wait complete. 2024-09-10T16:30:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient: build_initial_monmap 2024-09-10T16:30:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient: monmap: 2024-09-10T16:30:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:22.870 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:22.870 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:22.870 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:22.870 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:22.870 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:22.870 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:22.870 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:22.870 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:22.870 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 1 Processor -- start 2024-09-10T16:30:22.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 1 -- start start 2024-09-10T16:30:22.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient: init 2024-09-10T16:30:22.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:22.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient: _add_conns ranks=[7,8,3,4,2,1,6,5,0] 2024-09-10T16:30:22.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient(hunting): picked mon.noname-i con 0x7fa2f009df40 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:22.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient(hunting): picked mon.noname-e con 0x7fa2f00a3650 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:22.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient(hunting): picked mon.noname-g con 0x7fa2f00a4140 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:22.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f01beaa0 con 0x7fa2f00a4140 2024-09-10T16:30:22.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f01aba70 con 0x7fa2f009df40 2024-09-10T16:30:22.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2f01abd50 con 0x7fa2f00a3650 2024-09-10T16:30:22.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:22.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient(hunting): authenticate will time out at 990.258585s 2024-09-10T16:30:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f4a83640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fa2f00a3650 0x7fa2f01d0b10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35324/0 (socket says 172.21.15.81:35324) 2024-09-10T16:30:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f4a83640 1 -- 172.21.15.81:0/2386309750 learned_addr learned my addr 172.21.15.81:0/2386309750 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2331345106 0 0) 0x7fa2f01abd50 con 0x7fa2f00a3650 2024-09-10T16:30:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): my global_id is 4436 2024-09-10T16:30:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2d4003530 con 0x7fa2f00a3650 2024-09-10T16:30:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1235316725 0 0) 0x7fa2d4003530 con 0x7fa2f00a3650 2024-09-10T16:30:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2f01abd50 con 0x7fa2f00a3650 2024-09-10T16:30:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4647427 0 0) 0x7fa2f01aba70 con 0x7fa2f009df40 2024-09-10T16:30:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): my global_id is 4471 2024-09-10T16:30:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2d4003530 con 0x7fa2f009df40 2024-09-10T16:30:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa2e4004b30 con 0x7fa2f00a3650 2024-09-10T16:30:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): dump: 2024-09-10T16:30:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.873 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.874 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2475362329 0 0) 0x7fa2f01beaa0 con 0x7fa2f00a4140 2024-09-10T16:30:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient(hunting): my global_id is 4431 2024-09-10T16:30:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2f01aba70 con 0x7fa2f00a4140 2024-09-10T16:30:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4282713204 0 0) 0x7fa2f01abd50 con 0x7fa2f00a3650 2024-09-10T16:30:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 >> v1:172.21.15.189:6792/0 conn(0x7fa2f009df40 legacy=0x7fa2f01be390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 >> v1:172.21.15.189:6790/0 conn(0x7fa2f00a4140 legacy=0x7fa2f01d4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:30:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 monclient: found mon.e 2024-09-10T16:30:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2f00a76f0 con 0x7fa2f00a3650 2024-09-10T16:30:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient: _finish_auth 0 2024-09-10T16:30:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:30:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 5 monclient: authenticate success, global_id 4436 2024-09-10T16:30:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient: _renew_subs 2024-09-10T16:30:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa2f01ab790 con 0x7fa2f00a3650 2024-09-10T16:30:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient: _renew_subs 2024-09-10T16:30:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2f74e8640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fa2f01cb9a0 con 0x7fa2f00a3650 2024-09-10T16:30:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa2e40012f0 con 0x7fa2f00a3650 2024-09-10T16:30:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa2e4001b30 con 0x7fa2f00a3650 2024-09-10T16:30:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e37fe640 4 set_mon_vals no callback set 2024-09-10T16:30:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.854+0000 7fa2e1ffb640 10 monclient: dump: 2024-09-10T16:30:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.878 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2f74e8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2f74e8640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa2d00065d0 con 0x7fa2d0002870 2024-09-10T16:30:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fa2e4011250 con 0x7fa2f00a3650 2024-09-10T16:30:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 956220458 0 0) 0x7fa2e404b290 con 0x7fa2f00a3650 2024-09-10T16:30:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1839670556 0 0) 0x7fa2d00065d0 con 0x7fa2d0002870 2024-09-10T16:30:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 10 monclient(hunting): my global_id is 4537 2024-09-10T16:30:22.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2f01abd50 con 0x7fa2d0002870 2024-09-10T16:30:22.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2f5a85640 10 monclient: get_auth_request con 0x7fa2d403d1d0 auth_method 0 2024-09-10T16:30:22.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2856919927 0 0) 0x7fa2f01abd50 con 0x7fa2d0002870 2024-09-10T16:30:22.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2d00065d0 con 0x7fa2d0002870 2024-09-10T16:30:22.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa2ec0019b0 con 0x7fa2d0002870 2024-09-10T16:30:22.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:30:22.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 10 monclient: dump: 2024-09-10T16:30:22.881 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.881 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.881 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.881 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.881 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.881 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.881 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.881 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.881 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.882 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.882 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.882 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.882 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.882 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.882 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.882 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3975402319 0 0) 0x7fa2d00065d0 con 0x7fa2d0002870 2024-09-10T16:30:22.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.189:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa2d000a170 con 0x7fa2d0002870 2024-09-10T16:30:22.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa2ec001d10 con 0x7fa2d0002870 2024-09-10T16:30:22.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:22.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:22.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 >> v1:172.21.15.189:6789/0 conn(0x7fa2d0002870 legacy=0x7fa2d0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.858+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 >> v1:172.21.15.189:6789/0 conn(0x7fa2d0002870 legacy=0x7fa2d0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2f74e8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2f74e8640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa2d000c500 con 0x7fa2d00090f0 2024-09-10T16:30:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 973433801 0 0) 0x7fa2d000c500 con 0x7fa2d00090f0 2024-09-10T16:30:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 10 monclient(hunting): my global_id is 4546 2024-09-10T16:30:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2d00065d0 con 0x7fa2d00090f0 2024-09-10T16:30:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2015860553 0 0) 0x7fa2d00065d0 con 0x7fa2d00090f0 2024-09-10T16:30:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2d000c500 con 0x7fa2d00090f0 2024-09-10T16:30:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa2ec003bd0 con 0x7fa2d00090f0 2024-09-10T16:30:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:30:22.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 10 monclient: dump: 2024-09-10T16:30:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:22.884 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:22.885 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:22.885 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:22.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3960957898 0 0) 0x7fa2d000c500 con 0x7fa2d00090f0 2024-09-10T16:30:22.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 --> v1:172.21.15.189:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa2d0009ca0 con 0x7fa2d00090f0 2024-09-10T16:30:22.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 423343879) 0x7fa2ec0050e0 con 0x7fa2d00090f0 2024-09-10T16:30:22.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:22.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:22.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 >> v1:172.21.15.189:6789/0 conn(0x7fa2d00090f0 legacy=0x7fa2d0009540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2e1ffb640 1 -- 172.21.15.81:0/2386309750 >> v1:172.21.15.189:6789/0 conn(0x7fa2d00090f0 legacy=0x7fa2d0009540 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:22.885 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 6, 2024-09-10T16:30:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 32787, 2024-09-10T16:30:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:30:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:22.886 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 27, 2024-09-10T16:30:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.887 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.888 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:22.889 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:22.890 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.891 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.892 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.893 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.894 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:22.895 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.897 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.900 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.901 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:22.902 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:22.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:22.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:30:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:22.905 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:22.906 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:22.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2f74e8640 1 -- 172.21.15.81:0/2386309750 >> v1:172.21.15.189:6812/1108603242 conn(0x7fa2d403d1d0 legacy=0x7fa2d403f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2f74e8640 10 monclient: shutdown 2024-09-10T16:30:22.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2f74e8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:22.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2f74e8640 1 -- 172.21.15.81:0/2386309750 >> v1:172.21.15.81:6793/0 conn(0x7fa2f00a3650 legacy=0x7fa2f01d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:22.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2f5a85640 1 -- 172.21.15.81:0/2386309750 reap_dead start 2024-09-10T16:30:22.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2f5a85640 1 -- 172.21.15.81:0/2386309750 reap_dead start 2024-09-10T16:30:22.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2f74e8640 1 -- 172.21.15.81:0/2386309750 shutdown_connections 2024-09-10T16:30:22.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2f74e8640 1 -- 172.21.15.81:0/2386309750 >> 172.21.15.81:0/2386309750 conn(0x7fa2f00a8240 msgr2=0x7fa2f0070c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:22.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2f74e8640 1 -- 172.21.15.81:0/2386309750 shutdown_connections 2024-09-10T16:30:22.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:22.866+0000 7fa2f74e8640 1 -- 172.21.15.81:0/2386309750 wait complete. 2024-09-10T16:30:22.908 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:30:22.908 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-10T16:30:22.908 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-10T16:30:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 10 monclient: get_monmap_and_config 2024-09-10T16:30:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 10 monclient: build_initial_monmap 2024-09-10T16:30:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 10 monclient: monmap: 2024-09-10T16:30:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:23.030 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:23.032409+0000 2024-09-10T16:30:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:23.032409+0000 2024-09-10T16:30:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:23.031 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:23.032 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:23.032 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 1 Processor -- start 2024-09-10T16:30:23.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 1 -- start start 2024-09-10T16:30:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 10 monclient: init 2024-09-10T16:30:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 10 monclient: _add_conns ranks=[3,4,5,1,2,0,6,8,7] 2024-09-10T16:30:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 10 monclient(hunting): picked mon.noname-g con 0x7f0b080a0a90 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 10 monclient(hunting): picked mon.noname-c con 0x7f0b080a35f0 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 10 monclient(hunting): picked mon.noname-h con 0x7f0b080a3a40 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b0809df70 con 0x7f0b080a0a90 2024-09-10T16:30:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b0809fa30 con 0x7f0b080a35f0 2024-09-10T16:30:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b0809fd10 con 0x7f0b080a3a40 2024-09-10T16:30:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.026+0000 7f0b0d1b2640 10 monclient(hunting): authenticate will time out at 990.431871s 2024-09-10T16:30:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0659c640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f0b080a35f0 0x7f0b0813c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34666/0 (socket says 172.21.15.81:34666) 2024-09-10T16:30:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0659c640 1 -- 172.21.15.81:0/198274329 learned_addr learned my addr 172.21.15.81:0/198274329 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 1 -- 172.21.15.81:0/198274329 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 355100039 0 0) 0x7f0b0809fa30 con 0x7f0b080a35f0 2024-09-10T16:30:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient(hunting): my global_id is 4513 2024-09-10T16:30:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 1 -- 172.21.15.81:0/198274329 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0af0003530 con 0x7f0b080a35f0 2024-09-10T16:30:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 1 -- 172.21.15.81:0/198274329 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 838140621 0 0) 0x7f0b0809fd10 con 0x7f0b080a3a40 2024-09-10T16:30:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient(hunting): my global_id is 4451 2024-09-10T16:30:23.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 1 -- 172.21.15.81:0/198274329 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b0809fa30 con 0x7f0b080a3a40 2024-09-10T16:30:23.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 1 -- 172.21.15.81:0/198274329 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 219155154 0 0) 0x7f0b0809df70 con 0x7f0b080a0a90 2024-09-10T16:30:23.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient(hunting): my global_id is 4440 2024-09-10T16:30:23.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 1 -- 172.21.15.81:0/198274329 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b0809fd10 con 0x7f0b080a0a90 2024-09-10T16:30:23.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 1 -- 172.21.15.81:0/198274329 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2215309092 0 0) 0x7f0af0003530 con 0x7f0b080a35f0 2024-09-10T16:30:23.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 1 -- 172.21.15.81:0/198274329 >> v1:172.21.15.189:6791/0 conn(0x7f0b080a3a40 legacy=0x7f0b0813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 1 -- 172.21.15.81:0/198274329 >> v1:172.21.15.189:6790/0 conn(0x7f0b080a0a90 legacy=0x7f0b080a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient: _finish_hunting 0 2024-09-10T16:30:23.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 1 monclient: found mon.noname-c 2024-09-10T16:30:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:30:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 1 -- 172.21.15.81:0/198274329 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b0809fff0 con 0x7f0b080a35f0 2024-09-10T16:30:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient: _finish_auth 0 2024-09-10T16:30:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient: _check_auth_tickets 2024-09-10T16:30:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 5 monclient: authenticate success, global_id 4513 2024-09-10T16:30:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 1 -- 172.21.15.81:0/198274329 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0afc0017c0 con 0x7f0b080a35f0 2024-09-10T16:30:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient: dump: 2024-09-10T16:30:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.042 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.043 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.043 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 1 -- 172.21.15.81:0/198274329 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0afc001960 con 0x7f0b080a35f0 2024-09-10T16:30:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 1 -- 172.21.15.81:0/198274329 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0afc004bf0 con 0x7f0b080a35f0 2024-09-10T16:30:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 4 set_mon_vals no callback set 2024-09-10T16:30:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b05d9b640 10 monclient: dump: 2024-09-10T16:30:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.044 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.045 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 10 monclient: shutdown 2024-09-10T16:30:23.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/198274329 >> v1:172.21.15.81:6791/0 conn(0x7f0b080a35f0 legacy=0x7f0b0813c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/198274329 shutdown_connections 2024-09-10T16:30:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/198274329 >> 172.21.15.81:0/198274329 conn(0x7f0b080a3fd0 msgr2=0x7f0b080a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/198274329 shutdown_connections 2024-09-10T16:30:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/198274329 wait complete. 2024-09-10T16:30:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 10 monclient: build_initial_monmap 2024-09-10T16:30:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 10 monclient: monmap: 2024-09-10T16:30:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:23.046 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:23.047 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 1 Processor -- start 2024-09-10T16:30:23.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 1 -- start start 2024-09-10T16:30:23.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 10 monclient: init 2024-09-10T16:30:23.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:23.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 10 monclient: _add_conns ranks=[6,5,2,1,8,7,4,3,0] 2024-09-10T16:30:23.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 10 monclient(hunting): picked mon.noname-d con 0x7f0b080a0a90 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:23.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 10 monclient(hunting): picked mon.noname-h con 0x7f0b080a35f0 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:23.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 10 monclient(hunting): picked mon.noname-b con 0x7f0b080a3a40 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:23.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b08073ab0 con 0x7f0b080a3a40 2024-09-10T16:30:23.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b080a6c60 con 0x7f0b080a35f0 2024-09-10T16:30:23.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b08096380 con 0x7f0b080a0a90 2024-09-10T16:30:23.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:23.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0d1b2640 10 monclient(hunting): authenticate will time out at 990.435519s 2024-09-10T16:30:23.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0759e640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f0b080a3a40 0x7f0b081d3a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38714/0 (socket says 172.21.15.81:38714) 2024-09-10T16:30:23.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0b0759e640 1 -- 172.21.15.81:0/1435752832 learned_addr learned my addr 172.21.15.81:0/1435752832 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2385970373 0 0) 0x7f0b08096380 con 0x7f0b080a0a90 2024-09-10T16:30:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0aef7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0aef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0aef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0aef7fe640 10 monclient(hunting): my global_id is 4470 2024-09-10T16:30:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0af4003530 con 0x7f0b080a0a90 2024-09-10T16:30:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1919996439 0 0) 0x7f0b08073ab0 con 0x7f0b080a3a40 2024-09-10T16:30:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0aef7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0aef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0aef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0aef7fe640 10 monclient(hunting): my global_id is 4556 2024-09-10T16:30:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.030+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b08096380 con 0x7f0b080a3a40 2024-09-10T16:30:23.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2327040695 0 0) 0x7f0b080a6c60 con 0x7f0b080a35f0 2024-09-10T16:30:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): my global_id is 4460 2024-09-10T16:30:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b08073ab0 con 0x7f0b080a35f0 2024-09-10T16:30:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 224228039 0 0) 0x7f0af4003530 con 0x7f0b080a0a90 2024-09-10T16:30:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0b080a6c60 con 0x7f0b080a0a90 2024-09-10T16:30:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0af8001ac0 con 0x7f0b080a0a90 2024-09-10T16:30:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): dump: 2024-09-10T16:30:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.050 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.051 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2137534009 0 0) 0x7f0b08096380 con 0x7f0b080a3a40 2024-09-10T16:30:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0af4003530 con 0x7f0b080a3a40 2024-09-10T16:30:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0b00001d70 con 0x7f0b080a3a40 2024-09-10T16:30:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): dump: 2024-09-10T16:30:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.052 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.053 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.053 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.053 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.053 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.053 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.053 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.053 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.053 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.053 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2478511317 0 0) 0x7f0b080a6c60 con 0x7f0b080a0a90 2024-09-10T16:30:23.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 >> v1:172.21.15.189:6791/0 conn(0x7f0b080a35f0 legacy=0x7f0b0809a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 >> v1:172.21.15.81:6790/0 conn(0x7f0b080a3a40 legacy=0x7f0b081d3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:30:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 monclient: found mon.d 2024-09-10T16:30:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b08096660 con 0x7f0b080a0a90 2024-09-10T16:30:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient: _finish_auth 0 2024-09-10T16:30:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:30:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0b0d1b2640 5 monclient: authenticate success, global_id 4470 2024-09-10T16:30:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0b0d1b2640 10 monclient: _renew_subs 2024-09-10T16:30:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0b0d1b2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0b08095420 con 0x7f0b080a0a90 2024-09-10T16:30:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0b0d1b2640 10 monclient: _renew_subs 2024-09-10T16:30:23.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0b0d1b2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f0b0809a860 con 0x7f0b080a0a90 2024-09-10T16:30:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0af80038d0 con 0x7f0b080a0a90 2024-09-10T16:30:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0af8003ec0 con 0x7f0b080a0a90 2024-09-10T16:30:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0b0559a640 4 set_mon_vals no callback set 2024-09-10T16:30:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient: dump: 2024-09-10T16:30:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.056 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0b0d1b2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0ae80065d0 con 0x7f0ae8002870 2024-09-10T16:30:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f0af80040e0 con 0x7f0b080a0a90 2024-09-10T16:30:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 956220458 0 0) 0x7f0af8049df0 con 0x7f0b080a0a90 2024-09-10T16:30:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0b0759e640 10 monclient: get_auth_request con 0x7f0af403d7b0 auth_method 0 2024-09-10T16:30:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2445077382 0 0) 0x7f0ae80065d0 con 0x7f0ae8002870 2024-09-10T16:30:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient(hunting): my global_id is 4449 2024-09-10T16:30:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0b080a6c60 con 0x7f0ae8002870 2024-09-10T16:30:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3010733497 0 0) 0x7f0b080a6c60 con 0x7f0ae8002870 2024-09-10T16:30:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ae80065d0 con 0x7f0ae8002870 2024-09-10T16:30:23.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0afc0015c0 con 0x7f0ae8002870 2024-09-10T16:30:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:30:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient: dump: 2024-09-10T16:30:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.058 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.059 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3579601034 0 0) 0x7f0ae80065d0 con 0x7f0ae8002870 2024-09-10T16:30:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.189:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0ae800a170 con 0x7f0ae8002870 2024-09-10T16:30:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.3 v1:172.21.15.189:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0afc001650 con 0x7f0ae8002870 2024-09-10T16:30:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 >> v1:172.21.15.189:6790/0 conn(0x7f0ae8002870 legacy=0x7f0ae8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.034+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 >> v1:172.21.15.189:6790/0 conn(0x7f0ae8002870 legacy=0x7f0ae8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0b0d1b2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0ae8009e80 con 0x7f0ae8009140 2024-09-10T16:30:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942555066 0 0) 0x7f0ae8009e80 con 0x7f0ae8009140 2024-09-10T16:30:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 10 monclient(hunting): my global_id is 4458 2024-09-10T16:30:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ae80065d0 con 0x7f0ae8009140 2024-09-10T16:30:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3578472722 0 0) 0x7f0ae80065d0 con 0x7f0ae8009140 2024-09-10T16:30:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0ae8009e80 con 0x7f0ae8009140 2024-09-10T16:30:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0afc005000 con 0x7f0ae8009140 2024-09-10T16:30:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:30:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 10 monclient: dump: 2024-09-10T16:30:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.062 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.063 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.063 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.063 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.063 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.063 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.063 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.063 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.063 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.063 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.063 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.063 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 437526940 0 0) 0x7f0ae8009e80 con 0x7f0ae8009140 2024-09-10T16:30:23.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 --> v1:172.21.15.189:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0ae800c420 con 0x7f0ae8009140 2024-09-10T16:30:23.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 <== mon.3 v1:172.21.15.189:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 3106358730) 0x7f0afc005130 con 0x7f0ae8009140 2024-09-10T16:30:23.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:23.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:23.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 >> v1:172.21.15.189:6790/0 conn(0x7f0ae8009140 legacy=0x7f0ae80095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.042+0000 7f0aef7fe640 1 -- 172.21.15.81:0/1435752832 >> v1:172.21.15.189:6790/0 conn(0x7f0ae8009140 legacy=0x7f0ae80095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:23.064 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:23.064 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:23.064 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:23.065 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:23.065 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 6, 2024-09-10T16:30:23.065 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 32959, 2024-09-10T16:30:23.065 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:23.065 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:23.065 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:23.065 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:23.065 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:30:23.065 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:23.065 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:23.065 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:23.065 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:23.065 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:23.065 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:23.066 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 27, 2024-09-10T16:30:23.066 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:23.066 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:23.066 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:23.066 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:23.066 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:23.066 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:23.066 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:23.066 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:23.066 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:23.066 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:23.066 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:23.067 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:23.067 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:23.067 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:23.067 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:23.067 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:23.067 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:23.067 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:23.067 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:23.067 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:23.067 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:23.067 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:23.067 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:23.067 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:23.068 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:23.068 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:23.068 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:23.068 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:23.068 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.068 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:23.068 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:23.068 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:23.068 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:23.068 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:23.068 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:23.068 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:23.069 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:23.069 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:23.069 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:23.069 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:23.069 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:23.069 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:23.069 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:23.069 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:23.069 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:23.069 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:23.069 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:23.069 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:23.069 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:23.070 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:23.070 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:23.070 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:23.070 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:23.070 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:23.070 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:23.070 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:23.070 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:23.070 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:23.070 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:23.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.070 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:23.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.071 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:23.071 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:23.071 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.071 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.071 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:23.071 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.071 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.071 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:23.072 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:23.072 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.072 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.072 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.072 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:23.072 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:23.072 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.072 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.072 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.073 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:23.073 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.073 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.073 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:23.073 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:23.073 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.073 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.073 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.073 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:23.074 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:23.074 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.074 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.074 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.074 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:23.074 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.074 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.074 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:23.074 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:23.074 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.075 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.075 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.075 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:23.075 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:23.075 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.075 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.075 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:23.075 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.076 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.076 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:23.076 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:23.076 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.076 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.076 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.076 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:23.076 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:23.076 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.076 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.077 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.077 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:23.077 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.077 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.077 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:23.077 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:23.077 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.077 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.077 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:23.078 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:23.079 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.079 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.079 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.079 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:23.079 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:23.079 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.079 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.079 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:23.080 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.080 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.080 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:23.080 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:23.080 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.080 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.080 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.080 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:23.081 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:23.081 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.081 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.081 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.081 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:23.081 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.081 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.081 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:23.081 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:23.081 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.082 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.082 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.082 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:23.082 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:23.082 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.082 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.082 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:23.082 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.083 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:23.083 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:23.083 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.083 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.083 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.083 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.083 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:23.083 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:23.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.083 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:23.083 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:23.084 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:23.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.084 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:23.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:23.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.084 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:23.084 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:23.084 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-09-10T16:30:23.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.084 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.084 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:23.084 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.046+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/1435752832 >> v1:172.21.15.189:6812/1108603242 conn(0x7f0af403d7b0 legacy=0x7f0af403fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.046+0000 7f0b0d1b2640 10 monclient: shutdown 2024-09-10T16:30:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.046+0000 7f0b0d1b2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.046+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/1435752832 >> v1:172.21.15.81:6792/0 conn(0x7f0b080a0a90 legacy=0x7f0b081cb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.046+0000 7f0b0759e640 1 -- 172.21.15.81:0/1435752832 reap_dead start 2024-09-10T16:30:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.046+0000 7f0b0759e640 1 -- 172.21.15.81:0/1435752832 reap_dead start 2024-09-10T16:30:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.046+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/1435752832 shutdown_connections 2024-09-10T16:30:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.046+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/1435752832 >> 172.21.15.81:0/1435752832 conn(0x7f0b080a3fd0 msgr2=0x7f0b080741d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.046+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/1435752832 shutdown_connections 2024-09-10T16:30:23.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.046+0000 7f0b0d1b2640 1 -- 172.21.15.81:0/1435752832 wait complete. 2024-09-10T16:30:23.087 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:30:23.087 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-10T16:30:23.087 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-10T16:30:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 10 monclient: get_monmap_and_config 2024-09-10T16:30:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 10 monclient: build_initial_monmap 2024-09-10T16:30:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 10 monclient: monmap: 2024-09-10T16:30:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:23.202860+0000 2024-09-10T16:30:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:23.202860+0000 2024-09-10T16:30:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:23.202 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 1 Processor -- start 2024-09-10T16:30:23.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 1 -- start start 2024-09-10T16:30:23.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 10 monclient: init 2024-09-10T16:30:23.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:23.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 10 monclient: _add_conns ranks=[8,6,4,3,1,2,7,5,0] 2024-09-10T16:30:23.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 10 monclient(hunting): picked mon.noname-e con 0x7f22a40a0a90 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:23.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 10 monclient(hunting): picked mon.noname-d con 0x7f22a40a35f0 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:23.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 10 monclient(hunting): picked mon.noname-c con 0x7f22a40a3a40 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:23.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a409df70 con 0x7f22a40a3a40 2024-09-10T16:30:23.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a409fa30 con 0x7f22a40a35f0 2024-09-10T16:30:23.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a409fd10 con 0x7f22a40a0a90 2024-09-10T16:30:23.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 10 monclient(hunting): authenticate will time out at 990.602402s 2024-09-10T16:30:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a27fc640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f22a40a35f0 0x7f22a413c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56282/0 (socket says 172.21.15.81:56282) 2024-09-10T16:30:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a37fe640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f22a40a3a40 0x7f22a413fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:34670/0 (socket says 172.21.15.81:34670) 2024-09-10T16:30:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a27fc640 1 -- 172.21.15.81:0/2974808104 learned_addr learned my addr 172.21.15.81:0/2974808104 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 1 -- 172.21.15.81:0/2974808104 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1891340751 0 0) 0x7f22a409fd10 con 0x7f22a40a0a90 2024-09-10T16:30:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient(hunting): my global_id is 4445 2024-09-10T16:30:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 1 -- 172.21.15.81:0/2974808104 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2290003530 con 0x7f22a40a0a90 2024-09-10T16:30:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 1 -- 172.21.15.81:0/2974808104 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2625094656 0 0) 0x7f22a409df70 con 0x7f22a40a3a40 2024-09-10T16:30:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient(hunting): my global_id is 4522 2024-09-10T16:30:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 1 -- 172.21.15.81:0/2974808104 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22a409fd10 con 0x7f22a40a3a40 2024-09-10T16:30:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 1 -- 172.21.15.81:0/2974808104 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3621142999 0 0) 0x7f22a409fa30 con 0x7f22a40a35f0 2024-09-10T16:30:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient(hunting): my global_id is 4479 2024-09-10T16:30:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 1 -- 172.21.15.81:0/2974808104 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22a409df70 con 0x7f22a40a35f0 2024-09-10T16:30:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 1 -- 172.21.15.81:0/2974808104 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3612357393 0 0) 0x7f2290003530 con 0x7f22a40a0a90 2024-09-10T16:30:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 1 -- 172.21.15.81:0/2974808104 >> v1:172.21.15.81:6792/0 conn(0x7f22a40a35f0 legacy=0x7f22a413c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 1 -- 172.21.15.81:0/2974808104 >> v1:172.21.15.81:6791/0 conn(0x7f22a40a3a40 legacy=0x7f22a413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:30:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 1 monclient: found mon.noname-e 2024-09-10T16:30:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:30:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 1 -- 172.21.15.81:0/2974808104 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a409fff0 con 0x7f22a40a0a90 2024-09-10T16:30:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient: _finish_auth 0 2024-09-10T16:30:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:30:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 1 -- 172.21.15.81:0/2974808104 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f228c001840 con 0x7f22a40a0a90 2024-09-10T16:30:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient: dump: 2024-09-10T16:30:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.212 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.213 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 5 monclient: authenticate success, global_id 4445 2024-09-10T16:30:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 1 -- 172.21.15.81:0/2974808104 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f228c0019e0 con 0x7f22a40a0a90 2024-09-10T16:30:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 4 set_mon_vals no callback set 2024-09-10T16:30:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 1 -- 172.21.15.81:0/2974808104 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f228c003960 con 0x7f22a40a0a90 2024-09-10T16:30:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a1ffb640 10 monclient: dump: 2024-09-10T16:30:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.215 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 10 monclient: shutdown 2024-09-10T16:30:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:23.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 1 -- 172.21.15.81:0/2974808104 >> v1:172.21.15.81:6793/0 conn(0x7f22a40a0a90 legacy=0x7f22a40a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 1 -- 172.21.15.81:0/2974808104 shutdown_connections 2024-09-10T16:30:23.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 1 -- 172.21.15.81:0/2974808104 >> 172.21.15.81:0/2974808104 conn(0x7f22a40a3fd0 msgr2=0x7f22a40a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:23.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.198+0000 7f22a93eb640 1 -- 172.21.15.81:0/2974808104 shutdown_connections 2024-09-10T16:30:23.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 1 -- 172.21.15.81:0/2974808104 wait complete. 2024-09-10T16:30:23.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 monclient: build_initial_monmap 2024-09-10T16:30:23.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 monclient: monmap: 2024-09-10T16:30:23.216 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:23.216 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:23.216 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:23.216 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:23.217 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 1 Processor -- start 2024-09-10T16:30:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 1 -- start start 2024-09-10T16:30:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 monclient: init 2024-09-10T16:30:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 monclient: _add_conns ranks=[6,7,1,5,4,3,0,8,2] 2024-09-10T16:30:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 monclient(hunting): picked mon.noname-d con 0x7f22a40a0a90 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 monclient(hunting): picked mon.noname-i con 0x7f22a40a35f0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 monclient(hunting): picked mon.noname-f con 0x7f22a40a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a4097fa0 con 0x7f22a40a3a40 2024-09-10T16:30:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a4098280 con 0x7f22a40a0a90 2024-09-10T16:30:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22a409ce50 con 0x7f22a40a35f0 2024-09-10T16:30:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 monclient(hunting): authenticate will time out at 990.605484s 2024-09-10T16:30:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a2ffd640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f22a40a0a90 0x7f22a41d1a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:56290/0 (socket says 172.21.15.81:56290) 2024-09-10T16:30:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a2ffd640 1 -- 172.21.15.81:0/3304920165 learned_addr learned my addr 172.21.15.81:0/3304920165 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254041602 0 0) 0x7f22a4098280 con 0x7f22a40a0a90 2024-09-10T16:30:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient(hunting): my global_id is 4488 2024-09-10T16:30:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2284003530 con 0x7f22a40a0a90 2024-09-10T16:30:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1076859221 0 0) 0x7f2284003530 con 0x7f22a40a0a90 2024-09-10T16:30:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22a4098280 con 0x7f22a40a0a90 2024-09-10T16:30:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f228c001700 con 0x7f22a40a0a90 2024-09-10T16:30:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient(hunting): dump: 2024-09-10T16:30:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.221 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:23.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1875891014 0 0) 0x7f22a4098280 con 0x7f22a40a0a90 2024-09-10T16:30:23.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 >> v1:172.21.15.189:6792/0 conn(0x7f22a40a35f0 legacy=0x7f22a41d6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 >> v1:172.21.15.189:6789/0 conn(0x7f22a40a3a40 legacy=0x7f22a41da380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:30:23.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 1 monclient: found mon.d 2024-09-10T16:30:23.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:23.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:23.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22a41ba9e0 con 0x7f22a40a0a90 2024-09-10T16:30:23.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient: _finish_auth 0 2024-09-10T16:30:23.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:30:23.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:23.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 5 monclient: authenticate success, global_id 4488 2024-09-10T16:30:23.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 monclient: _renew_subs 2024-09-10T16:30:23.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:23.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 1 -- 172.21.15.81:0/3304920165 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f22a41bb300 con 0x7f22a40a0a90 2024-09-10T16:30:23.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 monclient: _renew_subs 2024-09-10T16:30:23.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:23.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 1 -- 172.21.15.81:0/3304920165 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f22a409c4e0 con 0x7f22a40a0a90 2024-09-10T16:30:23.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f228c001c10 con 0x7f22a40a0a90 2024-09-10T16:30:23.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:23.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f228c004210 con 0x7f22a40a0a90 2024-09-10T16:30:23.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:23.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a17fa640 4 set_mon_vals no callback set 2024-09-10T16:30:23.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 10 monclient: dump: 2024-09-10T16:30:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.224 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f228c004470 con 0x7f22a40a0a90 2024-09-10T16:30:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 956220458 0 0) 0x7f228c04b010 con 0x7f22a40a0a90 2024-09-10T16:30:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a93eb640 1 -- 172.21.15.81:0/3304920165 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f22a409c870 con 0x7f22a41d21a0 2024-09-10T16:30:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.202+0000 7f22a27fc640 10 monclient: get_auth_request con 0x7f228403d060 auth_method 0 2024-09-10T16:30:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1232886208 0 0) 0x7f22a409c870 con 0x7f22a41d21a0 2024-09-10T16:30:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 10 monclient(hunting): my global_id is 4469 2024-09-10T16:30:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22a4098280 con 0x7f22a41d21a0 2024-09-10T16:30:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1998546490 0 0) 0x7f22a4098280 con 0x7f22a41d21a0 2024-09-10T16:30:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22a409c870 con 0x7f22a41d21a0 2024-09-10T16:30:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f229c0017c0 con 0x7f22a41d21a0 2024-09-10T16:30:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:30:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 10 monclient: dump: 2024-09-10T16:30:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.226 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.226 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.226 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.226 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.226 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.226 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.226 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3626373408 0 0) 0x7f22a409c870 con 0x7f22a41d21a0 2024-09-10T16:30:23.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 --> v1:172.21.15.189:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22a40979e0 con 0x7f22a41d21a0 2024-09-10T16:30:23.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f229c001a30 con 0x7f22a41d21a0 2024-09-10T16:30:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 >> v1:172.21.15.189:6791/0 conn(0x7f22a41d21a0 legacy=0x7f22a4072500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.206+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 >> v1:172.21.15.189:6791/0 conn(0x7f22a41d21a0 legacy=0x7f22a4072500 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.210+0000 7f22a93eb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.210+0000 7f22a93eb640 1 -- 172.21.15.81:0/3304920165 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f22a41d2580 con 0x7f22a402e460 2024-09-10T16:30:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4203125690 0 0) 0x7f22a41d2580 con 0x7f22a402e460 2024-09-10T16:30:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 10 monclient(hunting): my global_id is 4478 2024-09-10T16:30:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22a409c870 con 0x7f22a402e460 2024-09-10T16:30:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 626312085 0 0) 0x7f22a409c870 con 0x7f22a402e460 2024-09-10T16:30:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22a41d2580 con 0x7f22a402e460 2024-09-10T16:30:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f229c004b30 con 0x7f22a402e460 2024-09-10T16:30:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:30:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 10 monclient: dump: 2024-09-10T16:30:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.230 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3357618875 0 0) 0x7f22a41d2580 con 0x7f22a402e460 2024-09-10T16:30:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 --> v1:172.21.15.189:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f22a4068f30 con 0x7f22a402e460 2024-09-10T16:30:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7710 (unknown 0 0 657672447) 0x7f229c005fc0 con 0x7f22a402e460 2024-09-10T16:30:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:23.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 >> v1:172.21.15.189:6791/0 conn(0x7f22a402e460 legacy=0x7f22a4072c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f229b7fe640 1 -- 172.21.15.81:0/3304920165 >> v1:172.21.15.189:6791/0 conn(0x7f22a402e460 legacy=0x7f22a4072c10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:23.231 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 6, 2024-09-10T16:30:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 33143, 2024-09-10T16:30:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:23.231 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:30:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 28, 2024-09-10T16:30:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:23.232 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:23.233 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.234 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:23.235 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:23.236 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.237 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:23.239 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:23.240 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:23.241 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.243 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:23.244 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.245 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.246 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:23.247 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.248 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:30:23.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.250 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:23.251 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:23.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f22a93eb640 1 -- 172.21.15.81:0/3304920165 >> v1:172.21.15.189:6812/1108603242 conn(0x7f228403d060 legacy=0x7f228403f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f22a93eb640 10 monclient: shutdown 2024-09-10T16:30:23.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f22a93eb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:23.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f22a93eb640 1 -- 172.21.15.81:0/3304920165 >> v1:172.21.15.81:6792/0 conn(0x7f22a40a0a90 legacy=0x7f22a41d1a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f22a37fe640 1 -- 172.21.15.81:0/3304920165 reap_dead start 2024-09-10T16:30:23.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f22a37fe640 1 -- 172.21.15.81:0/3304920165 reap_dead start 2024-09-10T16:30:23.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f22a93eb640 1 -- 172.21.15.81:0/3304920165 shutdown_connections 2024-09-10T16:30:23.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f22a93eb640 1 -- 172.21.15.81:0/3304920165 >> 172.21.15.81:0/3304920165 conn(0x7f22a40a3fd0 msgr2=0x7f22a41bb550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:23.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f22a93eb640 1 -- 172.21.15.81:0/3304920165 shutdown_connections 2024-09-10T16:30:23.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.214+0000 7f22a93eb640 1 -- 172.21.15.81:0/3304920165 wait complete. 2024-09-10T16:30:23.253 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:30:23.253 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-10T16:30:23.253 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-10T16:30:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient: get_monmap_and_config 2024-09-10T16:30:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient: build_initial_monmap 2024-09-10T16:30:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient: monmap: 2024-09-10T16:30:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:23.370175+0000 2024-09-10T16:30:23.368 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:23.370175+0000 2024-09-10T16:30:23.369 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:23.369 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.369 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:23.369 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:23.369 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:23.369 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:23.369 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:23.369 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:23.369 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:23.369 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:23.369 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:23.369 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 1 Processor -- start 2024-09-10T16:30:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 1 -- start start 2024-09-10T16:30:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient: init 2024-09-10T16:30:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient: _add_conns ranks=[2,3,8,6,0,4,1,7,5] 2024-09-10T16:30:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient(hunting): picked mon.noname-b con 0x7fb6dc068960 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient(hunting): picked mon.noname-g con 0x7fb6dc0a0950 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient(hunting): picked mon.noname-e con 0x7fb6dc13f5c0 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6dc0a4200 con 0x7fb6dc068960 2024-09-10T16:30:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6dc0a3c20 con 0x7fb6dc0a0950 2024-09-10T16:30:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6dc0a0ee0 con 0x7fb6dc13f5c0 2024-09-10T16:30:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient(hunting): authenticate will time out at 990.769624s 2024-09-10T16:30:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e2561640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fb6dc068960 0x7fb6dc0a2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38718/0 (socket says 172.21.15.81:38718) 2024-09-10T16:30:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e2561640 1 -- 172.21.15.81:0/1718930987 learned_addr learned my addr 172.21.15.81:0/1718930987 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e2d62640 1 --1- 172.21.15.81:0/1718930987 >> v1:172.21.15.81:6793/0 conn(0x7fb6dc13f5c0 0x7fb6dc1419b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35332/0 (socket says 172.21.15.81:35332) 2024-09-10T16:30:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 1 -- 172.21.15.81:0/1718930987 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4106662091 0 0) 0x7fb6dc0a0ee0 con 0x7fb6dc13f5c0 2024-09-10T16:30:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient(hunting): my global_id is 4454 2024-09-10T16:30:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 1 -- 172.21.15.81:0/1718930987 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6c4003530 con 0x7fb6dc13f5c0 2024-09-10T16:30:23.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 1 -- 172.21.15.81:0/1718930987 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 209496305 0 0) 0x7fb6dc0a4200 con 0x7fb6dc068960 2024-09-10T16:30:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient(hunting): my global_id is 4565 2024-09-10T16:30:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 1 -- 172.21.15.81:0/1718930987 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6dc0a0ee0 con 0x7fb6dc068960 2024-09-10T16:30:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 1 -- 172.21.15.81:0/1718930987 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4093824959 0 0) 0x7fb6c4003530 con 0x7fb6dc13f5c0 2024-09-10T16:30:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 1 -- 172.21.15.81:0/1718930987 >> v1:172.21.15.189:6790/0 conn(0x7fb6dc0a0950 legacy=0x7fb6dc0a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 1 -- 172.21.15.81:0/1718930987 >> v1:172.21.15.81:6790/0 conn(0x7fb6dc068960 legacy=0x7fb6dc0a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient: _finish_hunting 0 2024-09-10T16:30:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 1 monclient: found mon.noname-e 2024-09-10T16:30:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:30:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 1 -- 172.21.15.81:0/1718930987 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6dc0a4630 con 0x7fb6dc13f5c0 2024-09-10T16:30:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient: _finish_auth 0 2024-09-10T16:30:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient: _check_auth_tickets 2024-09-10T16:30:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 1 -- 172.21.15.81:0/1718930987 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb6cc001840 con 0x7fb6dc13f5c0 2024-09-10T16:30:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient: dump: 2024-09-10T16:30:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.379 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 5 monclient: authenticate success, global_id 4454 2024-09-10T16:30:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 1 -- 172.21.15.81:0/1718930987 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb6cc0019e0 con 0x7fb6dc13f5c0 2024-09-10T16:30:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 1 -- 172.21.15.81:0/1718930987 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb6cc004b30 con 0x7fb6dc13f5c0 2024-09-10T16:30:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 4 set_mon_vals no callback set 2024-09-10T16:30:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e155f640 10 monclient: dump: 2024-09-10T16:30:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.380 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.381 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient: shutdown 2024-09-10T16:30:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 1 -- 172.21.15.81:0/1718930987 >> v1:172.21.15.81:6793/0 conn(0x7fb6dc13f5c0 legacy=0x7fb6dc1419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 1 -- 172.21.15.81:0/1718930987 shutdown_connections 2024-09-10T16:30:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 1 -- 172.21.15.81:0/1718930987 >> 172.21.15.81:0/1718930987 conn(0x7fb6dc0a85d0 msgr2=0x7fb6dc0a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 1 -- 172.21.15.81:0/1718930987 shutdown_connections 2024-09-10T16:30:23.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 1 -- 172.21.15.81:0/1718930987 wait complete. 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient: build_initial_monmap 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.366+0000 7fb6e47c5640 10 monclient: monmap: 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:23.383 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 1 Processor -- start 2024-09-10T16:30:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 1 -- start start 2024-09-10T16:30:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 10 monclient: init 2024-09-10T16:30:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 10 monclient: _add_conns ranks=[0,3,1,6,4,5,8,7,2] 2024-09-10T16:30:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 10 monclient(hunting): picked mon.noname-a con 0x7fb6dc068960 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 10 monclient(hunting): picked mon.noname-g con 0x7fb6dc0a0950 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 10 monclient(hunting): picked mon.noname-f con 0x7fb6dc13f5c0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6dc074060 con 0x7fb6dc068960 2024-09-10T16:30:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6dc139f60 con 0x7fb6dc13f5c0 2024-09-10T16:30:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6dc13a240 con 0x7fb6dc0a0950 2024-09-10T16:30:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 10 monclient(hunting): authenticate will time out at 990.772645s 2024-09-10T16:30:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e2561640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb6dc068960 0x7fb6dc072510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43228/0 (socket says 172.21.15.81:43228) 2024-09-10T16:30:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e2561640 1 -- 172.21.15.81:0/2043336988 learned_addr learned my addr 172.21.15.81:0/2043336988 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1499618312 0 0) 0x7fb6dc074060 con 0x7fb6dc068960 2024-09-10T16:30:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): my global_id is 4527 2024-09-10T16:30:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6c8003530 con 0x7fb6dc068960 2024-09-10T16:30:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2499556089 0 0) 0x7fb6c8003530 con 0x7fb6dc068960 2024-09-10T16:30:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6dc074060 con 0x7fb6dc068960 2024-09-10T16:30:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb6d4001d10 con 0x7fb6dc068960 2024-09-10T16:30:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.385 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.386 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4031024786 0 0) 0x7fb6dc13a240 con 0x7fb6dc0a0950 2024-09-10T16:30:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): my global_id is 4476 2024-09-10T16:30:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6c8003530 con 0x7fb6dc0a0950 2024-09-10T16:30:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1245276495 0 0) 0x7fb6dc074060 con 0x7fb6dc068960 2024-09-10T16:30:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 >> v1:172.21.15.189:6790/0 conn(0x7fb6dc0a0950 legacy=0x7fb6dc072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 >> v1:172.21.15.189:6789/0 conn(0x7fb6dc13f5c0 legacy=0x7fb6dc1d6010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 monclient: found mon.a 2024-09-10T16:30:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6dc073e00 con 0x7fb6dc068960 2024-09-10T16:30:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 5 monclient: authenticate success, global_id 4527 2024-09-10T16:30:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 10 monclient: _renew_subs 2024-09-10T16:30:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 1 -- 172.21.15.81:0/2043336988 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb6dc0a6c50 con 0x7fb6dc068960 2024-09-10T16:30:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 10 monclient: _renew_subs 2024-09-10T16:30:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 1 -- 172.21.15.81:0/2043336988 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb6dc073330 con 0x7fb6dc068960 2024-09-10T16:30:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb6d4002070 con 0x7fb6dc068960 2024-09-10T16:30:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb6d4005160 con 0x7fb6dc068960 2024-09-10T16:30:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e0d5e640 4 set_mon_vals no callback set 2024-09-10T16:30:23.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient: dump: 2024-09-10T16:30:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.389 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.390 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e47c5640 1 -- 172.21.15.81:0/2043336988 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb6bc0065d0 con 0x7fb6bc002870 2024-09-10T16:30:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fb6d4011070 con 0x7fb6dc068960 2024-09-10T16:30:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(22..22 src has 1..22) ==== 3898+0+0 (unknown 956220458 0 0) 0x7fb6d404b2d0 con 0x7fb6dc068960 2024-09-10T16:30:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2423171096 0 0) 0x7fb6bc0065d0 con 0x7fb6bc002870 2024-09-10T16:30:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient(hunting): my global_id is 4489 2024-09-10T16:30:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6dc074060 con 0x7fb6bc002870 2024-09-10T16:30:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6e2d62640 10 monclient: get_auth_request con 0x7fb6c803d050 auth_method 0 2024-09-10T16:30:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1558955196 0 0) 0x7fb6dc074060 con 0x7fb6bc002870 2024-09-10T16:30:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6bc0065d0 con 0x7fb6bc002870 2024-09-10T16:30:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb6d8001a40 con 0x7fb6bc002870 2024-09-10T16:30:23.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:30:23.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.370+0000 7fb6d2ffd640 10 monclient: dump: 2024-09-10T16:30:23.392 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.392 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.392 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.392 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.392 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.392 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.392 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.392 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.392 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.392 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.393 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.393 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.393 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.393 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.393 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.393 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.406+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3149380263 0 0) 0x7fb6bc0065d0 con 0x7fb6bc002870 2024-09-10T16:30:23.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.406+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 --> v1:172.21.15.189:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb6bc00a170 con 0x7fb6bc002870 2024-09-10T16:30:23.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.410+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.7 v1:172.21.15.189:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb6d8001aa0 con 0x7fb6bc002870 2024-09-10T16:30:23.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.410+0000 7fb6d2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:23.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.410+0000 7fb6d2ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:23.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.410+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 >> v1:172.21.15.189:6792/0 conn(0x7fb6bc002870 legacy=0x7fb6bc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.410+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 >> v1:172.21.15.189:6792/0 conn(0x7fb6bc002870 legacy=0x7fb6bc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:23.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.418+0000 7fb6e47c5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:23.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.418+0000 7fb6e47c5640 1 -- 172.21.15.81:0/2043336988 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb6bc009e60 con 0x7fb6bc009120 2024-09-10T16:30:23.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1338480334 0 0) 0x7fb6bc009e60 con 0x7fb6bc009120 2024-09-10T16:30:23.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 10 monclient(hunting): my global_id is 4498 2024-09-10T16:30:23.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6bc0065d0 con 0x7fb6bc009120 2024-09-10T16:30:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3436875706 0 0) 0x7fb6bc0065d0 con 0x7fb6bc009120 2024-09-10T16:30:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6bc009e60 con 0x7fb6bc009120 2024-09-10T16:30:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb6d8003c00 con 0x7fb6bc009120 2024-09-10T16:30:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:30:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 10 monclient: dump: 2024-09-10T16:30:23.425 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.426 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3485333999 0 0) 0x7fb6bc009e60 con 0x7fb6bc009120 2024-09-10T16:30:23.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 --> v1:172.21.15.189:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb6bc00c400 con 0x7fb6bc009120 2024-09-10T16:30:23.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 <== mon.7 v1:172.21.15.189:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7710 (unknown 0 0 1561647044) 0x7fb6d8005070 con 0x7fb6bc009120 2024-09-10T16:30:23.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:23.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:23.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 >> v1:172.21.15.189:6792/0 conn(0x7fb6bc009120 legacy=0x7fb6bc0095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6d2ffd640 1 -- 172.21.15.81:0/2043336988 >> v1:172.21.15.189:6792/0 conn(0x7fb6bc009120 legacy=0x7fb6bc0095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:23.427 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:23.427 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:23.427 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:23.428 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:23.428 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 6, 2024-09-10T16:30:23.428 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 33355, 2024-09-10T16:30:23.428 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:23.428 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:23.428 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:23.428 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:23.428 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:30:23.428 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:23.428 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:23.428 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:23.428 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:23.428 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:23.428 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:23.429 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 28, 2024-09-10T16:30:23.429 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:23.429 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:23.429 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:23.429 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:23.429 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:23.429 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:23.429 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:23.429 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:23.429 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:23.429 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:23.429 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:23.429 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:23.429 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:23.430 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:23.430 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:23.430 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:23.430 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:23.430 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:23.430 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:23.430 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:23.430 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:23.430 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:23.430 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:23.430 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:23.430 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:23.430 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:23.431 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:23.431 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:23.431 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.431 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:23.431 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:23.431 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:23.431 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:23.431 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:23.431 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:23.431 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:23.431 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:23.431 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:23.431 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:23.432 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:23.432 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:23.432 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:23.432 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:23.432 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:23.432 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:23.432 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:23.432 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:23.432 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:23.432 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:23.432 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:23.432 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:23.432 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:23.432 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:23.433 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:23.433 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:23.433 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:23.433 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:23.433 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:23.433 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:23.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.433 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:23.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.433 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:23.433 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:23.433 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.433 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:23.434 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.434 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:23.434 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:23.434 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.434 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.434 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.435 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:23.435 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:23.435 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.435 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.435 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:23.435 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.435 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.435 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:23.436 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:23.436 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.436 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.436 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.436 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:23.436 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:23.436 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.436 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.436 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.436 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:23.436 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.437 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:23.437 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:23.437 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.437 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.437 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.437 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:23.437 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:23.437 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.438 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:23.438 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.438 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.438 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:23.438 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:23.438 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.438 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.438 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.439 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.440 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.440 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:23.440 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:23.440 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.440 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.440 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.440 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:23.440 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.440 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.440 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.441 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:23.441 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:23.441 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.441 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.441 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.441 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:23.441 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:23.441 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.441 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.441 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:23.442 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.442 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.442 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:23.442 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:23.442 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.442 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.442 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.442 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:23.442 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:23.442 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.443 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.443 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:23.443 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.443 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.443 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:23.443 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:23.443 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.443 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.443 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:23.444 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:23.445 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:23.445 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:23.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.445 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.445 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:23.445 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:23.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.445 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:23.445 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:23.445 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:23.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.445 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:23.445 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:23.446 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:23.447 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6e47c5640 1 -- 172.21.15.81:0/2043336988 >> v1:172.21.15.189:6812/1108603242 conn(0x7fb6c803d050 legacy=0x7fb6c803f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6e47c5640 10 monclient: shutdown 2024-09-10T16:30:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6e47c5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6e47c5640 1 -- 172.21.15.81:0/2043336988 >> v1:172.21.15.81:6789/0 conn(0x7fb6dc068960 legacy=0x7fb6dc072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6e2d62640 1 -- 172.21.15.81:0/2043336988 reap_dead start 2024-09-10T16:30:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6e2d62640 1 -- 172.21.15.81:0/2043336988 reap_dead start 2024-09-10T16:30:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6e47c5640 1 -- 172.21.15.81:0/2043336988 shutdown_connections 2024-09-10T16:30:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6e47c5640 1 -- 172.21.15.81:0/2043336988 >> 172.21.15.81:0/2043336988 conn(0x7fb6dc0a85d0 msgr2=0x7fb6dc09e310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6e47c5640 1 -- 172.21.15.81:0/2043336988 shutdown_connections 2024-09-10T16:30:23.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.422+0000 7fb6e47c5640 1 -- 172.21.15.81:0/2043336988 wait complete. 2024-09-10T16:30:23.449 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:30:23.449 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['g'] 2024-09-10T16:30:23.449 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T16:30:23.449 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.g 2024-09-10T16:30:23.449 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-09-10T16:30:23.449 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-09-10T16:30:23.449 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:30:23.470 INFO:tasks.ceph.mon.g:Stopped 2024-09-10T16:30:23.470 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 8 2024-09-10T16:30:23.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T16:30:23.527 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28311]: starting. 2024-09-10T16:30:23.527 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28311]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28310 2024-09-10T16:30:23.527 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28311]: created object 0... 2024-09-10T16:30:23.527 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28311]: created object 25... 2024-09-10T16:30:23.527 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28311]: created object 49... 2024-09-10T16:30:23.527 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28311]: finishing. 2024-09-10T16:30:23.527 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28311]: shutting down. 2024-09-10T16:30:23.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 10 monclient: get_monmap_and_config 2024-09-10T16:30:23.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 10 monclient: build_initial_monmap 2024-09-10T16:30:23.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 10 monclient: monmap: 2024-09-10T16:30:23.581 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:23.581 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.581 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:23.583278+0000 2024-09-10T16:30:23.581 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:23.583278+0000 2024-09-10T16:30:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:23.582 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 1 Processor -- start 2024-09-10T16:30:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 1 -- start start 2024-09-10T16:30:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 10 monclient: init 2024-09-10T16:30:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 10 monclient: _add_conns ranks=[0,6,1,8,5,2,4,3,7] 2024-09-10T16:30:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 10 monclient(hunting): picked mon.noname-a con 0x7f2c580a0a90 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 10 monclient(hunting): picked mon.noname-d con 0x7f2c580a35f0 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 10 monclient(hunting): picked mon.noname-f con 0x7f2c580a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c5809df70 con 0x7f2c580a0a90 2024-09-10T16:30:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c5809fa30 con 0x7f2c580a3a40 2024-09-10T16:30:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c5809fd10 con 0x7f2c580a35f0 2024-09-10T16:30:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 10 monclient(hunting): authenticate will time out at 990.982880s 2024-09-10T16:30:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c56ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2c580a0a90 0x7f2c580a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:43242/0 (socket says 172.21.15.81:43242) 2024-09-10T16:30:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c56ffd640 1 -- 172.21.15.81:0/998947632 learned_addr learned my addr 172.21.15.81:0/998947632 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 1 -- 172.21.15.81:0/998947632 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512620382 0 0) 0x7f2c5809df70 con 0x7f2c580a0a90 2024-09-10T16:30:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient(hunting): my global_id is 4536 2024-09-10T16:30:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 1 -- 172.21.15.81:0/998947632 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c40003530 con 0x7f2c580a0a90 2024-09-10T16:30:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 1 -- 172.21.15.81:0/998947632 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 368765518 0 0) 0x7f2c5809fd10 con 0x7f2c580a35f0 2024-09-10T16:30:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient(hunting): my global_id is 4497 2024-09-10T16:30:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 1 -- 172.21.15.81:0/998947632 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c5809df70 con 0x7f2c580a35f0 2024-09-10T16:30:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 1 -- 172.21.15.81:0/998947632 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 696489646 0 0) 0x7f2c40003530 con 0x7f2c580a0a90 2024-09-10T16:30:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 1 -- 172.21.15.81:0/998947632 >> v1:172.21.15.81:6792/0 conn(0x7f2c580a35f0 legacy=0x7f2c5813c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 1 -- 172.21.15.81:0/998947632 >> v1:172.21.15.189:6789/0 conn(0x7f2c580a3a40 legacy=0x7f2c5813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:30:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 1 monclient: found mon.noname-a 2024-09-10T16:30:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:30:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 1 -- 172.21.15.81:0/998947632 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5809fff0 con 0x7f2c580a0a90 2024-09-10T16:30:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient: _finish_auth 0 2024-09-10T16:30:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:30:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 1 -- 172.21.15.81:0/998947632 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2c4c001860 con 0x7f2c580a0a90 2024-09-10T16:30:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient: dump: 2024-09-10T16:30:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.592 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 5 monclient: authenticate success, global_id 4536 2024-09-10T16:30:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 1 -- 172.21.15.81:0/998947632 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2c4c001a00 con 0x7f2c580a0a90 2024-09-10T16:30:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:23.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 1 -- 172.21.15.81:0/998947632 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2c4c004bf0 con 0x7f2c580a0a90 2024-09-10T16:30:23.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c5d750640 4 set_mon_vals no callback set 2024-09-10T16:30:23.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:23.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.578+0000 7f2c55ffb640 10 monclient: dump: 2024-09-10T16:30:23.593 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.593 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.593 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.593 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.593 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.593 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.593 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.593 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.594 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient: shutdown 2024-09-10T16:30:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 1 -- 172.21.15.81:0/998947632 >> v1:172.21.15.81:6789/0 conn(0x7f2c580a0a90 legacy=0x7f2c580a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 1 -- 172.21.15.81:0/998947632 shutdown_connections 2024-09-10T16:30:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 1 -- 172.21.15.81:0/998947632 >> 172.21.15.81:0/998947632 conn(0x7f2c580a3fd0 msgr2=0x7f2c580a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 1 -- 172.21.15.81:0/998947632 shutdown_connections 2024-09-10T16:30:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 1 -- 172.21.15.81:0/998947632 wait complete. 2024-09-10T16:30:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient: build_initial_monmap 2024-09-10T16:30:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient: monmap: 2024-09-10T16:30:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:23.595 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:23.596 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:23.596 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:23.596 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:23.596 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:23.596 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:23.596 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 1 Processor -- start 2024-09-10T16:30:23.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 1 -- start start 2024-09-10T16:30:23.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient: init 2024-09-10T16:30:23.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:23.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient: _add_conns ranks=[0,7,2,8,4,1,6,3,5] 2024-09-10T16:30:23.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient(hunting): picked mon.noname-a con 0x7f2c580a0a90 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:23.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient(hunting): picked mon.noname-i con 0x7f2c580a35f0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:23.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient(hunting): picked mon.noname-b con 0x7f2c580a3a40 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:23.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c581b1520 con 0x7f2c580a0a90 2024-09-10T16:30:23.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c581cc730 con 0x7f2c580a3a40 2024-09-10T16:30:23.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2c581b1ac0 con 0x7f2c580a35f0 2024-09-10T16:30:23.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:23.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient(hunting): authenticate will time out at 990.986011s 2024-09-10T16:30:23.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c577fe640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f2c580a3a40 0x7f2c581d3b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:38720/0 (socket says 172.21.15.81:38720) 2024-09-10T16:30:23.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c577fe640 1 -- 172.21.15.81:0/2145863703 learned_addr learned my addr 172.21.15.81:0/2145863703 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:23.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2262823890 0 0) 0x7f2c581b1520 con 0x7f2c580a0a90 2024-09-10T16:30:23.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): my global_id is 4545 2024-09-10T16:30:23.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c44003530 con 0x7f2c580a0a90 2024-09-10T16:30:23.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1509591824 0 0) 0x7f2c581cc730 con 0x7f2c580a3a40 2024-09-10T16:30:23.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): my global_id is 4574 2024-09-10T16:30:23.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c581b1520 con 0x7f2c580a3a40 2024-09-10T16:30:23.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 20249446 0 0) 0x7f2c581b1520 con 0x7f2c580a3a40 2024-09-10T16:30:23.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c581cc730 con 0x7f2c580a3a40 2024-09-10T16:30:23.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2c50001e00 con 0x7f2c580a3a40 2024-09-10T16:30:23.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:23.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:23.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): dump: 2024-09-10T16:30:23.598 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.599 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.600 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:23.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 100197449 0 0) 0x7f2c44003530 con 0x7f2c580a0a90 2024-09-10T16:30:23.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2c581b1520 con 0x7f2c580a0a90 2024-09-10T16:30:23.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2c4c0047f0 con 0x7f2c580a0a90 2024-09-10T16:30:23.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:23.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:23.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): dump: 2024-09-10T16:30:23.600 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.600 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.600 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.600 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.600 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.601 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.601 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.601 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.601 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.601 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.601 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.601 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.601 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.601 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.601 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.601 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 114536538 0 0) 0x7f2c581b1ac0 con 0x7f2c580a35f0 2024-09-10T16:30:23.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:30:23.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:23.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:23.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient(hunting): my global_id is 4507 2024-09-10T16:30:23.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2c44003530 con 0x7f2c580a35f0 2024-09-10T16:30:23.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3121792795 0 0) 0x7f2c581cc730 con 0x7f2c580a3a40 2024-09-10T16:30:23.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 >> v1:172.21.15.189:6792/0 conn(0x7f2c580a35f0 legacy=0x7f2c581cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 >> v1:172.21.15.81:6789/0 conn(0x7f2c580a0a90 legacy=0x7f2c581cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:30:23.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 monclient: found mon.b 2024-09-10T16:30:23.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:23.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:23.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c581b2d50 con 0x7f2c580a3a40 2024-09-10T16:30:23.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient: _finish_auth 0 2024-09-10T16:30:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:30:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 5 monclient: authenticate success, global_id 4574 2024-09-10T16:30:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient: _renew_subs 2024-09-10T16:30:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 1 -- 172.21.15.81:0/2145863703 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2c581b3030 con 0x7f2c580a3a40 2024-09-10T16:30:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient: _renew_subs 2024-09-10T16:30:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 1 -- 172.21.15.81:0/2145863703 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f2c581b1df0 con 0x7f2c580a3a40 2024-09-10T16:30:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2c50003c50 con 0x7f2c580a3a40 2024-09-10T16:30:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2c50004180 con 0x7f2c580a3a40 2024-09-10T16:30:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c557fa640 4 set_mon_vals no callback set 2024-09-10T16:30:23.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:23.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c3f7fe640 10 monclient: dump: 2024-09-10T16:30:23.604 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:23.604 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:23.604 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.604 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:23.604 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:23.604 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:23.604 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:23.604 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:23.604 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:23.604 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:23.604 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:23.605 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:23.605 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:23.605 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:23.605 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:23.605 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:23.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.582+0000 7f2c5d750640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:23.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.586+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f2c500043e0 con 0x7f2c580a3a40 2024-09-10T16:30:23.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.586+0000 7f2c5d750640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:23.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.586+0000 7f2c5d750640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:23.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.586+0000 7f2c5d750640 1 -- 172.21.15.81:0/2145863703 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c38005090 con 0x7f2c580a3a40 2024-09-10T16:30:23.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.586+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(23..23 src has 1..23) ==== 3898+0+0 (unknown 3523114516 0 0) 0x7f2c5004b1d0 con 0x7f2c580a3a40 2024-09-10T16:30:23.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.586+0000 7f2c56ffd640 10 monclient: get_auth_request con 0x7f2c4403d740 auth_method 0 2024-09-10T16:30:23.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.590+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f2c50016f70 con 0x7f2c580a3a40 2024-09-10T16:30:23.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.590+0000 7f2c3f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:23.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.590+0000 7f2c3f7fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:23.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.806+0000 7f2c5d750640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-10T16:30:23.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.806+0000 7f2c5d750640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-10T16:30:23.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.806+0000 7f2c5d750640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:23.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.806+0000 7f2c5d750640 1 -- 172.21.15.81:0/2145863703 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f2c38005380 con 0x7f2c580a3a40 2024-09-10T16:30:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.806+0000 7f2c3f7fe640 1 -- 172.21.15.81:0/2145863703 <== mon.2 v1:172.21.15.81:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 3574322190) 0x7f2c50016870 con 0x7f2c580a3a40 2024-09-10T16:30:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.810+0000 7f2c3f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-10T16:30:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.810+0000 7f2c3f7fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:23.812 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":6,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"b","quorum_age":28,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","modified":"2024-09-10T16:29:22.909160Z","created":"2024-09-10T16:29:22.909160Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6790","nonce":0}]},"addr":"172.21.15.189:6790/0","public_addr":"172.21.15.189:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6791","nonce":0}]},"addr":"172.21.15.81:6791/0","public_addr":"172.21.15.81:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6791","nonce":0}]},"addr":"172.21.15.189:6791/0","public_addr":"172.21.15.189:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6792","nonce":0}]},"addr":"172.21.15.81:6792/0","public_addr":"172.21.15.81:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6792","nonce":0}]},"addr":"172.21.15.189:6792/0","public_addr":"172.21.15.189:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6793","nonce":0}]},"addr":"172.21.15.81:6793/0","public_addr":"172.21.15.81:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T16:30:23.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.810+0000 7f2c5d750640 1 -- 172.21.15.81:0/2145863703 >> v1:172.21.15.189:6812/1108603242 conn(0x7f2c4403d740 legacy=0x7f2c4403fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.810+0000 7f2c5d750640 10 monclient: shutdown 2024-09-10T16:30:23.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.810+0000 7f2c5d750640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:23.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.810+0000 7f2c5d750640 1 -- 172.21.15.81:0/2145863703 >> v1:172.21.15.81:6790/0 conn(0x7f2c580a3a40 legacy=0x7f2c581d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:23.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.810+0000 7f2c5d750640 1 -- 172.21.15.81:0/2145863703 shutdown_connections 2024-09-10T16:30:23.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.810+0000 7f2c5d750640 1 -- 172.21.15.81:0/2145863703 >> 172.21.15.81:0/2145863703 conn(0x7f2c580a3fd0 msgr2=0x7f2c5809a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:23.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.810+0000 7f2c5d750640 1 -- 172.21.15.81:0/2145863703 shutdown_connections 2024-09-10T16:30:23.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:23.810+0000 7f2c5d750640 1 -- 172.21.15.81:0/2145863703 wait complete. 2024-09-10T16:30:26.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T16:30:26.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 10 monclient: get_monmap_and_config 2024-09-10T16:30:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 10 monclient: build_initial_monmap 2024-09-10T16:30:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 10 monclient: monmap: 2024-09-10T16:30:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:26.959768+0000 2024-09-10T16:30:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:26.959768+0000 2024-09-10T16:30:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:26.958 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:26.959 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:26.959 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:26.959 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:26.959 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:26.959 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:26.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 1 Processor -- start 2024-09-10T16:30:26.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 1 -- start start 2024-09-10T16:30:26.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 10 monclient: init 2024-09-10T16:30:26.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 10 monclient: _add_conns ranks=[7,6,4,8,2,1,0,3,5] 2024-09-10T16:30:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 10 monclient(hunting): picked mon.noname-i con 0x7f03600a0a90 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 10 monclient(hunting): picked mon.noname-d con 0x7f03600a35f0 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 10 monclient(hunting): picked mon.noname-c con 0x7f03600a3a40 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f036009df70 con 0x7f03600a3a40 2024-09-10T16:30:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f036009fa30 con 0x7f03600a35f0 2024-09-10T16:30:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f036009fd10 con 0x7f03600a0a90 2024-09-10T16:30:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f03668fb640 10 monclient(hunting): authenticate will time out at 994.359203s 2024-09-10T16:30:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f035f7fe640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f03600a35f0 0x7f036013c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:49590/0 (socket says 172.21.15.81:49590) 2024-09-10T16:30:26.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:26.954+0000 7f035f7fe640 1 -- 172.21.15.81:0/3616750710 learned_addr learned my addr 172.21.15.81:0/3616750710 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 10 monclient(hunting): tick 2024-09-10T16:30:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 10 monclient(hunting): _check_auth_tickets 2024-09-10T16:30:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 1 monclient(hunting): continuing hunt 2024-09-10T16:30:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 10 monclient(hunting): _reopen_session rank -1 2024-09-10T16:30:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.189:6792/0 conn(0x7f03600a0a90 legacy=0x7f03600a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.81:6792/0 conn(0x7f03600a35f0 legacy=0x7f036013c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.81:6791/0 conn(0x7f03600a3a40 legacy=0x7f036013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 10 monclient: _add_conns ranks=[0,2,5,3,8,1] 2024-09-10T16:30:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 10 monclient(hunting): picked mon.noname-a con 0x7f034c0037f0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:29.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 10 monclient(hunting): picked mon.noname-b con 0x7f034c007480 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:29.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 10 monclient(hunting): picked mon.noname-h con 0x7f034c00b1f0 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:29.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f036009fff0 con 0x7f034c0037f0 2024-09-10T16:30:29.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c010010 con 0x7f034c007480 2024-09-10T16:30:29.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c011290 con 0x7f034c00b1f0 2024-09-10T16:30:29.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:29.958+0000 7f035dffb640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:32.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.954+0000 7f035dffb640 10 monclient(hunting): tick 2024-09-10T16:30:32.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.954+0000 7f035dffb640 10 monclient(hunting): _check_auth_tickets 2024-09-10T16:30:32.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.954+0000 7f035dffb640 1 monclient(hunting): continuing hunt 2024-09-10T16:30:32.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.954+0000 7f035dffb640 10 monclient(hunting): _reopen_session rank -1 2024-09-10T16:30:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.954+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.189:6791/0 conn(0x7f034c00b1f0 legacy=0x7f034c00d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.954+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.81:6790/0 conn(0x7f034c007480 legacy=0x7f034c009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.954+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.81:6789/0 conn(0x7f034c0037f0 legacy=0x7f034c005c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.954+0000 7f035dffb640 10 monclient: _add_conns ranks=[8,3,1] 2024-09-10T16:30:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.954+0000 7f035dffb640 10 monclient(hunting): picked mon.noname-e con 0x7f034c00f1e0 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.954+0000 7f0364e98640 1 -- 172.21.15.81:0/3616750710 reap_dead start 2024-09-10T16:30:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.954+0000 7f035dffb640 10 monclient(hunting): picked mon.noname-g con 0x7f034c0101e0 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.954+0000 7f035dffb640 10 monclient(hunting): picked mon.noname-f con 0x7f034c00a0f0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c0125f0 con 0x7f034c00a0f0 2024-09-10T16:30:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.958+0000 7f035f7fe640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.189:6790/0 conn(0x7f034c0101e0 legacy=0x7f034c010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:30:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c010f30 con 0x7f034c0101e0 2024-09-10T16:30:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c00a4d0 con 0x7f034c00f1e0 2024-09-10T16:30:32.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:32.958+0000 7f035dffb640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:33.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:33.162+0000 7f035f7fe640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.189:6790/0 conn(0x7f034c0101e0 legacy=0x7f034c010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:30:33.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:33.566+0000 7f035f7fe640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.189:6790/0 conn(0x7f034c0101e0 legacy=0x7f034c010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:30:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:34.370+0000 7f035f7fe640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.189:6790/0 conn(0x7f034c0101e0 legacy=0x7f034c010610 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:30:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 10 monclient(hunting): tick 2024-09-10T16:30:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 10 monclient(hunting): _check_auth_tickets 2024-09-10T16:30:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 1 monclient(hunting): continuing hunt 2024-09-10T16:30:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 10 monclient(hunting): _reopen_session rank -1 2024-09-10T16:30:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.81:6793/0 conn(0x7f034c00f1e0 legacy=0x7f034c00f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.189:6790/0 conn(0x7f034c0101e0 legacy=0x7f034c010610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:30:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.189:6789/0 conn(0x7f034c00a0f0 legacy=0x7f034c009920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 10 monclient: _add_conns ranks=[0,8,7,5,6,3,1,4,2] 2024-09-10T16:30:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 10 monclient(hunting): picked mon.noname-a con 0x7f034c00a6a0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 10 monclient(hunting): picked mon.noname-e con 0x7f034c00f1e0 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 10 monclient(hunting): picked mon.noname-i con 0x7f034c00aa80 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c005ca0 con 0x7f034c00a6a0 2024-09-10T16:30:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c010f30 con 0x7f034c00aa80 2024-09-10T16:30:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 1 -- 172.21.15.81:0/3616750710 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f034c00ae60 con 0x7f034c00f1e0 2024-09-10T16:30:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:35.958+0000 7f035dffb640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.442+0000 7f035effd640 1 -- 172.21.15.81:0/3616750710 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3620713174 0 0) 0x7f034c00ae60 con 0x7f034c00f1e0 2024-09-10T16:30:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.442+0000 7f035effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.442+0000 7f035effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.442+0000 7f035effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.442+0000 7f035effd640 10 monclient(hunting): my global_id is 4463 2024-09-10T16:30:38.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.442+0000 7f035effd640 1 -- 172.21.15.81:0/3616750710 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0348003530 con 0x7f034c00f1e0 2024-09-10T16:30:38.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 1 -- 172.21.15.81:0/3616750710 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3031893911 0 0) 0x7f034c005ca0 con 0x7f034c00a6a0 2024-09-10T16:30:38.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:38.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:38.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:38.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient(hunting): my global_id is 4554 2024-09-10T16:30:38.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 1 -- 172.21.15.81:0/3616750710 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f034c00ae60 con 0x7f034c00a6a0 2024-09-10T16:30:38.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 1 -- 172.21.15.81:0/3616750710 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1555012862 0 0) 0x7f0348003530 con 0x7f034c00f1e0 2024-09-10T16:30:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.189:6792/0 conn(0x7f034c00aa80 legacy=0x7f034c00e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.81:6789/0 conn(0x7f034c00a6a0 legacy=0x7f034c00de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 1 monclient: found mon.noname-e 2024-09-10T16:30:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:30:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 1 -- 172.21.15.81:0/3616750710 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f034c005fd0 con 0x7f034c00f1e0 2024-09-10T16:30:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient: _finish_auth 0 2024-09-10T16:30:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 1 -- 172.21.15.81:0/3616750710 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0350001900 con 0x7f034c00f1e0 2024-09-10T16:30:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:38.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:38.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient: dump: 2024-09-10T16:30:38.454 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:38.454 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:38.454 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.454 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.454 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:38.454 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:38.454 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:38.454 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:38.454 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:38.454 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:38.454 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:38.454 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:38.455 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:38.455 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:38.455 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:38.455 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:38.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f03668fb640 5 monclient: authenticate success, global_id 4463 2024-09-10T16:30:38.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f03668fb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 1 -- 172.21.15.81:0/3616750710 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0350001aa0 con 0x7f034c00f1e0 2024-09-10T16:30:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 1 -- 172.21.15.81:0/3616750710 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0350001d50 con 0x7f034c00f1e0 2024-09-10T16:30:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.446+0000 7f035effd640 10 monclient: dump: 2024-09-10T16:30:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:38.456 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:38.457 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.450+0000 7f03668fb640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.450+0000 7f03668fb640 4 set_mon_vals no callback set 2024-09-10T16:30:38.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.450+0000 7f03668fb640 10 monclient: shutdown 2024-09-10T16:30:38.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.450+0000 7f03668fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:38.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.450+0000 7f03668fb640 1 -- 172.21.15.81:0/3616750710 >> v1:172.21.15.81:6793/0 conn(0x7f034c00f1e0 legacy=0x7f034c00f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.450+0000 7f0364e98640 1 -- 172.21.15.81:0/3616750710 reap_dead start 2024-09-10T16:30:38.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.450+0000 7f03668fb640 1 -- 172.21.15.81:0/3616750710 shutdown_connections 2024-09-10T16:30:38.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.450+0000 7f03668fb640 1 -- 172.21.15.81:0/3616750710 >> 172.21.15.81:0/3616750710 conn(0x7f03600a3fd0 msgr2=0x7f03600a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:38.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.450+0000 7f03668fb640 1 -- 172.21.15.81:0/3616750710 shutdown_connections 2024-09-10T16:30:38.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.450+0000 7f03668fb640 1 -- 172.21.15.81:0/3616750710 wait complete. 2024-09-10T16:30:38.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 10 monclient: build_initial_monmap 2024-09-10T16:30:38.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 10 monclient: monmap: 2024-09-10T16:30:38.459 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:38.459 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:38.459 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:38.459 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:38.459 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:38.459 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:38.459 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:38.459 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:38.460 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 1 Processor -- start 2024-09-10T16:30:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 1 -- start start 2024-09-10T16:30:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 10 monclient: init 2024-09-10T16:30:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 10 monclient: _add_conns ranks=[0,5,2,1,3,6,7,8,4] 2024-09-10T16:30:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 10 monclient(hunting): picked mon.noname-a con 0x7f034c00f1e0 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 10 monclient(hunting): picked mon.noname-h con 0x7f036009aaf0 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 10 monclient(hunting): picked mon.noname-b con 0x7f03601c7610 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0360092b10 con 0x7f034c00f1e0 2024-09-10T16:30:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f03601c7ac0 con 0x7f03601c7610 2024-09-10T16:30:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f036009d100 con 0x7f036009aaf0 2024-09-10T16:30:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f03668fb640 10 monclient(hunting): authenticate will time out at 1005.858049s 2024-09-10T16:30:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f0364e98640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f03601c7610 0x7f03601e3320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:58700/0 (socket says 172.21.15.81:58700) 2024-09-10T16:30:38.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.454+0000 7f0364e98640 1 -- 172.21.15.81:0/562316920 learned_addr learned my addr 172.21.15.81:0/562316920 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:38.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1973499347 0 0) 0x7f0360092b10 con 0x7f034c00f1e0 2024-09-10T16:30:38.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:30:38.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:38.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:38.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 10 monclient(hunting): my global_id is 4563 2024-09-10T16:30:38.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f034c005ca0 con 0x7f034c00f1e0 2024-09-10T16:30:38.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2886520544 0 0) 0x7f034c005ca0 con 0x7f034c00f1e0 2024-09-10T16:30:38.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0360092b10 con 0x7f034c00f1e0 2024-09-10T16:30:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0354001a40 con 0x7f034c00f1e0 2024-09-10T16:30:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 10 monclient(hunting): dump: 2024-09-10T16:30:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:38.464 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:38.465 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4229743133 0 0) 0x7f0360092b10 con 0x7f034c00f1e0 2024-09-10T16:30:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 >> v1:172.21.15.189:6791/0 conn(0x7f036009aaf0 legacy=0x7f03601dfbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 >> v1:172.21.15.81:6790/0 conn(0x7f03601c7610 legacy=0x7f03601e3320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 10 monclient: _finish_hunting 0 2024-09-10T16:30:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 1 monclient: found mon.a 2024-09-10T16:30:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0360094e70 con 0x7f034c00f1e0 2024-09-10T16:30:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 10 monclient: _finish_auth 0 2024-09-10T16:30:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 10 monclient: _check_auth_tickets 2024-09-10T16:30:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f03668fb640 5 monclient: authenticate success, global_id 4563 2024-09-10T16:30:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f03668fb640 10 monclient: _renew_subs 2024-09-10T16:30:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f03668fb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f03668fb640 1 -- 172.21.15.81:0/562316920 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f03600744f0 con 0x7f034c00f1e0 2024-09-10T16:30:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f03668fb640 10 monclient: _renew_subs 2024-09-10T16:30:38.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f03668fb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:38.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f03668fb640 1 -- 172.21.15.81:0/562316920 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f0360093670 con 0x7f034c00f1e0 2024-09-10T16:30:38.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f03668fb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:38.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0354001ce0 con 0x7f034c00f1e0 2024-09-10T16:30:38.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035cff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:38.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.458+0000 7f035dffb640 4 set_mon_vals no callback set 2024-09-10T16:30:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.462+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0354003bf0 con 0x7f034c00f1e0 2024-09-10T16:30:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.462+0000 7f035cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.462+0000 7f035cff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.462+0000 7f035cff9640 10 monclient: dump: 2024-09-10T16:30:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:38.468 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:38.469 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.462+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f0354003e50 con 0x7f034c00f1e0 2024-09-10T16:30:38.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.462+0000 7f03668fb640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:38.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.462+0000 7f03668fb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:38.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.462+0000 7f03668fb640 1 -- 172.21.15.81:0/562316920 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03600008e0 con 0x7f034c00f1e0 2024-09-10T16:30:38.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.462+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (unknown 2089754905 0 0) 0x7f0354049be0 con 0x7f034c00f1e0 2024-09-10T16:30:38.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.462+0000 7f035f7fe640 10 monclient: get_auth_request con 0x7f034c03f980 auth_method 0 2024-09-10T16:30:38.471 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28312]: starting. 2024-09-10T16:30:38.471 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28312]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28310 2024-09-10T16:30:38.471 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28312]: shutting down. 2024-09-10T16:30:38.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.470+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f0354015b20 con 0x7f034c00f1e0 2024-09-10T16:30:38.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.470+0000 7f035cff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:38.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.470+0000 7f035cff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.714+0000 7f03668fb640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-10T16:30:38.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.714+0000 7f03668fb640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-10T16:30:38.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.714+0000 7f03668fb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:30:38.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.714+0000 7f03668fb640 1 -- 172.21.15.81:0/562316920 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f03600008e0 con 0x7f034c00f1e0 2024-09-10T16:30:38.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.714+0000 7f035cff9640 1 -- 172.21.15.81:0/562316920 <== mon.0 v1:172.21.15.81:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2723 (unknown 254746657 0 2978850077) 0x7f0354015420 con 0x7f034c00f1e0 2024-09-10T16:30:38.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.714+0000 7f035cff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-10T16:30:38.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.714+0000 7f035cff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:38.719 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":12,"quorum":[0,1,2,4,5,6,7,8],"quorum_names":["a","f","b","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","modified":"2024-09-10T16:29:22.909160Z","created":"2024-09-10T16:29:22.909160Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6790","nonce":0}]},"addr":"172.21.15.189:6790/0","public_addr":"172.21.15.189:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6791","nonce":0}]},"addr":"172.21.15.81:6791/0","public_addr":"172.21.15.81:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6791","nonce":0}]},"addr":"172.21.15.189:6791/0","public_addr":"172.21.15.189:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6792","nonce":0}]},"addr":"172.21.15.81:6792/0","public_addr":"172.21.15.81:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6792","nonce":0}]},"addr":"172.21.15.189:6792/0","public_addr":"172.21.15.189:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6793","nonce":0}]},"addr":"172.21.15.81:6793/0","public_addr":"172.21.15.81:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T16:30:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.718+0000 7f03668fb640 1 -- 172.21.15.81:0/562316920 >> v1:172.21.15.189:6812/1108603242 conn(0x7f034c03f980 legacy=0x7f034c041e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.718+0000 7f03668fb640 10 monclient: shutdown 2024-09-10T16:30:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.718+0000 7f03668fb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.718+0000 7f03668fb640 1 -- 172.21.15.81:0/562316920 >> v1:172.21.15.81:6789/0 conn(0x7f034c00f1e0 legacy=0x7f036009a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.718+0000 7f03668fb640 1 -- 172.21.15.81:0/562316920 shutdown_connections 2024-09-10T16:30:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.718+0000 7f03668fb640 1 -- 172.21.15.81:0/562316920 >> 172.21.15.81:0/562316920 conn(0x7f03600a3fd0 msgr2=0x7f036009b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.718+0000 7f03668fb640 1 -- 172.21.15.81:0/562316920 shutdown_connections 2024-09-10T16:30:38.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.718+0000 7f03668fb640 1 -- 172.21.15.81:0/562316920 wait complete. 2024-09-10T16:30:38.738 INFO:tasks.mon_thrash.ceph_manager:quorum is size 8 2024-09-10T16:30:38.738 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon a 2024-09-10T16:30:38.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T16:30:38.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 10 monclient: get_monmap_and_config 2024-09-10T16:30:38.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 10 monclient: build_initial_monmap 2024-09-10T16:30:38.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 10 monclient: monmap: 2024-09-10T16:30:38.861 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:38.861 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:38.861 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:38.862526+0000 2024-09-10T16:30:38.861 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:38.862526+0000 2024-09-10T16:30:38.861 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:38.861 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:38.861 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:38.861 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:38.861 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:38.861 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:38.861 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:38.862 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:38.862 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:38.862 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:38.862 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:38.862 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:38.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 1 Processor -- start 2024-09-10T16:30:38.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 1 -- start start 2024-09-10T16:30:38.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 10 monclient: init 2024-09-10T16:30:38.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:38.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 10 monclient: _add_conns ranks=[2,6,0,7,5,8,1,3,4] 2024-09-10T16:30:38.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 10 monclient(hunting): picked mon.noname-b con 0x7f9f180a0a90 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:38.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 10 monclient(hunting): picked mon.noname-d con 0x7f9f180a35f0 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:38.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 10 monclient(hunting): picked mon.noname-a con 0x7f9f180a3a40 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:38.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f1809df70 con 0x7f9f180a3a40 2024-09-10T16:30:38.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f1809fa30 con 0x7f9f180a0a90 2024-09-10T16:30:38.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f1809fd10 con 0x7f9f180a35f0 2024-09-10T16:30:38.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:38.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 10 monclient(hunting): authenticate will time out at 1006.261883s 2024-09-10T16:30:38.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1ce51640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f9f180a35f0 0x7f9f1813c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:37434/0 (socket says 172.21.15.81:37434) 2024-09-10T16:30:38.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1d652640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f9f180a0a90 0x7f9f180a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:58708/0 (socket says 172.21.15.81:58708) 2024-09-10T16:30:38.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1ce51640 1 -- 172.21.15.81:0/420075165 learned_addr learned my addr 172.21.15.81:0/420075165 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:38.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 1 -- 172.21.15.81:0/420075165 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1564752558 0 0) 0x7f9f1809fa30 con 0x7f9f180a0a90 2024-09-10T16:30:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient(hunting): my global_id is 4583 2024-09-10T16:30:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 1 -- 172.21.15.81:0/420075165 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f04003530 con 0x7f9f180a0a90 2024-09-10T16:30:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 1 -- 172.21.15.81:0/420075165 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2729150099 0 0) 0x7f9f1809fd10 con 0x7f9f180a35f0 2024-09-10T16:30:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient(hunting): my global_id is 4515 2024-09-10T16:30:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 1 -- 172.21.15.81:0/420075165 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f1809fa30 con 0x7f9f180a35f0 2024-09-10T16:30:38.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 1 -- 172.21.15.81:0/420075165 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4143347479 0 0) 0x7f9f1809df70 con 0x7f9f180a3a40 2024-09-10T16:30:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient(hunting): my global_id is 4608 2024-09-10T16:30:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 1 -- 172.21.15.81:0/420075165 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f1809fd10 con 0x7f9f180a3a40 2024-09-10T16:30:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 1 -- 172.21.15.81:0/420075165 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 562193278 0 0) 0x7f9f1809fa30 con 0x7f9f180a35f0 2024-09-10T16:30:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 1 -- 172.21.15.81:0/420075165 >> v1:172.21.15.81:6790/0 conn(0x7f9f180a0a90 legacy=0x7f9f180a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 1 -- 172.21.15.81:0/420075165 >> v1:172.21.15.81:6789/0 conn(0x7f9f180a3a40 legacy=0x7f9f1813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient: _finish_hunting 0 2024-09-10T16:30:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 1 monclient: found mon.noname-d 2024-09-10T16:30:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:30:38.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 1 -- 172.21.15.81:0/420075165 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f1809fff0 con 0x7f9f180a35f0 2024-09-10T16:30:38.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient: _finish_auth 0 2024-09-10T16:30:38.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient: _check_auth_tickets 2024-09-10T16:30:38.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:38.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 1 -- 172.21.15.81:0/420075165 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9f08001820 con 0x7f9f180a35f0 2024-09-10T16:30:38.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:38.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:38.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient: dump: 2024-09-10T16:30:38.873 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:38.873 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:38.873 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.873 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.873 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:38.873 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:38.873 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:38.873 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:38.873 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:38.874 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 5 monclient: authenticate success, global_id 4515 2024-09-10T16:30:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 1 -- 172.21.15.81:0/420075165 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f08001a40 con 0x7f9f180a35f0 2024-09-10T16:30:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:38.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 4 set_mon_vals no callback set 2024-09-10T16:30:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 1 -- 172.21.15.81:0/420075165 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9f08004bf0 con 0x7f9f180a35f0 2024-09-10T16:30:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f0ffff640 10 monclient: dump: 2024-09-10T16:30:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:38.875 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:38.876 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 10 monclient: shutdown 2024-09-10T16:30:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/420075165 >> v1:172.21.15.81:6792/0 conn(0x7f9f180a35f0 legacy=0x7f9f1813c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/420075165 shutdown_connections 2024-09-10T16:30:38.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/420075165 >> 172.21.15.81:0/420075165 conn(0x7f9f180a3fd0 msgr2=0x7f9f180a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:38.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/420075165 shutdown_connections 2024-09-10T16:30:38.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.858+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/420075165 wait complete. 2024-09-10T16:30:38.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 monclient: build_initial_monmap 2024-09-10T16:30:38.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 monclient: monmap: 2024-09-10T16:30:38.877 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:38.877 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:38.877 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:38.877 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:38.877 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:38.877 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:38.877 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:38.877 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:38.877 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:38.878 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 1 Processor -- start 2024-09-10T16:30:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 1 -- start start 2024-09-10T16:30:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 monclient: init 2024-09-10T16:30:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 monclient: _add_conns ranks=[2,3,6,4,5,0,1,8,7] 2024-09-10T16:30:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 monclient(hunting): picked mon.noname-b con 0x7f9f180a0a90 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:38.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 monclient(hunting): picked mon.noname-g con 0x7f9f180a35f0 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 monclient(hunting): picked mon.noname-d con 0x7f9f180a3a40 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f1809c2f0 con 0x7f9f180a0a90 2024-09-10T16:30:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f181b59c0 con 0x7f9f180a35f0 2024-09-10T16:30:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f1809c570 con 0x7f9f180a3a40 2024-09-10T16:30:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 monclient(hunting): authenticate will time out at 1006.264981s 2024-09-10T16:30:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1de53640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f9f180a3a40 0x7f9f181d5b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:37440/0 (socket says 172.21.15.81:37440) 2024-09-10T16:30:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1de53640 1 -- 172.21.15.81:0/3378179811 learned_addr learned my addr 172.21.15.81:0/3378179811 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1ce51640 1 -- 172.21.15.81:0/3378179811 >> v1:172.21.15.189:6790/0 conn(0x7f9f180a35f0 legacy=0x7f9f1809bbe0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:30:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 897316725 0 0) 0x7f9f1809c570 con 0x7f9f180a3a40 2024-09-10T16:30:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:38.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): my global_id is 4524 2024-09-10T16:30:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9efc003560 con 0x7f9f180a3a40 2024-09-10T16:30:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 20116578 0 0) 0x7f9f1809c2f0 con 0x7f9f180a0a90 2024-09-10T16:30:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): my global_id is 4592 2024-09-10T16:30:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f1809c570 con 0x7f9f180a0a90 2024-09-10T16:30:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1061369689 0 0) 0x7f9efc003560 con 0x7f9f180a3a40 2024-09-10T16:30:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f1809c2f0 con 0x7f9f180a3a40 2024-09-10T16:30:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9f10001d80 con 0x7f9f180a3a40 2024-09-10T16:30:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): dump: 2024-09-10T16:30:38.880 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:38.881 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:38.881 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.881 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.881 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:38.881 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:38.881 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:38.881 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:38.881 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:38.881 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:38.881 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:38.881 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:38.881 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:38.881 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2793684018 0 0) 0x7f9f1809c570 con 0x7f9f180a0a90 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9efc003560 con 0x7f9f180a0a90 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9f14001490 con 0x7f9f180a0a90 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): dump: 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:38.882 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:38.883 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 535037412 0 0) 0x7f9f1809c2f0 con 0x7f9f180a3a40 2024-09-10T16:30:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 >> v1:172.21.15.189:6790/0 conn(0x7f9f180a35f0 legacy=0x7f9f1809bbe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:30:38.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 >> v1:172.21.15.81:6790/0 conn(0x7f9f180a0a90 legacy=0x7f9f1809b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient: _finish_hunting 0 2024-09-10T16:30:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 monclient: found mon.d 2024-09-10T16:30:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f181b5fa0 con 0x7f9f180a3a40 2024-09-10T16:30:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient: _finish_auth 0 2024-09-10T16:30:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient: _check_auth_tickets 2024-09-10T16:30:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 5 monclient: authenticate success, global_id 4524 2024-09-10T16:30:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 monclient: _renew_subs 2024-09-10T16:30:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9f181b6cf0 con 0x7f9f180a3a40 2024-09-10T16:30:38.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 monclient: _renew_subs 2024-09-10T16:30:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f9f181bb0b0 con 0x7f9f180a3a40 2024-09-10T16:30:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f10002080 con 0x7f9f180a3a40 2024-09-10T16:30:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9f10003f90 con 0x7f9f180a3a40 2024-09-10T16:30:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient: dump: 2024-09-10T16:30:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.885 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:38.886 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0f7fe640 4 set_mon_vals no callback set 2024-09-10T16:30:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f9f10004130 con 0x7f9f180a3a40 2024-09-10T16:30:38.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (unknown 2089754905 0 0) 0x7f9f1004b060 con 0x7f9f180a3a40 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9f180008e0 con 0x7f9f180706b0 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3680595868 0 0) 0x7f9f180008e0 con 0x7f9f180706b0 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient(hunting): my global_id is 4617 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f1809c2f0 con 0x7f9f180706b0 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f1d652640 10 monclient: get_auth_request con 0x7f9efc03d690 auth_method 0 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2103607096 0 0) 0x7f9f1809c2f0 con 0x7f9f180706b0 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f180008e0 con 0x7f9f180706b0 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9f080014a0 con 0x7f9f180706b0 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:38.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 10 monclient: dump: 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:38.888 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:38.889 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:38.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1906829426 0 0) 0x7f9f180008e0 con 0x7f9f180706b0 2024-09-10T16:30:38.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.862+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f181bb3a0 con 0x7f9f180706b0 2024-09-10T16:30:38.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.866+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9f080016e0 con 0x7f9f180706b0 2024-09-10T16:30:38.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.866+0000 7f9f0dffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:38.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.866+0000 7f9f0dffb640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:38.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.866+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 >> v1:172.21.15.81:6789/0 conn(0x7f9f180706b0 legacy=0x7f9f18070a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.866+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 >> v1:172.21.15.81:6789/0 conn(0x7f9f180706b0 legacy=0x7f9f18070a90 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:38.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f1f8b6640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:38.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9f180715a0 con 0x7f9f180711a0 2024-09-10T16:30:38.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2357185993 0 0) 0x7f9f180715a0 con 0x7f9f180711a0 2024-09-10T16:30:38.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:30:38.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:38.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:38.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 10 monclient(hunting): my global_id is 4626 2024-09-10T16:30:38.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f180008e0 con 0x7f9f180711a0 2024-09-10T16:30:38.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3680910649 0 0) 0x7f9f180008e0 con 0x7f9f180711a0 2024-09-10T16:30:38.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f180715a0 con 0x7f9f180711a0 2024-09-10T16:30:38.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9f08001bc0 con 0x7f9f180711a0 2024-09-10T16:30:38.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:38.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:38.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 10 monclient: dump: 2024-09-10T16:30:38.891 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:38.891 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:38.891 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.892 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:38.892 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:38.892 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:38.892 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:38.892 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:38.892 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:38.892 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:38.892 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:38.892 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:38.892 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:38.892 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:38.892 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:38.892 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:38.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2667243587 0 0) 0x7f9f180715a0 con 0x7f9f180711a0 2024-09-10T16:30:38.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 --> v1:172.21.15.81:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9f181deb80 con 0x7f9f180711a0 2024-09-10T16:30:38.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7534 (unknown 0 0 3194695489) 0x7f9f08001b80 con 0x7f9f180711a0 2024-09-10T16:30:38.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:38.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:38.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 >> v1:172.21.15.81:6789/0 conn(0x7f9f180711a0 legacy=0x7f9f181db2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f0dffb640 1 -- 172.21.15.81:0/3378179811 >> v1:172.21.15.81:6789/0 conn(0x7f9f180711a0 legacy=0x7f9f181db2d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:38.893 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:38.893 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 12, 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 48819, 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:38.894 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:38.895 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.896 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:38.897 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:38.898 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:38.899 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:38.900 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:38.901 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:38.902 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:38.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:38.905 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:38.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:38.907 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:38.908 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:38.909 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:38.910 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:38.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:30:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:38.912 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:38.913 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/3378179811 >> v1:172.21.15.189:6812/1108603242 conn(0x7f9efc03d690 legacy=0x7f9efc03fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f1f8b6640 10 monclient: shutdown 2024-09-10T16:30:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f1f8b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/3378179811 >> v1:172.21.15.81:6792/0 conn(0x7f9f180a3a40 legacy=0x7f9f181d5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f1de53640 1 -- 172.21.15.81:0/3378179811 reap_dead start 2024-09-10T16:30:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f1de53640 1 -- 172.21.15.81:0/3378179811 reap_dead start 2024-09-10T16:30:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/3378179811 shutdown_connections 2024-09-10T16:30:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/3378179811 >> 172.21.15.81:0/3378179811 conn(0x7f9f180a3fd0 msgr2=0x7f9f1809a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/3378179811 shutdown_connections 2024-09-10T16:30:38.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:38.870+0000 7f9f1f8b6640 1 -- 172.21.15.81:0/3378179811 wait complete. 2024-09-10T16:30:38.915 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-10T16:30:38.915 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon b 2024-09-10T16:30:38.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T16:30:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient: get_monmap_and_config 2024-09-10T16:30:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient: build_initial_monmap 2024-09-10T16:30:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient: monmap: 2024-09-10T16:30:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:39.034188+0000 2024-09-10T16:30:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:39.034188+0000 2024-09-10T16:30:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:39.033 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.033 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:39.033 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:39.033 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:39.033 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:39.033 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:39.033 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:39.033 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:39.033 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:39.033 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:39.033 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 1 Processor -- start 2024-09-10T16:30:39.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 1 -- start start 2024-09-10T16:30:39.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient: init 2024-09-10T16:30:39.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:39.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient: _add_conns ranks=[0,2,5,8,7,3,6,1,4] 2024-09-10T16:30:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient(hunting): picked mon.noname-a con 0x7f0e00068960 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient(hunting): picked mon.noname-b con 0x7f0e000a26e0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient(hunting): picked mon.noname-h con 0x7f0e0013f6a0 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e000a0610 con 0x7f0e00068960 2024-09-10T16:30:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e000a3d00 con 0x7f0e000a26e0 2024-09-10T16:30:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e000696f0 con 0x7f0e0013f6a0 2024-09-10T16:30:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient(hunting): authenticate will time out at 1006.433576s 2024-09-10T16:30:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0506d640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f0e000a26e0 0x7f0e000a35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:58736/0 (socket says 172.21.15.81:58736) 2024-09-10T16:30:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0506d640 1 -- 172.21.15.81:0/4130402248 learned_addr learned my addr 172.21.15.81:0/4130402248 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 1 -- 172.21.15.81:0/4130402248 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1171410901 0 0) 0x7f0e000a3d00 con 0x7f0e000a26e0 2024-09-10T16:30:39.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient(hunting): my global_id is 4601 2024-09-10T16:30:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 1 -- 172.21.15.81:0/4130402248 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0de8003530 con 0x7f0e000a26e0 2024-09-10T16:30:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 1 -- 172.21.15.81:0/4130402248 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 195473186 0 0) 0x7f0e000a0610 con 0x7f0e00068960 2024-09-10T16:30:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient(hunting): my global_id is 4635 2024-09-10T16:30:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 1 -- 172.21.15.81:0/4130402248 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e000a3d00 con 0x7f0e00068960 2024-09-10T16:30:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 1 -- 172.21.15.81:0/4130402248 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1460579234 0 0) 0x7f0e000a3d00 con 0x7f0e00068960 2024-09-10T16:30:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 1 -- 172.21.15.81:0/4130402248 >> v1:172.21.15.189:6791/0 conn(0x7f0e0013f6a0 legacy=0x7f0e00141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 1 -- 172.21.15.81:0/4130402248 >> v1:172.21.15.81:6790/0 conn(0x7f0e000a26e0 legacy=0x7f0e000a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient: _finish_hunting 0 2024-09-10T16:30:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 1 monclient: found mon.noname-a 2024-09-10T16:30:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:30:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 1 -- 172.21.15.81:0/4130402248 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e000a3fd0 con 0x7f0e00068960 2024-09-10T16:30:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient: _finish_auth 0 2024-09-10T16:30:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient: _check_auth_tickets 2024-09-10T16:30:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 1 -- 172.21.15.81:0/4130402248 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0df8001ba0 con 0x7f0e00068960 2024-09-10T16:30:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient: dump: 2024-09-10T16:30:39.043 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.044 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.045 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 5 monclient: authenticate success, global_id 4635 2024-09-10T16:30:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 1 -- 172.21.15.81:0/4130402248 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0df8001d40 con 0x7f0e00068960 2024-09-10T16:30:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 4 set_mon_vals no callback set 2024-09-10T16:30:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 1 -- 172.21.15.81:0/4130402248 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0df8003ce0 con 0x7f0e00068960 2024-09-10T16:30:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e0486c640 10 monclient: dump: 2024-09-10T16:30:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.045 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.046 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.047 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient: shutdown 2024-09-10T16:30:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 1 -- 172.21.15.81:0/4130402248 >> v1:172.21.15.81:6789/0 conn(0x7f0e00068960 legacy=0x7f0e000a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 1 -- 172.21.15.81:0/4130402248 shutdown_connections 2024-09-10T16:30:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 1 -- 172.21.15.81:0/4130402248 >> 172.21.15.81:0/4130402248 conn(0x7f0e000a86b0 msgr2=0x7f0e000a8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 1 -- 172.21.15.81:0/4130402248 shutdown_connections 2024-09-10T16:30:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 1 -- 172.21.15.81:0/4130402248 wait complete. 2024-09-10T16:30:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient: build_initial_monmap 2024-09-10T16:30:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.030+0000 7f0e07ad2640 10 monclient: monmap: 2024-09-10T16:30:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:39.047 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:39.048 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 1 Processor -- start 2024-09-10T16:30:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 1 -- start start 2024-09-10T16:30:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 10 monclient: init 2024-09-10T16:30:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 10 monclient: _add_conns ranks=[6,1,4,8,3,5,0,7,2] 2024-09-10T16:30:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 10 monclient(hunting): picked mon.noname-d con 0x7f0e00068960 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 10 monclient(hunting): picked mon.noname-f con 0x7f0e000a26e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 10 monclient(hunting): picked mon.noname-c con 0x7f0e0013f6a0 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e0013b980 con 0x7f0e000a26e0 2024-09-10T16:30:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e00073e70 con 0x7f0e0013f6a0 2024-09-10T16:30:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e00071ee0 con 0x7f0e00068960 2024-09-10T16:30:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 10 monclient(hunting): authenticate will time out at 1006.436787s 2024-09-10T16:30:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e0586e640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f0e00068960 0x7f0e000710c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:37442/0 (socket says 172.21.15.81:37442) 2024-09-10T16:30:39.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e0586e640 1 -- 172.21.15.81:0/3315065476 learned_addr learned my addr 172.21.15.81:0/3315065476 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 478482179 0 0) 0x7f0e00071ee0 con 0x7f0e00068960 2024-09-10T16:30:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): my global_id is 4533 2024-09-10T16:30:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dec003530 con 0x7f0e00068960 2024-09-10T16:30:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2840909341 0 0) 0x7f0e00073e70 con 0x7f0e0013f6a0 2024-09-10T16:30:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): my global_id is 4549 2024-09-10T16:30:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e00071ee0 con 0x7f0e0013f6a0 2024-09-10T16:30:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1437241376 0 0) 0x7f0dec003530 con 0x7f0e00068960 2024-09-10T16:30:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e00073e70 con 0x7f0e00068960 2024-09-10T16:30:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0df8001a60 con 0x7f0e00068960 2024-09-10T16:30:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): dump: 2024-09-10T16:30:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.052 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.052 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.052 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.052 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.052 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.052 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.052 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.052 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:39.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 547551510 0 0) 0x7f0e00071ee0 con 0x7f0e0013f6a0 2024-09-10T16:30:39.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0dec003530 con 0x7f0e0013f6a0 2024-09-10T16:30:39.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0df0001940 con 0x7f0e0013f6a0 2024-09-10T16:30:39.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:39.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): dump: 2024-09-10T16:30:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.054 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135708505 0 0) 0x7f0df4000f70 con 0x7f0e000a26e0 2024-09-10T16:30:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): my global_id is 4600 2024-09-10T16:30:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e00071ee0 con 0x7f0e000a26e0 2024-09-10T16:30:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 904852050 0 0) 0x7f0e00073e70 con 0x7f0e00068960 2024-09-10T16:30:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 >> v1:172.21.15.81:6791/0 conn(0x7f0e0013f6a0 legacy=0x7f0e001d5d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 >> v1:172.21.15.189:6789/0 conn(0x7f0e000a26e0 legacy=0x7f0e000717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:30:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 monclient: found mon.d 2024-09-10T16:30:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e000a6bf0 con 0x7f0e00068960 2024-09-10T16:30:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient: _finish_auth 0 2024-09-10T16:30:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:30:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 5 monclient: authenticate success, global_id 4533 2024-09-10T16:30:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 10 monclient: _renew_subs 2024-09-10T16:30:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0e000a66c0 con 0x7f0e00068960 2024-09-10T16:30:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 10 monclient: _renew_subs 2024-09-10T16:30:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f0e0009e950 con 0x7f0e00068960 2024-09-10T16:30:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0df8001c80 con 0x7f0e00068960 2024-09-10T16:30:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0df8004590 con 0x7f0e00068960 2024-09-10T16:30:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfffff640 4 set_mon_vals no callback set 2024-09-10T16:30:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient: dump: 2024-09-10T16:30:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e07ad2640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0de00065d0 con 0x7f0de0002870 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f0df8004730 con 0x7f0e00068960 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (unknown 2089754905 0 0) 0x7f0df804b0c0 con 0x7f0e00068960 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 942039850 0 0) 0x7f0de00065d0 con 0x7f0de0002870 2024-09-10T16:30:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient(hunting): my global_id is 4610 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e00073e70 con 0x7f0de0002870 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 189814679 0 0) 0x7f0e00073e70 con 0x7f0de0002870 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0de00065d0 con 0x7f0de0002870 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0df4001580 con 0x7f0de0002870 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient: dump: 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.059 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0e0606f640 10 monclient: get_auth_request con 0x7f0dec03d700 auth_method 0 2024-09-10T16:30:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1223260355 0 0) 0x7f0de00065d0 con 0x7f0de0002870 2024-09-10T16:30:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0de000a170 con 0x7f0de0002870 2024-09-10T16:30:39.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0df40047f0 con 0x7f0de0002870 2024-09-10T16:30:39.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:39.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:39.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 >> v1:172.21.15.81:6790/0 conn(0x7f0de0002870 legacy=0x7f0de0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.034+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 >> v1:172.21.15.81:6790/0 conn(0x7f0de0002870 legacy=0x7f0de0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:39.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0e07ad2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:39.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0e07ad2640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0de0009e80 con 0x7f0de0009140 2024-09-10T16:30:39.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2537079354 0 0) 0x7f0de0009e80 con 0x7f0de0009140 2024-09-10T16:30:39.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 10 monclient(hunting): my global_id is 4619 2024-09-10T16:30:39.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0de00065d0 con 0x7f0de0009140 2024-09-10T16:30:39.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3863256470 0 0) 0x7f0de00065d0 con 0x7f0de0009140 2024-09-10T16:30:39.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0de0009e80 con 0x7f0de0009140 2024-09-10T16:30:39.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0df4004ed0 con 0x7f0de0009140 2024-09-10T16:30:39.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:39.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 10 monclient: dump: 2024-09-10T16:30:39.062 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.062 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.062 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.062 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.062 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.063 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.063 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.063 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.063 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.063 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.063 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.063 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.063 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.063 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.063 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.063 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2123024060 0 0) 0x7f0de0009e80 con 0x7f0de0009140 2024-09-10T16:30:39.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 --> v1:172.21.15.81:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0de000c420 con 0x7f0de0009140 2024-09-10T16:30:39.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7866 (unknown 0 0 1379498172) 0x7f0df40070b0 con 0x7f0de0009140 2024-09-10T16:30:39.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:39.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:39.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 >> v1:172.21.15.81:6790/0 conn(0x7f0de0009140 legacy=0x7f0de00095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0dfe7fc640 1 -- 172.21.15.81:0/3315065476 >> v1:172.21.15.81:6790/0 conn(0x7f0de0009140 legacy=0x7f0de00095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:39.064 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 12, 2024-09-10T16:30:39.064 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 49011, 2024-09-10T16:30:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-09-10T16:30:39.065 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.068 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.069 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:39.070 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:39.071 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:39.072 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:39.072 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.072 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.072 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.072 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.072 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.072 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.072 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.072 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.072 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.072 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.072 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.073 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.073 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:39.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.073 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:39.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.073 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:39.073 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:39.073 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.073 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.074 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.074 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:39.074 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.074 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.074 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:39.074 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:39.074 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.074 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.074 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.075 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:39.075 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:39.075 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.075 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.075 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:39.075 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.075 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.076 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:39.076 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:39.076 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.076 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.076 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.076 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:39.076 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:39.076 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.076 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.077 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:39.077 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.077 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.077 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:39.077 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:39.077 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.077 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.077 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.077 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:39.078 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:39.078 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.078 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.078 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:39.078 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.078 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.078 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:39.078 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:39.079 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.079 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.079 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.079 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:39.079 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:39.079 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.079 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.079 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:39.079 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.080 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.080 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:39.080 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:39.080 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.080 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.080 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.080 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:39.080 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:39.081 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.081 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.081 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.081 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:39.081 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.081 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.081 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:39.081 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:39.081 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.081 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.082 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.082 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:39.082 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:39.082 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.082 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.082 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:39.082 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.082 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.083 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:39.083 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:39.083 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.083 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.083 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.083 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:39.083 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:39.083 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.083 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.083 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.084 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:39.084 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.084 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.084 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:39.084 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:39.084 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.084 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.084 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.084 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:39.085 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:39.085 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.085 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.085 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.085 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:39.085 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.085 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.085 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.085 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:39.085 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:39.085 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.086 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.086 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.086 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.086 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:39.086 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:39.086 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.086 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:39.086 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:39.086 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:39.086 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.086 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.087 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:30:39.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.087 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:39.087 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:39.087 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:39.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.087 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.087 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:39.087 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.087 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:39.087 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:39.087 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:39.087 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.087 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.088 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-09-10T16:30:39.088 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.088 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:39.088 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:39.088 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:39.088 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.088 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.088 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.088 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:39.088 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:39.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0e07ad2640 1 -- 172.21.15.81:0/3315065476 >> v1:172.21.15.189:6812/1108603242 conn(0x7f0dec03d700 legacy=0x7f0dec03fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0e07ad2640 10 monclient: shutdown 2024-09-10T16:30:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0e07ad2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0e07ad2640 1 -- 172.21.15.81:0/3315065476 >> v1:172.21.15.81:6792/0 conn(0x7f0e00068960 legacy=0x7f0e000710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0e0606f640 1 -- 172.21.15.81:0/3315065476 reap_dead start 2024-09-10T16:30:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0e0606f640 1 -- 172.21.15.81:0/3315065476 reap_dead start 2024-09-10T16:30:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0e07ad2640 1 -- 172.21.15.81:0/3315065476 shutdown_connections 2024-09-10T16:30:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0e07ad2640 1 -- 172.21.15.81:0/3315065476 >> 172.21.15.81:0/3315065476 conn(0x7f0e000a86b0 msgr2=0x7f0e0013a990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0e07ad2640 1 -- 172.21.15.81:0/3315065476 shutdown_connections 2024-09-10T16:30:39.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.042+0000 7f0e07ad2640 1 -- 172.21.15.81:0/3315065476 wait complete. 2024-09-10T16:30:39.091 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-10T16:30:39.091 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon c 2024-09-10T16:30:39.091 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T16:30:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 10 monclient: get_monmap_and_config 2024-09-10T16:30:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 10 monclient: build_initial_monmap 2024-09-10T16:30:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 10 monclient: monmap: 2024-09-10T16:30:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:39.214590+0000 2024-09-10T16:30:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:39.214590+0000 2024-09-10T16:30:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:39.213 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:39.214 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:39.214 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 1 Processor -- start 2024-09-10T16:30:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 1 -- start start 2024-09-10T16:30:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 10 monclient: init 2024-09-10T16:30:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 10 monclient: _add_conns ranks=[4,8,1,6,7,3,5,0,2] 2024-09-10T16:30:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 10 monclient(hunting): picked mon.noname-c con 0x7f9abc0a0a90 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:39.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 10 monclient(hunting): picked mon.noname-e con 0x7f9abc0a35f0 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 10 monclient(hunting): picked mon.noname-f con 0x7f9abc0a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9abc09df70 con 0x7f9abc0a3a40 2024-09-10T16:30:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9abc09fa30 con 0x7f9abc0a0a90 2024-09-10T16:30:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9abc09fd10 con 0x7f9abc0a35f0 2024-09-10T16:30:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 10 monclient(hunting): authenticate will time out at 1006.614089s 2024-09-10T16:30:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac19d1640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f9abc0a35f0 0x7f9abc13c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:47360/0 (socket says 172.21.15.81:47360) 2024-09-10T16:30:39.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac19d1640 1 -- 172.21.15.81:0/2004371100 learned_addr learned my addr 172.21.15.81:0/2004371100 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac21d2640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f9abc0a0a90 0x7f9abc0a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:43954/0 (socket says 172.21.15.81:43954) 2024-09-10T16:30:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 1 -- 172.21.15.81:0/2004371100 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 736653574 0 0) 0x7f9abc09fa30 con 0x7f9abc0a0a90 2024-09-10T16:30:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient(hunting): my global_id is 4558 2024-09-10T16:30:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 1 -- 172.21.15.81:0/2004371100 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9aa8003530 con 0x7f9abc0a0a90 2024-09-10T16:30:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 1 -- 172.21.15.81:0/2004371100 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1833395209 0 0) 0x7f9abc09fd10 con 0x7f9abc0a35f0 2024-09-10T16:30:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient(hunting): my global_id is 4499 2024-09-10T16:30:39.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 1 -- 172.21.15.81:0/2004371100 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9abc09fa30 con 0x7f9abc0a35f0 2024-09-10T16:30:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 1 -- 172.21.15.81:0/2004371100 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4086574975 0 0) 0x7f9aa8003530 con 0x7f9abc0a0a90 2024-09-10T16:30:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 1 -- 172.21.15.81:0/2004371100 >> v1:172.21.15.81:6793/0 conn(0x7f9abc0a35f0 legacy=0x7f9abc13c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 1 -- 172.21.15.81:0/2004371100 >> v1:172.21.15.189:6789/0 conn(0x7f9abc0a3a40 legacy=0x7f9abc13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient: _finish_hunting 0 2024-09-10T16:30:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 1 monclient: found mon.noname-c 2024-09-10T16:30:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:30:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 1 -- 172.21.15.81:0/2004371100 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc09fff0 con 0x7f9abc0a0a90 2024-09-10T16:30:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient: _finish_auth 0 2024-09-10T16:30:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient: _check_auth_tickets 2024-09-10T16:30:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:39.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 1 -- 172.21.15.81:0/2004371100 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9aac001770 con 0x7f9abc0a0a90 2024-09-10T16:30:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 5 monclient: authenticate success, global_id 4558 2024-09-10T16:30:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient: dump: 2024-09-10T16:30:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.226 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.227 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:39.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 1 -- 172.21.15.81:0/2004371100 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9aac001990 con 0x7f9abc0a0a90 2024-09-10T16:30:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 4 set_mon_vals no callback set 2024-09-10T16:30:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 1 -- 172.21.15.81:0/2004371100 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9aac004b30 con 0x7f9abc0a0a90 2024-09-10T16:30:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac11d0640 10 monclient: dump: 2024-09-10T16:30:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.228 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.229 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 10 monclient: shutdown 2024-09-10T16:30:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 1 -- 172.21.15.81:0/2004371100 >> v1:172.21.15.81:6791/0 conn(0x7f9abc0a0a90 legacy=0x7f9abc0a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 1 -- 172.21.15.81:0/2004371100 shutdown_connections 2024-09-10T16:30:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 1 -- 172.21.15.81:0/2004371100 >> 172.21.15.81:0/2004371100 conn(0x7f9abc0a3fd0 msgr2=0x7f9abc0a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 1 -- 172.21.15.81:0/2004371100 shutdown_connections 2024-09-10T16:30:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.210+0000 7f9ac4436640 1 -- 172.21.15.81:0/2004371100 wait complete. 2024-09-10T16:30:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 monclient: build_initial_monmap 2024-09-10T16:30:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 monclient: monmap: 2024-09-10T16:30:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:39.230 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:39.231 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 1 Processor -- start 2024-09-10T16:30:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 1 -- start start 2024-09-10T16:30:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 monclient: init 2024-09-10T16:30:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:39.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 monclient: _add_conns ranks=[6,4,3,5,2,8,7,1,0] 2024-09-10T16:30:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 monclient(hunting): picked mon.noname-d con 0x7f9abc0a0a90 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 monclient(hunting): picked mon.noname-c con 0x7f9abc0a35f0 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 monclient(hunting): picked mon.noname-g con 0x7f9abc0a3a40 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9abc09aef0 con 0x7f9abc0a3a40 2024-09-10T16:30:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9abc097820 con 0x7f9abc0a35f0 2024-09-10T16:30:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9abc098d10 con 0x7f9abc0a0a90 2024-09-10T16:30:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 monclient(hunting): authenticate will time out at 1006.617374s 2024-09-10T16:30:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac29d3640 1 -- >> v1:172.21.15.189:6790/0 conn(0x7f9abc0a3a40 legacy=0x7f9abc1d65e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:30:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac21d2640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f9abc0a0a90 0x7f9abc09a7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:37446/0 (socket says 172.21.15.81:37446) 2024-09-10T16:30:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac19d1640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f9abc0a35f0 0x7f9abc1d2eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:43956/0 (socket says 172.21.15.81:43956) 2024-09-10T16:30:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac19d1640 1 -- 172.21.15.81:0/2797532372 learned_addr learned my addr 172.21.15.81:0/2797532372 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:39.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 125536705 0 0) 0x7f9abc098d10 con 0x7f9abc0a0a90 2024-09-10T16:30:39.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): my global_id is 4542 2024-09-10T16:30:39.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9aa0003530 con 0x7f9abc0a0a90 2024-09-10T16:30:39.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4116101124 0 0) 0x7f9abc097820 con 0x7f9abc0a35f0 2024-09-10T16:30:39.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): my global_id is 4567 2024-09-10T16:30:39.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9abc098d10 con 0x7f9abc0a35f0 2024-09-10T16:30:39.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2179639748 0 0) 0x7f9aa0003530 con 0x7f9abc0a0a90 2024-09-10T16:30:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9abc097820 con 0x7f9abc0a0a90 2024-09-10T16:30:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9aac0013f0 con 0x7f9abc0a0a90 2024-09-10T16:30:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.234 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.235 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:39.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2350002281 0 0) 0x7f9abc098d10 con 0x7f9abc0a35f0 2024-09-10T16:30:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9aa0003530 con 0x7f9abc0a35f0 2024-09-10T16:30:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9ab8001ae0 con 0x7f9abc0a35f0 2024-09-10T16:30:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.236 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.237 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1014596153 0 0) 0x7f9abc097820 con 0x7f9abc0a0a90 2024-09-10T16:30:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 >> v1:172.21.15.81:6791/0 conn(0x7f9abc0a35f0 legacy=0x7f9abc1d2eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 >> v1:172.21.15.189:6790/0 conn(0x7f9abc0a3a40 legacy=0x7f9abc1d65e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:30:39.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:39.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 monclient: found mon.d 2024-09-10T16:30:39.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:39.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:39.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9abc098a30 con 0x7f9abc0a0a90 2024-09-10T16:30:39.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:39.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:39.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:39.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 5 monclient: authenticate success, global_id 4542 2024-09-10T16:30:39.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 monclient: _renew_subs 2024-09-10T16:30:39.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:39.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9abc1cb450 con 0x7f9abc0a0a90 2024-09-10T16:30:39.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 monclient: _renew_subs 2024-09-10T16:30:39.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:30:39.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f9abc09d040 con 0x7f9abc0a0a90 2024-09-10T16:30:39.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9aac0010b0 con 0x7f9abc0a0a90 2024-09-10T16:30:39.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:39.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac09cf640 4 set_mon_vals no callback set 2024-09-10T16:30:39.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9aac0018c0 con 0x7f9abc0a0a90 2024-09-10T16:30:39.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:39.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient: dump: 2024-09-10T16:30:39.239 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.241 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac4436640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9aa40065d0 con 0x7f9aa4002870 2024-09-10T16:30:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f9aac010ea0 con 0x7f9abc0a0a90 2024-09-10T16:30:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (unknown 2089754905 0 0) 0x7f9aac04ae20 con 0x7f9abc0a0a90 2024-09-10T16:30:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4036300148 0 0) 0x7f9aa40065d0 con 0x7f9aa4002870 2024-09-10T16:30:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 10 monclient(hunting): my global_id is 4576 2024-09-10T16:30:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9abc097820 con 0x7f9aa4002870 2024-09-10T16:30:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ac29d3640 10 monclient: get_auth_request con 0x7f9aa003d450 auth_method 0 2024-09-10T16:30:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.214+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3859614049 0 0) 0x7f9abc097820 con 0x7f9aa4002870 2024-09-10T16:30:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.218+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9aa40065d0 con 0x7f9aa4002870 2024-09-10T16:30:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.218+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9ab8004b30 con 0x7f9aa4002870 2024-09-10T16:30:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.218+0000 7f9ab2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.218+0000 7f9ab2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.218+0000 7f9ab2ffd640 10 monclient: dump: 2024-09-10T16:30:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.242 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.243 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.244 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.218+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 611769395 0 0) 0x7f9aa40065d0 con 0x7f9aa4002870 2024-09-10T16:30:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.218+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9aa400a170 con 0x7f9aa4002870 2024-09-10T16:30:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.218+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9ab80058e0 con 0x7f9aa4002870 2024-09-10T16:30:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.218+0000 7f9ab2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.218+0000 7f9ab2ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.218+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 >> v1:172.21.15.81:6791/0 conn(0x7f9aa4002870 legacy=0x7f9aa4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.218+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 >> v1:172.21.15.81:6791/0 conn(0x7f9aa4002870 legacy=0x7f9aa4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:39.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ac4436640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:39.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ac4436640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9aa4009e30 con 0x7f9aa40090f0 2024-09-10T16:30:39.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3923627103 0 0) 0x7f9aa4009e30 con 0x7f9aa40090f0 2024-09-10T16:30:39.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 10 monclient(hunting): my global_id is 4585 2024-09-10T16:30:39.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9aa40065d0 con 0x7f9aa40090f0 2024-09-10T16:30:39.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 25300310 0 0) 0x7f9aa40065d0 con 0x7f9aa40090f0 2024-09-10T16:30:39.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9aa4009e30 con 0x7f9aa40090f0 2024-09-10T16:30:39.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9ab80053d0 con 0x7f9aa40090f0 2024-09-10T16:30:39.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:39.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 10 monclient: dump: 2024-09-10T16:30:39.247 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.247 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.247 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.247 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.247 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.247 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.247 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.247 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.247 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.248 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.248 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.248 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.248 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.248 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.248 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.248 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3310908400 0 0) 0x7f9aa4009e30 con 0x7f9aa40090f0 2024-09-10T16:30:39.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 --> v1:172.21.15.81:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9aa400c400 con 0x7f9aa40090f0 2024-09-10T16:30:39.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7699 (unknown 0 0 1188268174) 0x7f9ab80056b0 con 0x7f9aa40090f0 2024-09-10T16:30:39.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:39.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:39.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 >> v1:172.21.15.81:6791/0 conn(0x7f9aa40090f0 legacy=0x7f9aa4009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.222+0000 7f9ab2ffd640 1 -- 172.21.15.81:0/2797532372 >> v1:172.21.15.81:6791/0 conn(0x7f9aa40090f0 legacy=0x7f9aa4009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:39.249 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 12, 2024-09-10T16:30:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 49179, 2024-09-10T16:30:39.249 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-09-10T16:30:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:39.250 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.251 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.252 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:39.253 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.254 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.255 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.256 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.258 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:39.259 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:39.260 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:39.261 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:39.262 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.263 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.264 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.265 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.266 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.267 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.268 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.269 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:39.272 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:30:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:39.273 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:30:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.274 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:39.275 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.226+0000 7f9ac4436640 1 -- 172.21.15.81:0/2797532372 >> v1:172.21.15.189:6812/1108603242 conn(0x7f9aa003d450 legacy=0x7f9aa003f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.226+0000 7f9ac4436640 10 monclient: shutdown 2024-09-10T16:30:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.226+0000 7f9ac4436640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.226+0000 7f9ac4436640 1 -- 172.21.15.81:0/2797532372 >> v1:172.21.15.81:6792/0 conn(0x7f9abc0a0a90 legacy=0x7f9abc09a7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.226+0000 7f9ac29d3640 1 -- 172.21.15.81:0/2797532372 reap_dead start 2024-09-10T16:30:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.226+0000 7f9ac29d3640 1 -- 172.21.15.81:0/2797532372 reap_dead start 2024-09-10T16:30:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.226+0000 7f9ac4436640 1 -- 172.21.15.81:0/2797532372 shutdown_connections 2024-09-10T16:30:39.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.226+0000 7f9ac4436640 1 -- 172.21.15.81:0/2797532372 >> 172.21.15.81:0/2797532372 conn(0x7f9abc0a3fd0 msgr2=0x7f9abc074230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:39.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.226+0000 7f9ac4436640 1 -- 172.21.15.81:0/2797532372 shutdown_connections 2024-09-10T16:30:39.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.226+0000 7f9ac4436640 1 -- 172.21.15.81:0/2797532372 wait complete. 2024-09-10T16:30:39.277 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-10T16:30:39.277 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon d 2024-09-10T16:30:39.277 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-10T16:30:39.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 10 monclient: get_monmap_and_config 2024-09-10T16:30:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 10 monclient: build_initial_monmap 2024-09-10T16:30:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 10 monclient: monmap: 2024-09-10T16:30:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:39.394958+0000 2024-09-10T16:30:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:39.394958+0000 2024-09-10T16:30:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:39.393 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:39.394 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:39.394 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:39.394 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:39.394 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:39.394 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:39.394 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:39.394 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 1 Processor -- start 2024-09-10T16:30:39.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 1 -- start start 2024-09-10T16:30:39.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 10 monclient: init 2024-09-10T16:30:39.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:39.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 10 monclient: _add_conns ranks=[0,3,2,4,5,6,7,1,8] 2024-09-10T16:30:39.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 10 monclient(hunting): picked mon.noname-a con 0x7fcbec068960 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:39.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 10 monclient(hunting): picked mon.noname-g con 0x7fcbec0a0950 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:39.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 10 monclient(hunting): picked mon.noname-b con 0x7fcbec13f5c0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:39.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbec0a4200 con 0x7fcbec068960 2024-09-10T16:30:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbec0a3c20 con 0x7fcbec13f5c0 2024-09-10T16:30:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbec0a0ee0 con 0x7fcbec0a0950 2024-09-10T16:30:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 10 monclient(hunting): authenticate will time out at 1006.794586s 2024-09-10T16:30:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbea59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcbec068960 0x7fcbec0a2e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33376/0 (socket says 172.21.15.81:33376) 2024-09-10T16:30:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbea59c640 1 -- 172.21.15.81:0/1691186543 learned_addr learned my addr 172.21.15.81:0/1691186543 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe9d9b640 1 -- 172.21.15.81:0/1691186543 >> v1:172.21.15.189:6790/0 conn(0x7fcbec0a0950 legacy=0x7fcbec0a3510 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:30:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 1 -- 172.21.15.81:0/1691186543 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4035067413 0 0) 0x7fcbec0a4200 con 0x7fcbec068960 2024-09-10T16:30:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient(hunting): my global_id is 4644 2024-09-10T16:30:39.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 1 -- 172.21.15.81:0/1691186543 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbd4003530 con 0x7fcbec068960 2024-09-10T16:30:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 1 -- 172.21.15.81:0/1691186543 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3671674899 0 0) 0x7fcbec0a3c20 con 0x7fcbec13f5c0 2024-09-10T16:30:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient(hunting): my global_id is 4628 2024-09-10T16:30:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 1 -- 172.21.15.81:0/1691186543 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbec0a4200 con 0x7fcbec13f5c0 2024-09-10T16:30:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 1 -- 172.21.15.81:0/1691186543 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2985649600 0 0) 0x7fcbec0a4200 con 0x7fcbec13f5c0 2024-09-10T16:30:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 1 -- 172.21.15.81:0/1691186543 >> v1:172.21.15.189:6790/0 conn(0x7fcbec0a0950 legacy=0x7fcbec0a3510 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:30:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 1 -- 172.21.15.81:0/1691186543 >> v1:172.21.15.81:6789/0 conn(0x7fcbec068960 legacy=0x7fcbec0a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient: _finish_hunting 0 2024-09-10T16:30:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 1 monclient: found mon.noname-b 2024-09-10T16:30:39.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:30:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 1 -- 172.21.15.81:0/1691186543 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec0a4630 con 0x7fcbec13f5c0 2024-09-10T16:30:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient: _finish_auth 0 2024-09-10T16:30:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient: _check_auth_tickets 2024-09-10T16:30:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 1 -- 172.21.15.81:0/1691186543 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcbe4001b20 con 0x7fcbec13f5c0 2024-09-10T16:30:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 5 monclient: authenticate success, global_id 4628 2024-09-10T16:30:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient: dump: 2024-09-10T16:30:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.405 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.406 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.406 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.406 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.406 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.406 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.406 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.406 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.406 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.406 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.406 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.406 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.406 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.406 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.407 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 1 -- 172.21.15.81:0/1691186543 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcbe4001cc0 con 0x7fcbec13f5c0 2024-09-10T16:30:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 1 -- 172.21.15.81:0/1691186543 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcbe4003ce0 con 0x7fcbec13f5c0 2024-09-10T16:30:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbf0f6e640 4 set_mon_vals no callback set 2024-09-10T16:30:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.390+0000 7fcbe959a640 10 monclient: dump: 2024-09-10T16:30:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.407 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.408 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.409 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient: shutdown 2024-09-10T16:30:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/1691186543 >> v1:172.21.15.81:6790/0 conn(0x7fcbec13f5c0 legacy=0x7fcbec1419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/1691186543 shutdown_connections 2024-09-10T16:30:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/1691186543 >> 172.21.15.81:0/1691186543 conn(0x7fcbec0a85d0 msgr2=0x7fcbec0a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/1691186543 shutdown_connections 2024-09-10T16:30:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/1691186543 wait complete. 2024-09-10T16:30:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient: build_initial_monmap 2024-09-10T16:30:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient: monmap: 2024-09-10T16:30:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:39.409 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:39.410 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:39.411 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 1 Processor -- start 2024-09-10T16:30:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 1 -- start start 2024-09-10T16:30:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient: init 2024-09-10T16:30:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient: _add_conns ranks=[0,7,2,3,6,8,1,5,4] 2024-09-10T16:30:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient(hunting): picked mon.noname-a con 0x7fcbec068960 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient(hunting): picked mon.noname-i con 0x7fcbec0a0950 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient(hunting): picked mon.noname-b con 0x7fcbec13f5c0 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbec13f3d0 con 0x7fcbec068960 2024-09-10T16:30:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbec1429d0 con 0x7fcbec13f5c0 2024-09-10T16:30:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbec074ed0 con 0x7fcbec0a0950 2024-09-10T16:30:39.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient(hunting): authenticate will time out at 1006.797847s 2024-09-10T16:30:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbea59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fcbec068960 0x7fcbec13ecc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33382/0 (socket says 172.21.15.81:33382) 2024-09-10T16:30:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbead9d640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fcbec13f5c0 0x7fcbec1d5980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:58764/0 (socket says 172.21.15.81:58764) 2024-09-10T16:30:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbea59c640 1 -- 172.21.15.81:0/867069874 learned_addr learned my addr 172.21.15.81:0/867069874 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786481857 0 0) 0x7fcbec13f3d0 con 0x7fcbec068960 2024-09-10T16:30:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): my global_id is 4653 2024-09-10T16:30:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbcc003530 con 0x7fcbec068960 2024-09-10T16:30:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 604579452 0 0) 0x7fcbec1429d0 con 0x7fcbec13f5c0 2024-09-10T16:30:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): my global_id is 4637 2024-09-10T16:30:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbec13f3d0 con 0x7fcbec13f5c0 2024-09-10T16:30:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3812720095 0 0) 0x7fcbec13f3d0 con 0x7fcbec13f5c0 2024-09-10T16:30:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcbec1429d0 con 0x7fcbec13f5c0 2024-09-10T16:30:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcbe4001a60 con 0x7fcbec13f5c0 2024-09-10T16:30:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): dump: 2024-09-10T16:30:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.413 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.414 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.414 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.414 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.414 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.414 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.414 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.414 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.414 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.414 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.414 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.414 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.414 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:39.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3639001863 0 0) 0x7fcbcc003530 con 0x7fcbec068960 2024-09-10T16:30:39.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcbec13f3d0 con 0x7fcbec068960 2024-09-10T16:30:39.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcbdc001b20 con 0x7fcbec068960 2024-09-10T16:30:39.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:39.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:39.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): dump: 2024-09-10T16:30:39.415 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.415 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.415 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.415 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.415 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.415 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.415 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.415 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.416 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.416 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.416 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.416 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.416 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.416 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.416 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.416 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2248234546 0 0) 0x7fcbec074ed0 con 0x7fcbec0a0950 2024-09-10T16:30:39.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient(hunting): my global_id is 4552 2024-09-10T16:30:39.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbcc003530 con 0x7fcbec0a0950 2024-09-10T16:30:39.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4260009981 0 0) 0x7fcbec1429d0 con 0x7fcbec13f5c0 2024-09-10T16:30:39.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 >> v1:172.21.15.189:6792/0 conn(0x7fcbec0a0950 legacy=0x7fcbec1cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 >> v1:172.21.15.81:6789/0 conn(0x7fcbec068960 legacy=0x7fcbec13ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:39.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 monclient: found mon.b 2024-09-10T16:30:39.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:39.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:39.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbec13aed0 con 0x7fcbec13f5c0 2024-09-10T16:30:39.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:39.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:39.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:39.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 5 monclient: authenticate success, global_id 4637 2024-09-10T16:30:39.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient: _renew_subs 2024-09-10T16:30:39.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:39.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcbec13b1b0 con 0x7fcbec13f5c0 2024-09-10T16:30:39.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient: _renew_subs 2024-09-10T16:30:39.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:39.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fcbec1cdec0 con 0x7fcbec13f5c0 2024-09-10T16:30:39.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcbe4003c30 con 0x7fcbec13f5c0 2024-09-10T16:30:39.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:39.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcbe4004320 con 0x7fcbec13f5c0 2024-09-10T16:30:39.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbe8d99640 4 set_mon_vals no callback set 2024-09-10T16:30:39.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:39.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 10 monclient: dump: 2024-09-10T16:30:39.418 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.419 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.420 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:39.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcbd00065d0 con 0x7fcbd0002870 2024-09-10T16:30:39.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.394+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fcbe40044c0 con 0x7fcbec13f5c0 2024-09-10T16:30:39.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(24..24 src has 1..24) ==== 3506+0+0 (unknown 2089754905 0 0) 0x7fcbe404ae90 con 0x7fcbec13f5c0 2024-09-10T16:30:39.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 902459589 0 0) 0x7fcbd00065d0 con 0x7fcbd0002870 2024-09-10T16:30:39.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 10 monclient(hunting): my global_id is 4551 2024-09-10T16:30:39.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbec1429d0 con 0x7fcbd0002870 2024-09-10T16:30:39.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 211641519 0 0) 0x7fcbec1429d0 con 0x7fcbd0002870 2024-09-10T16:30:39.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcbd00065d0 con 0x7fcbd0002870 2024-09-10T16:30:39.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcbdc004e60 con 0x7fcbd0002870 2024-09-10T16:30:39.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:39.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 10 monclient: dump: 2024-09-10T16:30:39.421 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.421 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.421 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.421 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.421 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.421 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.421 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.421 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.421 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.422 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.422 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.422 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.422 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.422 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.422 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.422 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbe9d9b640 10 monclient: get_auth_request con 0x7fcbcc03d700 auth_method 0 2024-09-10T16:30:39.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1726408078 0 0) 0x7fcbd00065d0 con 0x7fcbd0002870 2024-09-10T16:30:39.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcbd000a170 con 0x7fcbd0002870 2024-09-10T16:30:39.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fcbdc0064e0 con 0x7fcbd0002870 2024-09-10T16:30:39.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:39.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 >> v1:172.21.15.81:6792/0 conn(0x7fcbd0002870 legacy=0x7fcbd0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.398+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 >> v1:172.21.15.81:6792/0 conn(0x7fcbd0002870 legacy=0x7fcbd0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbf0f6e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcbd0009e60 con 0x7fcbd0009120 2024-09-10T16:30:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1405869241 0 0) 0x7fcbd0009e60 con 0x7fcbd0009120 2024-09-10T16:30:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbdaffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbdaffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbdaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbdaffd640 10 monclient(hunting): my global_id is 4560 2024-09-10T16:30:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbd00065d0 con 0x7fcbd0009120 2024-09-10T16:30:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2232383152 0 0) 0x7fcbd00065d0 con 0x7fcbd0009120 2024-09-10T16:30:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcbd0009e60 con 0x7fcbd0009120 2024-09-10T16:30:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcbdc0052f0 con 0x7fcbd0009120 2024-09-10T16:30:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbdaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbdaffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbdaffd640 10 monclient: dump: 2024-09-10T16:30:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.426 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3836375857 0 0) 0x7fcbd0009e60 con 0x7fcbd0009120 2024-09-10T16:30:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.402+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 --> v1:172.21.15.81:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcbd000c3b0 con 0x7fcbd0009120 2024-09-10T16:30:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7699 (unknown 0 0 731508423) 0x7fcbdc006690 con 0x7fcbd0009120 2024-09-10T16:30:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbdaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbdaffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 >> v1:172.21.15.81:6792/0 conn(0x7fcbd0009120 legacy=0x7fcbd00095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbdaffd640 1 -- 172.21.15.81:0/867069874 >> v1:172.21.15.81:6792/0 conn(0x7fcbd0009120 legacy=0x7fcbd00095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:39.427 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:39.427 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:39.427 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:39.428 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:39.428 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 12, 2024-09-10T16:30:39.428 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 49363, 2024-09-10T16:30:39.428 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:39.428 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:39.428 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:39.428 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:39.428 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:39.428 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:39.428 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:39.428 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:39.428 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:39.428 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.429 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-09-10T16:30:39.429 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:39.429 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:39.429 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:39.429 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.429 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.429 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.429 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.429 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.429 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.429 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.429 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.429 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.430 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.430 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.430 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.430 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:39.430 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:39.430 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.430 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.430 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.430 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.430 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.430 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.430 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.430 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.431 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.431 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.431 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.431 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.431 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:39.431 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:39.431 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:39.431 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:39.431 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:39.431 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:39.431 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:39.431 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:39.432 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:39.432 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:39.432 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:39.432 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:39.432 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:39.432 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:39.432 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:39.432 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:39.432 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:39.432 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.432 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.432 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.433 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.433 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.433 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.433 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.433 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.433 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.433 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.433 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.433 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.433 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:39.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.433 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:39.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.433 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:39.434 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:39.434 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:39.434 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.434 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.434 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:39.434 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:39.434 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.435 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.435 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.435 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:39.435 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:39.435 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.435 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.435 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:39.435 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.436 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.436 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:39.436 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:39.436 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.436 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.436 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.436 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:39.436 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:39.436 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.437 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:39.437 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.437 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.437 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:39.437 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:39.437 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.437 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.437 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.438 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:39.438 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:39.438 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.438 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.438 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:39.438 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.438 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.439 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:39.439 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:39.439 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.439 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.439 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.439 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:39.439 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:39.439 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.439 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.440 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:39.440 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.440 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.440 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.440 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:39.440 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:39.440 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.440 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.440 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.441 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:39.441 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:39.441 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.441 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.441 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:39.441 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.441 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.441 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:39.441 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:39.442 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.442 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.442 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.442 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:39.442 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:39.442 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.442 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.442 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.442 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:39.442 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.443 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.443 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:39.443 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:39.443 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.443 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.443 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.443 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:39.443 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:39.443 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.443 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.444 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.444 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:39.444 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.444 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.444 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.444 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:39.444 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:39.444 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.444 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.444 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.445 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:39.445 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:39.445 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.445 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.445 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.445 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:39.445 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.445 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.445 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:39.446 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:39.446 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.446 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.446 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.446 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.446 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:39.446 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:39.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.446 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:39.446 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:39.446 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:39.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.447 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.447 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:30:39.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.447 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:39.447 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:39.447 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:39.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.447 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.447 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:39.447 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.447 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:39.447 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:39.448 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:30:39.448 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.448 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.448 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:39.448 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:39.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/867069874 >> v1:172.21.15.189:6812/1108603242 conn(0x7fcbcc03d700 legacy=0x7fcbcc03fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbf0f6e640 10 monclient: shutdown 2024-09-10T16:30:39.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbf0f6e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:39.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/867069874 >> v1:172.21.15.81:6790/0 conn(0x7fcbec13f5c0 legacy=0x7fcbec1d5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbead9d640 1 -- 172.21.15.81:0/867069874 reap_dead start 2024-09-10T16:30:39.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbead9d640 1 -- 172.21.15.81:0/867069874 reap_dead start 2024-09-10T16:30:39.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/867069874 shutdown_connections 2024-09-10T16:30:39.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/867069874 >> 172.21.15.81:0/867069874 conn(0x7fcbec0a85d0 msgr2=0x7fcbec0a0e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:39.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/867069874 shutdown_connections 2024-09-10T16:30:39.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.406+0000 7fcbf0f6e640 1 -- 172.21.15.81:0/867069874 wait complete. 2024-09-10T16:30:39.450 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-10T16:30:39.450 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon e 2024-09-10T16:30:39.450 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-10T16:30:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 10 monclient: get_monmap_and_config 2024-09-10T16:30:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 10 monclient: build_initial_monmap 2024-09-10T16:30:39.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 10 monclient: monmap: 2024-09-10T16:30:39.573 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:39.573 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.573 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:39.574512+0000 2024-09-10T16:30:39.573 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:39.574512+0000 2024-09-10T16:30:39.573 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:39.573 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.573 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:39.573 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:39.573 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:39.573 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:39.573 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:39.573 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:39.573 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:39.574 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:39.574 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:39.574 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 1 Processor -- start 2024-09-10T16:30:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 1 -- start start 2024-09-10T16:30:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 10 monclient: init 2024-09-10T16:30:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 10 monclient: _add_conns ranks=[3,6,4,8,5,0,2,7,1] 2024-09-10T16:30:39.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 10 monclient(hunting): picked mon.noname-g con 0x7f023c135610 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:39.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 10 monclient(hunting): picked mon.noname-d con 0x7f023c0a5c60 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:39.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 10 monclient(hunting): picked mon.noname-c con 0x7f023c13f5b0 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:39.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f023c136240 con 0x7f023c135610 2024-09-10T16:30:39.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f023c09cba0 con 0x7f023c13f5b0 2024-09-10T16:30:39.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f023c09d720 con 0x7f023c0a5c60 2024-09-10T16:30:39.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:39.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 10 monclient(hunting): authenticate will time out at 1006.974096s 2024-09-10T16:30:39.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023affd640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f023c0a5c60 0x7f023c13de90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:37478/0 (socket says 172.21.15.81:37478) 2024-09-10T16:30:39.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023affd640 1 -- 172.21.15.81:0/2526169146 learned_addr learned my addr 172.21.15.81:0/2526169146 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:39.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023b7fe640 1 -- 172.21.15.81:0/2526169146 >> v1:172.21.15.189:6790/0 conn(0x7f023c135610 legacy=0x7f023c0a5550 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:30:39.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 1 -- 172.21.15.81:0/2526169146 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803295090 0 0) 0x7f023c09d720 con 0x7f023c0a5c60 2024-09-10T16:30:39.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient(hunting): my global_id is 4569 2024-09-10T16:30:39.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 1 -- 172.21.15.81:0/2526169146 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0224003530 con 0x7f023c0a5c60 2024-09-10T16:30:39.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 1 -- 172.21.15.81:0/2526169146 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3080851280 0 0) 0x7f023c09cba0 con 0x7f023c13f5b0 2024-09-10T16:30:39.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient(hunting): my global_id is 4594 2024-09-10T16:30:39.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 1 -- 172.21.15.81:0/2526169146 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f023c09d720 con 0x7f023c13f5b0 2024-09-10T16:30:39.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 1 -- 172.21.15.81:0/2526169146 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2761364056 0 0) 0x7f0224003530 con 0x7f023c0a5c60 2024-09-10T16:30:39.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 1 -- 172.21.15.81:0/2526169146 >> v1:172.21.15.81:6791/0 conn(0x7f023c13f5b0 legacy=0x7f023c1419a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 1 -- 172.21.15.81:0/2526169146 >> v1:172.21.15.189:6790/0 conn(0x7f023c135610 legacy=0x7f023c0a5550 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:30:39.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:30:39.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 1 monclient: found mon.noname-d 2024-09-10T16:30:39.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:39.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:30:39.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 1 -- 172.21.15.81:0/2526169146 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023c09da00 con 0x7f023c0a5c60 2024-09-10T16:30:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient: _finish_auth 0 2024-09-10T16:30:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:30:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 5 monclient: authenticate success, global_id 4569 2024-09-10T16:30:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 1 -- 172.21.15.81:0/2526169146 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0230001840 con 0x7f023c0a5c60 2024-09-10T16:30:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:30:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient: dump: 2024-09-10T16:30:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.585 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.586 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.586 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.586 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.586 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.586 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.586 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.586 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.586 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.586 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.586 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.586 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:39.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 1 -- 172.21.15.81:0/2526169146 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0230001a60 con 0x7f023c0a5c60 2024-09-10T16:30:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 1 -- 172.21.15.81:0/2526169146 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0230004bf0 con 0x7f023c0a5c60 2024-09-10T16:30:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 4 set_mon_vals no callback set 2024-09-10T16:30:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:30:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f023a7fc640 10 monclient: dump: 2024-09-10T16:30:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.587 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.588 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.588 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.588 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.588 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.588 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.588 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.588 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.588 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.588 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 10 monclient: shutdown 2024-09-10T16:30:39.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:39.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 1 -- 172.21.15.81:0/2526169146 >> v1:172.21.15.81:6792/0 conn(0x7f023c0a5c60 legacy=0x7f023c13de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 1 -- 172.21.15.81:0/2526169146 shutdown_connections 2024-09-10T16:30:39.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 1 -- 172.21.15.81:0/2526169146 >> 172.21.15.81:0/2526169146 conn(0x7f023c06db50 msgr2=0x7f023c0ab9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:39.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 1 -- 172.21.15.81:0/2526169146 shutdown_connections 2024-09-10T16:30:39.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.570+0000 7f024210a640 1 -- 172.21.15.81:0/2526169146 wait complete. 2024-09-10T16:30:39.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 monclient: build_initial_monmap 2024-09-10T16:30:39.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 monclient: monmap: 2024-09-10T16:30:39.589 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:39.589 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:39.589 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:39.589 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:39.589 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:39.589 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:39.590 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:39.590 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:39.590 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:39.590 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:39.590 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:39.590 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:39.590 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:39.590 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:39.590 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:39.590 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 1 Processor -- start 2024-09-10T16:30:39.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 1 -- start start 2024-09-10T16:30:39.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 monclient: init 2024-09-10T16:30:39.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:39.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 monclient: _add_conns ranks=[5,3,8,4,1,7,0,6,2] 2024-09-10T16:30:39.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 monclient(hunting): picked mon.noname-h con 0x7f023c0a5c60 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:39.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 monclient(hunting): picked mon.noname-g con 0x7f023c135610 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:39.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 monclient(hunting): picked mon.noname-e con 0x7f023c13f5b0 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:39.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f023c13d060 con 0x7f023c135610 2024-09-10T16:30:39.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f023c0a5a10 con 0x7f023c0a5c60 2024-09-10T16:30:39.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f023c13d320 con 0x7f023c13f5b0 2024-09-10T16:30:39.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:39.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 monclient(hunting): authenticate will time out at 1006.977055s 2024-09-10T16:30:39.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f023affd640 1 -- >> v1:172.21.15.189:6790/0 conn(0x7f023c135610 legacy=0x7f023c1d26f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:30:39.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f023bfff640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f023c13f5b0 0x7f023c1d5e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:47372/0 (socket says 172.21.15.81:47372) 2024-09-10T16:30:39.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f023bfff640 1 -- 172.21.15.81:0/414989798 learned_addr learned my addr 172.21.15.81:0/414989798 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 404343629 0 0) 0x7f023c13d320 con 0x7f023c13f5b0 2024-09-10T16:30:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): my global_id is 4508 2024-09-10T16:30:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0228003530 con 0x7f023c13f5b0 2024-09-10T16:30:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 315227268 0 0) 0x7f0228003530 con 0x7f023c13f5b0 2024-09-10T16:30:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f023c13d320 con 0x7f023c13f5b0 2024-09-10T16:30:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0234001ea0 con 0x7f023c13f5b0 2024-09-10T16:30:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): dump: 2024-09-10T16:30:39.594 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.595 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.595 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.595 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.595 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.595 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.595 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.595 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.595 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.595 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.595 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.595 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.597 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.597 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.597 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.597 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:39.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3091397747 0 0) 0x7f023c0a5a10 con 0x7f023c0a5c60 2024-09-10T16:30:39.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): my global_id is 4496 2024-09-10T16:30:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0228003530 con 0x7f023c0a5c60 2024-09-10T16:30:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3519393494 0 0) 0x7f023c13d320 con 0x7f023c13f5b0 2024-09-10T16:30:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 >> v1:172.21.15.189:6791/0 conn(0x7f023c0a5c60 legacy=0x7f023c132560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 >> v1:172.21.15.189:6790/0 conn(0x7f023c135610 legacy=0x7f023c1d26f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:30:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient: _finish_hunting 0 2024-09-10T16:30:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 monclient: found mon.e 2024-09-10T16:30:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f023c13d600 con 0x7f023c13f5b0 2024-09-10T16:30:39.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient: _finish_auth 0 2024-09-10T16:30:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient: _check_auth_tickets 2024-09-10T16:30:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 5 monclient: authenticate success, global_id 4508 2024-09-10T16:30:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 monclient: _renew_subs 2024-09-10T16:30:39.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:39.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 1 -- 172.21.15.81:0/414989798 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f023c13e2f0 con 0x7f023c13f5b0 2024-09-10T16:30:39.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 monclient: _renew_subs 2024-09-10T16:30:39.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:39.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 1 -- 172.21.15.81:0/414989798 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f023c139ed0 con 0x7f023c13f5b0 2024-09-10T16:30:39.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0234003c50 con 0x7f023c13f5b0 2024-09-10T16:30:39.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:39.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0234004200 con 0x7f023c13f5b0 2024-09-10T16:30:39.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0239ffb640 4 set_mon_vals no callback set 2024-09-10T16:30:39.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:39.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient: dump: 2024-09-10T16:30:39.603 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.603 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.603 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.603 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.603 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.604 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.605 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.605 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f024210a640 1 -- 172.21.15.81:0/414989798 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f021c0065d0 con 0x7f021c002870 2024-09-10T16:30:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f0234004420 con 0x7f023c13f5b0 2024-09-10T16:30:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(25..25 src has 1..25) ==== 3898+0+0 (unknown 4255508053 0 0) 0x7f023404b240 con 0x7f023c13f5b0 2024-09-10T16:30:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3614717512 0 0) 0x7f021c0065d0 con 0x7f021c002870 2024-09-10T16:30:39.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient(hunting): my global_id is 4517 2024-09-10T16:30:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f023c13d320 con 0x7f021c002870 2024-09-10T16:30:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3208975472 0 0) 0x7f023c13d320 con 0x7f021c002870 2024-09-10T16:30:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f021c0065d0 con 0x7f021c002870 2024-09-10T16:30:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f022c004290 con 0x7f021c002870 2024-09-10T16:30:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 10 monclient: dump: 2024-09-10T16:30:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.609 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.609 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.609 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.609 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.609 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.609 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.610 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.610 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.610 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.610 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.610 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.611 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f023affd640 10 monclient: get_auth_request con 0x7f022803cf40 auth_method 0 2024-09-10T16:30:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 512672288 0 0) 0x7f021c0065d0 con 0x7f021c002870 2024-09-10T16:30:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.574+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 --> v1:172.21.15.81:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f021c00a170 con 0x7f021c002870 2024-09-10T16:30:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.578+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f022c0065f0 con 0x7f021c002870 2024-09-10T16:30:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.578+0000 7f0223fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.578+0000 7f0223fff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.578+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 >> v1:172.21.15.81:6793/0 conn(0x7f021c002870 legacy=0x7f021c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.578+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 >> v1:172.21.15.81:6793/0 conn(0x7f021c002870 legacy=0x7f021c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f024210a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f024210a640 1 -- 172.21.15.81:0/414989798 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f021c009e80 con 0x7f021c009140 2024-09-10T16:30:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2902321234 0 0) 0x7f021c009e80 con 0x7f021c009140 2024-09-10T16:30:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 10 monclient(hunting): my global_id is 4526 2024-09-10T16:30:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f021c0065d0 con 0x7f021c009140 2024-09-10T16:30:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2296592601 0 0) 0x7f021c0065d0 con 0x7f021c009140 2024-09-10T16:30:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f021c009e80 con 0x7f021c009140 2024-09-10T16:30:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f022c004c70 con 0x7f021c009140 2024-09-10T16:30:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 10 monclient: dump: 2024-09-10T16:30:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.618 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.619 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.620 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.620 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.620 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.620 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.620 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.621 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4163013548 0 0) 0x7f021c009e80 con 0x7f021c009140 2024-09-10T16:30:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 --> v1:172.21.15.81:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f021c00c420 con 0x7f021c009140 2024-09-10T16:30:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7532 (unknown 0 0 2276936873) 0x7f022c006120 con 0x7f021c009140 2024-09-10T16:30:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 >> v1:172.21.15.81:6793/0 conn(0x7f021c009140 legacy=0x7f021c0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f0223fff640 1 -- 172.21.15.81:0/414989798 >> v1:172.21.15.81:6793/0 conn(0x7f021c009140 legacy=0x7f021c0095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:39.623 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:39.623 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:39.623 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:39.623 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:39.623 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 12, 2024-09-10T16:30:39.624 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 49543, 2024-09-10T16:30:39.624 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:39.624 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:39.624 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:39.624 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:39.625 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:39.625 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:39.625 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:39.625 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:39.625 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:39.625 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.626 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:30:39.626 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:39.626 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:39.626 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:39.626 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.627 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.628 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.628 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.628 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.628 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.628 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.629 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:39.629 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:39.629 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.629 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.630 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.630 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.630 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.630 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.630 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.631 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.631 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.631 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.631 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.631 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.632 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:39.632 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:39.632 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:39.632 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:39.632 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:39.632 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:39.633 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:39.633 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:39.633 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:39.633 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:39.633 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:39.634 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:39.634 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:39.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:39.634 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:39.634 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:39.634 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:39.635 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.635 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.635 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.635 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.635 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.635 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.636 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.636 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.636 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.636 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.636 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.637 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.637 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:39.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:39.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.637 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:39.638 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:39.638 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:39.639 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:39.640 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:39.640 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.640 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.640 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.641 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:39.641 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:39.641 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.641 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.642 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:39.642 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.642 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.642 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:39.643 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:39.643 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.643 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.643 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.644 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:39.644 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:39.644 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.644 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.645 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:39.645 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.646 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:39.646 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:39.646 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.646 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.646 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.647 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:39.647 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:39.647 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.647 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.648 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:39.648 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.648 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.649 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:39.649 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:39.649 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.649 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.649 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.650 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:39.650 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:39.650 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.651 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:39.651 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.651 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.652 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:39.652 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:39.652 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.652 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.652 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.653 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:39.653 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:39.653 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.654 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:39.654 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.654 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:39.654 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:39.655 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.655 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.655 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.655 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:39.656 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:39.656 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.656 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.656 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.656 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:39.656 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.656 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.657 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.657 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:39.657 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:39.657 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.657 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.657 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.658 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:39.658 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:39.658 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.658 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.658 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.658 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:39.658 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.658 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.658 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.659 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:39.659 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:39.659 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.659 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.659 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.660 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.660 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:39.660 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:39.660 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.660 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.661 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.661 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.661 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:39.661 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.661 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.661 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.662 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.662 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:39.662 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:39.662 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.662 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.662 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.663 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.663 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.663 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:39.663 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:39.663 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.663 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:39.664 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:39.664 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:39.664 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.664 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.664 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:39.664 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.665 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:39.665 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:39.665 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:30:39.665 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.665 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.665 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.665 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:39.665 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f024210a640 1 -- 172.21.15.81:0/414989798 >> v1:172.21.15.189:6812/1108603242 conn(0x7f022803cf40 legacy=0x7f022803f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f024210a640 10 monclient: shutdown 2024-09-10T16:30:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f024210a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f024210a640 1 -- 172.21.15.81:0/414989798 >> v1:172.21.15.81:6793/0 conn(0x7f023c13f5b0 legacy=0x7f023c1d5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f023bfff640 1 -- 172.21.15.81:0/414989798 reap_dead start 2024-09-10T16:30:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f023bfff640 1 -- 172.21.15.81:0/414989798 reap_dead start 2024-09-10T16:30:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f024210a640 1 -- 172.21.15.81:0/414989798 shutdown_connections 2024-09-10T16:30:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f024210a640 1 -- 172.21.15.81:0/414989798 >> 172.21.15.81:0/414989798 conn(0x7f023c06db50 msgr2=0x7f023c133510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:39.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f024210a640 1 -- 172.21.15.81:0/414989798 shutdown_connections 2024-09-10T16:30:39.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.582+0000 7f024210a640 1 -- 172.21.15.81:0/414989798 wait complete. 2024-09-10T16:30:39.668 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-10T16:30:39.668 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon f 2024-09-10T16:30:39.669 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-10T16:30:39.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 10 monclient: get_monmap_and_config 2024-09-10T16:30:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 10 monclient: build_initial_monmap 2024-09-10T16:30:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 10 monclient: monmap: 2024-09-10T16:30:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:39.794650+0000 2024-09-10T16:30:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:39.794650+0000 2024-09-10T16:30:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:39.794 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:39.794 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:39.794 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:39.794 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:39.794 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 1 Processor -- start 2024-09-10T16:30:39.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 1 -- start start 2024-09-10T16:30:39.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 10 monclient: init 2024-09-10T16:30:39.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:39.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 10 monclient: _add_conns ranks=[0,1,4,2,7,3,8,5,6] 2024-09-10T16:30:39.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 10 monclient(hunting): picked mon.noname-a con 0x7fb2b00a5510 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:39.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 10 monclient(hunting): picked mon.noname-f con 0x7fb2b0135bf0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:39.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 10 monclient(hunting): picked mon.noname-c con 0x7fb2b0136060 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:39.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b009d7e0 con 0x7fb2b00a5510 2024-09-10T16:30:39.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b009dac0 con 0x7fb2b0135bf0 2024-09-10T16:30:39.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b009dda0 con 0x7fb2b0136060 2024-09-10T16:30:39.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:39.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 10 monclient(hunting): authenticate will time out at 1007.194867s 2024-09-10T16:30:39.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b6092640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fb2b0136060 0x7fb2b0141560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:44004/0 (socket says 172.21.15.81:44004) 2024-09-10T16:30:39.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b6092640 1 -- 172.21.15.81:0/2473697433 learned_addr learned my addr 172.21.15.81:0/2473697433 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:39.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b5891640 1 --1- 172.21.15.81:0/2473697433 >> v1:172.21.15.81:6789/0 conn(0x7fb2b00a5510 0x7fb2b00a58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33396/0 (socket says 172.21.15.81:33396) 2024-09-10T16:30:39.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 1 -- 172.21.15.81:0/2473697433 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2415443536 0 0) 0x7fb2b009dda0 con 0x7fb2b0136060 2024-09-10T16:30:39.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient(hunting): my global_id is 4603 2024-09-10T16:30:39.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 1 -- 172.21.15.81:0/2473697433 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb29c003530 con 0x7fb2b0136060 2024-09-10T16:30:39.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 1 -- 172.21.15.81:0/2473697433 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4259416323 0 0) 0x7fb2b009d7e0 con 0x7fb2b00a5510 2024-09-10T16:30:39.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient(hunting): my global_id is 4662 2024-09-10T16:30:39.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 1 -- 172.21.15.81:0/2473697433 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2b009dda0 con 0x7fb2b00a5510 2024-09-10T16:30:39.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 1 -- 172.21.15.81:0/2473697433 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1206392999 0 0) 0x7fb29c003530 con 0x7fb2b0136060 2024-09-10T16:30:39.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 1 -- 172.21.15.81:0/2473697433 >> v1:172.21.15.189:6789/0 conn(0x7fb2b0135bf0 legacy=0x7fb2b013de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 1 -- 172.21.15.81:0/2473697433 >> v1:172.21.15.81:6789/0 conn(0x7fb2b00a5510 legacy=0x7fb2b00a58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient: _finish_hunting 0 2024-09-10T16:30:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 1 monclient: found mon.noname-c 2024-09-10T16:30:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:30:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 1 -- 172.21.15.81:0/2473697433 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b009cca0 con 0x7fb2b0136060 2024-09-10T16:30:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient: _finish_auth 0 2024-09-10T16:30:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient: _check_auth_tickets 2024-09-10T16:30:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 1 -- 172.21.15.81:0/2473697433 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb2a8001bc0 con 0x7fb2b0136060 2024-09-10T16:30:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 5 monclient: authenticate success, global_id 4603 2024-09-10T16:30:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:39.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient: dump: 2024-09-10T16:30:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.804 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.805 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b7af5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 1 -- 172.21.15.81:0/2473697433 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2a8001e50 con 0x7fb2b0136060 2024-09-10T16:30:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 1 -- 172.21.15.81:0/2473697433 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb2a8004f70 con 0x7fb2b0136060 2024-09-10T16:30:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.790+0000 7fb2b488f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b488f640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b488f640 10 monclient: dump: 2024-09-10T16:30:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.805 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.806 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:39.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 4 set_mon_vals no callback set 2024-09-10T16:30:39.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient: shutdown 2024-09-10T16:30:39.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:39.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 1 -- 172.21.15.81:0/2473697433 >> v1:172.21.15.81:6791/0 conn(0x7fb2b0136060 legacy=0x7fb2b0141560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 1 -- 172.21.15.81:0/2473697433 shutdown_connections 2024-09-10T16:30:39.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 1 -- 172.21.15.81:0/2473697433 >> 172.21.15.81:0/2473697433 conn(0x7fb2b006dae0 msgr2=0x7fb2b00ab8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:39.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 1 -- 172.21.15.81:0/2473697433 shutdown_connections 2024-09-10T16:30:39.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 1 -- 172.21.15.81:0/2473697433 wait complete. 2024-09-10T16:30:39.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient: build_initial_monmap 2024-09-10T16:30:39.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient: monmap: 2024-09-10T16:30:39.807 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:39.807 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:39.807 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:39.808 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:39.808 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:39.808 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:39.808 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:39.808 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:39.808 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:39.808 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:39.808 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:39.808 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:39.808 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:39.808 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:39.808 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:39.809 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 1 Processor -- start 2024-09-10T16:30:39.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 1 -- start start 2024-09-10T16:30:39.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient: init 2024-09-10T16:30:39.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:39.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient: _add_conns ranks=[5,1,8,3,2,6,0,7,4] 2024-09-10T16:30:39.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient(hunting): picked mon.noname-h con 0x7fb2b00a5510 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:39.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient(hunting): picked mon.noname-f con 0x7fb2b0135bf0 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:39.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient(hunting): picked mon.noname-e con 0x7fb2b0136060 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:39.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b00a3180 con 0x7fb2b0135bf0 2024-09-10T16:30:39.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b00a3460 con 0x7fb2b00a5510 2024-09-10T16:30:39.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2b00a8fd0 con 0x7fb2b0136060 2024-09-10T16:30:39.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:39.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient(hunting): authenticate will time out at 1007.198219s 2024-09-10T16:30:39.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b6092640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fb2b0136060 0x7fb2b01d5f50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:47390/0 (socket says 172.21.15.81:47390) 2024-09-10T16:30:39.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b6092640 1 -- 172.21.15.81:0/636765652 learned_addr learned my addr 172.21.15.81:0/636765652 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:39.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 212602725 0 0) 0x7fb2b00a8fd0 con 0x7fb2b0136060 2024-09-10T16:30:39.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): my global_id is 4535 2024-09-10T16:30:39.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb294003530 con 0x7fb2b0136060 2024-09-10T16:30:39.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 221819350 0 0) 0x7fb2b00a3180 con 0x7fb2b0135bf0 2024-09-10T16:30:39.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): my global_id is 4627 2024-09-10T16:30:39.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2b00a8fd0 con 0x7fb2b0135bf0 2024-09-10T16:30:39.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1100850185 0 0) 0x7fb294003530 con 0x7fb2b0136060 2024-09-10T16:30:39.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2b00a3180 con 0x7fb2b0136060 2024-09-10T16:30:39.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 64891252 0 0) 0x7fb2b00a3460 con 0x7fb2b00a5510 2024-09-10T16:30:39.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): my global_id is 4505 2024-09-10T16:30:39.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb294003530 con 0x7fb2b00a5510 2024-09-10T16:30:39.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb2a8001370 con 0x7fb2b0136060 2024-09-10T16:30:39.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:39.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:39.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): dump: 2024-09-10T16:30:39.812 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.812 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.812 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.812 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.812 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.812 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.812 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.812 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.812 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.813 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 315272907 0 0) 0x7fb2b00a3180 con 0x7fb2b0136060 2024-09-10T16:30:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 >> v1:172.21.15.189:6791/0 conn(0x7fb2b00a5510 legacy=0x7fb2b009f8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 >> v1:172.21.15.189:6789/0 conn(0x7fb2b0135bf0 legacy=0x7fb2b00a0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient: _finish_hunting 0 2024-09-10T16:30:39.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 monclient: found mon.e 2024-09-10T16:30:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b0135200 con 0x7fb2b0136060 2024-09-10T16:30:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient: _finish_auth 0 2024-09-10T16:30:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient: _check_auth_tickets 2024-09-10T16:30:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 5 monclient: authenticate success, global_id 4535 2024-09-10T16:30:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient: _renew_subs 2024-09-10T16:30:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b00a0710 con 0x7fb2b0136060 2024-09-10T16:30:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient: _renew_subs 2024-09-10T16:30:39.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fb2b00a1cc0 con 0x7fb2b0136060 2024-09-10T16:30:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2a8001ca0 con 0x7fb2b0136060 2024-09-10T16:30:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb2a80054a0 con 0x7fb2b0136060 2024-09-10T16:30:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a7fff640 4 set_mon_vals no callback set 2024-09-10T16:30:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2a67fc640 10 monclient: dump: 2024-09-10T16:30:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.815 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.816 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:39.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.794+0000 7fb2b7af5640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb2980065d0 con 0x7fb298002870 2024-09-10T16:30:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fb2a80113b0 con 0x7fb2b0136060 2024-09-10T16:30:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(25..25 src has 1..25) ==== 3898+0+0 (unknown 4255508053 0 0) 0x7fb2a804b120 con 0x7fb2b0136060 2024-09-10T16:30:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2b5090640 10 monclient: get_auth_request con 0x7fb29403d230 auth_method 0 2024-09-10T16:30:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2836178105 0 0) 0x7fb2980065d0 con 0x7fb298002870 2024-09-10T16:30:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 10 monclient(hunting): my global_id is 4636 2024-09-10T16:30:39.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2b00a3180 con 0x7fb298002870 2024-09-10T16:30:39.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1862623680 0 0) 0x7fb2b00a3180 con 0x7fb298002870 2024-09-10T16:30:39.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2980065d0 con 0x7fb298002870 2024-09-10T16:30:39.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb2ac0013f0 con 0x7fb298002870 2024-09-10T16:30:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:30:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 10 monclient: dump: 2024-09-10T16:30:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.820 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.821 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 132605504 0 0) 0x7fb2980065d0 con 0x7fb298002870 2024-09-10T16:30:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.189:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb29800a170 con 0x7fb298002870 2024-09-10T16:30:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb2ac001700 con 0x7fb298002870 2024-09-10T16:30:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:39.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 >> v1:172.21.15.189:6789/0 conn(0x7fb298002870 legacy=0x7fb298004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.798+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 >> v1:172.21.15.189:6789/0 conn(0x7fb298002870 legacy=0x7fb298004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2b7af5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2b7af5640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb298009e60 con 0x7fb298009120 2024-09-10T16:30:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 246633218 0 0) 0x7fb298009e60 con 0x7fb298009120 2024-09-10T16:30:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 10 monclient(hunting): my global_id is 4645 2024-09-10T16:30:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2980065d0 con 0x7fb298009120 2024-09-10T16:30:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2168750616 0 0) 0x7fb2980065d0 con 0x7fb298009120 2024-09-10T16:30:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb298009e60 con 0x7fb298009120 2024-09-10T16:30:39.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb2ac004d60 con 0x7fb298009120 2024-09-10T16:30:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:30:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 10 monclient: dump: 2024-09-10T16:30:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.823 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.824 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1014799008 0 0) 0x7fb298009e60 con 0x7fb298009120 2024-09-10T16:30:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 --> v1:172.21.15.189:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb29800c3b0 con 0x7fb298009120 2024-09-10T16:30:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7532 (unknown 0 0 2364591447) 0x7fb2ac006230 con 0x7fb298009120 2024-09-10T16:30:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 >> v1:172.21.15.189:6789/0 conn(0x7fb298009120 legacy=0x7fb2980095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2a67fc640 1 -- 172.21.15.81:0/636765652 >> v1:172.21.15.189:6789/0 conn(0x7fb298009120 legacy=0x7fb2980095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:39.825 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 12, 2024-09-10T16:30:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 49727, 2024-09-10T16:30:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:39.825 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:30:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:39.826 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.827 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.828 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:39.829 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.830 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.831 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:39.832 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.833 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:39.834 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:39.836 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:39.837 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:39.840 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.842 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.843 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:39.844 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.845 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-09-10T16:30:39.846 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.847 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:39.847 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2b7af5640 1 -- 172.21.15.81:0/636765652 >> v1:172.21.15.189:6812/1108603242 conn(0x7fb29403d230 legacy=0x7fb29403f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2b7af5640 10 monclient: shutdown 2024-09-10T16:30:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2b7af5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2b7af5640 1 -- 172.21.15.81:0/636765652 >> v1:172.21.15.81:6793/0 conn(0x7fb2b0136060 legacy=0x7fb2b01d5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2b6092640 1 -- 172.21.15.81:0/636765652 reap_dead start 2024-09-10T16:30:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2b6092640 1 -- 172.21.15.81:0/636765652 reap_dead start 2024-09-10T16:30:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2b7af5640 1 -- 172.21.15.81:0/636765652 shutdown_connections 2024-09-10T16:30:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2b7af5640 1 -- 172.21.15.81:0/636765652 >> 172.21.15.81:0/636765652 conn(0x7fb2b006dae0 msgr2=0x7fb2b0133430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2b7af5640 1 -- 172.21.15.81:0/636765652 shutdown_connections 2024-09-10T16:30:39.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.806+0000 7fb2b7af5640 1 -- 172.21.15.81:0/636765652 wait complete. 2024-09-10T16:30:39.849 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-10T16:30:39.849 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon h 2024-09-10T16:30:39.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-10T16:30:39.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 10 monclient: get_monmap_and_config 2024-09-10T16:30:39.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 10 monclient: build_initial_monmap 2024-09-10T16:30:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 10 monclient: monmap: 2024-09-10T16:30:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:39.966673+0000 2024-09-10T16:30:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:39.966673+0000 2024-09-10T16:30:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:39.965 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:39.966 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:39.966 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:39.966 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:39.966 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:39.966 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 1 Processor -- start 2024-09-10T16:30:39.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 1 -- start start 2024-09-10T16:30:39.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 10 monclient: init 2024-09-10T16:30:39.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:39.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 10 monclient: _add_conns ranks=[6,4,1,0,3,5,2,8,7] 2024-09-10T16:30:39.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 10 monclient(hunting): picked mon.noname-d con 0x7f14d41328c0 addr v1:172.21.15.81:6792/0 2024-09-10T16:30:39.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 10 monclient(hunting): picked mon.noname-c con 0x7f14d409e7a0 addr v1:172.21.15.81:6791/0 2024-09-10T16:30:39.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 10 monclient(hunting): picked mon.noname-f con 0x7f14d413f730 addr v1:172.21.15.189:6789/0 2024-09-10T16:30:39.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d406d540 con 0x7f14d413f730 2024-09-10T16:30:39.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d406d860 con 0x7f14d409e7a0 2024-09-10T16:30:39.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d409d520 con 0x7f14d41328c0 2024-09-10T16:30:39.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:39.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 10 monclient(hunting): authenticate will time out at 1007.366171s 2024-09-10T16:30:39.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14da44c640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f14d41328c0 0x7f14d4132ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:37488/0 (socket says 172.21.15.81:37488) 2024-09-10T16:30:39.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14da44c640 1 -- 172.21.15.81:0/1320975506 learned_addr learned my addr 172.21.15.81:0/1320975506 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:39.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 1 -- 172.21.15.81:0/1320975506 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3539744164 0 0) 0x7f14d406d860 con 0x7f14d409e7a0 2024-09-10T16:30:39.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient(hunting): my global_id is 4612 2024-09-10T16:30:39.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 1 -- 172.21.15.81:0/1320975506 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14c0003530 con 0x7f14d409e7a0 2024-09-10T16:30:39.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 1 -- 172.21.15.81:0/1320975506 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 436239251 0 0) 0x7f14d409d520 con 0x7f14d41328c0 2024-09-10T16:30:39.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient(hunting): my global_id is 4578 2024-09-10T16:30:39.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 1 -- 172.21.15.81:0/1320975506 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14d406d860 con 0x7f14d41328c0 2024-09-10T16:30:39.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 1 -- 172.21.15.81:0/1320975506 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1095679103 0 0) 0x7f14c0003530 con 0x7f14d409e7a0 2024-09-10T16:30:39.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 1 -- 172.21.15.81:0/1320975506 >> v1:172.21.15.81:6792/0 conn(0x7f14d41328c0 legacy=0x7f14d4132ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 1 -- 172.21.15.81:0/1320975506 >> v1:172.21.15.189:6789/0 conn(0x7f14d413f730 legacy=0x7f14d4141b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient: _finish_hunting 0 2024-09-10T16:30:39.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 1 monclient: found mon.noname-c 2024-09-10T16:30:39.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:39.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:30:39.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 1 -- 172.21.15.81:0/1320975506 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d409d800 con 0x7f14d409e7a0 2024-09-10T16:30:39.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient: _finish_auth 0 2024-09-10T16:30:39.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient: _check_auth_tickets 2024-09-10T16:30:39.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:39.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 1 -- 172.21.15.81:0/1320975506 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f14bc001bc0 con 0x7f14d409e7a0 2024-09-10T16:30:39.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 5 monclient: authenticate success, global_id 4612 2024-09-10T16:30:39.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:39.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:30:39.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient: dump: 2024-09-10T16:30:39.975 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.975 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 1 -- 172.21.15.81:0/1320975506 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f14bc001de0 con 0x7f14d409e7a0 2024-09-10T16:30:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 4 set_mon_vals no callback set 2024-09-10T16:30:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 1 -- 172.21.15.81:0/1320975506 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f14bc003ce0 con 0x7f14d409e7a0 2024-09-10T16:30:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:30:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14d944a640 10 monclient: dump: 2024-09-10T16:30:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.977 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 10 monclient: shutdown 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 1 -- 172.21.15.81:0/1320975506 >> v1:172.21.15.81:6791/0 conn(0x7f14d409e7a0 legacy=0x7f14d413e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 1 -- 172.21.15.81:0/1320975506 shutdown_connections 2024-09-10T16:30:39.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 1 -- 172.21.15.81:0/1320975506 >> 172.21.15.81:0/1320975506 conn(0x7f14d40a47e0 msgr2=0x7f14d40a4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 1 -- 172.21.15.81:0/1320975506 shutdown_connections 2024-09-10T16:30:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.962+0000 7f14dc6b0640 1 -- 172.21.15.81:0/1320975506 wait complete. 2024-09-10T16:30:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 monclient: build_initial_monmap 2024-09-10T16:30:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 monclient: monmap: 2024-09-10T16:30:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:39.979 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:39.980 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:39.980 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:39.980 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:39.980 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:39.980 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:39.980 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:39.980 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 1 Processor -- start 2024-09-10T16:30:39.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 1 -- start start 2024-09-10T16:30:39.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 monclient: init 2024-09-10T16:30:39.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:39.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 monclient: _add_conns ranks=[7,5,2,0,3,1,4,6,8] 2024-09-10T16:30:39.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 monclient(hunting): picked mon.noname-i con 0x7f14d409e7a0 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:39.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 monclient(hunting): picked mon.noname-h con 0x7f14d41328c0 addr v1:172.21.15.189:6791/0 2024-09-10T16:30:39.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 monclient(hunting): picked mon.noname-b con 0x7f14d413f730 addr v1:172.21.15.81:6790/0 2024-09-10T16:30:39.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d40a2010 con 0x7f14d413f730 2024-09-10T16:30:39.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d40a0150 con 0x7f14d41328c0 2024-09-10T16:30:39.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14d413a010 con 0x7f14d409e7a0 2024-09-10T16:30:39.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:39.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 monclient(hunting): authenticate will time out at 1007.369491s 2024-09-10T16:30:39.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dac4d640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f14d413f730 0x7f14d41d6300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:58776/0 (socket says 172.21.15.81:58776) 2024-09-10T16:30:39.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dac4d640 1 -- 172.21.15.81:0/2254604411 learned_addr learned my addr 172.21.15.81:0/2254604411 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:39.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 399123108 0 0) 0x7f14d40a2010 con 0x7f14d413f730 2024-09-10T16:30:39.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): my global_id is 4646 2024-09-10T16:30:39.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14b4003530 con 0x7f14d413f730 2024-09-10T16:30:39.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3812847134 0 0) 0x7f14b4003530 con 0x7f14d413f730 2024-09-10T16:30:39.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14d40a2010 con 0x7f14d413f730 2024-09-10T16:30:39.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f14cc001a90 con 0x7f14d413f730 2024-09-10T16:30:39.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:39.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:30:39.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:39.982 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.982 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.982 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.982 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930310924 0 0) 0x7f14d40a0150 con 0x7f14d41328c0 2024-09-10T16:30:39.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): my global_id is 4514 2024-09-10T16:30:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14b4003530 con 0x7f14d41328c0 2024-09-10T16:30:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4124462988 0 0) 0x7f14d40a2010 con 0x7f14d413f730 2024-09-10T16:30:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 >> v1:172.21.15.189:6792/0 conn(0x7f14d409e7a0 legacy=0x7f14d409f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 >> v1:172.21.15.189:6791/0 conn(0x7f14d41328c0 legacy=0x7f14d409fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 monclient: found mon.b 2024-09-10T16:30:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14d4142cb0 con 0x7f14d413f730 2024-09-10T16:30:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:39.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 5 monclient: authenticate success, global_id 4646 2024-09-10T16:30:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 monclient: _renew_subs 2024-09-10T16:30:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 1 -- 172.21.15.81:0/2254604411 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f14d40a06d0 con 0x7f14d413f730 2024-09-10T16:30:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 monclient: _renew_subs 2024-09-10T16:30:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:30:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 1 -- 172.21.15.81:0/2254604411 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f14d40a0aa0 con 0x7f14d413f730 2024-09-10T16:30:39.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f14cc0038d0 con 0x7f14d413f730 2024-09-10T16:30:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f14cc003e40 con 0x7f14d413f730 2024-09-10T16:30:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d8c49640 4 set_mon_vals no callback set 2024-09-10T16:30:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:30:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient: dump: 2024-09-10T16:30:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.986 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.987 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14dc6b0640 1 -- 172.21.15.81:0/2254604411 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f14b80065d0 con 0x7f14b8002870 2024-09-10T16:30:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f14cc004060 con 0x7f14d413f730 2024-09-10T16:30:39.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(25..25 src has 1..25) ==== 3898+0+0 (unknown 4255508053 0 0) 0x7f14cc04aea0 con 0x7f14d413f730 2024-09-10T16:30:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d9c4b640 10 monclient: get_auth_request con 0x7f14b403d050 auth_method 0 2024-09-10T16:30:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2750351314 0 0) 0x7f14b80065d0 con 0x7f14b8002870 2024-09-10T16:30:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 10 monclient(hunting): my global_id is 4523 2024-09-10T16:30:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.966+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14d40a2010 con 0x7f14b8002870 2024-09-10T16:30:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.970+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4203462716 0 0) 0x7f14d40a2010 con 0x7f14b8002870 2024-09-10T16:30:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.970+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14b80065d0 con 0x7f14b8002870 2024-09-10T16:30:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.970+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f14c4001360 con 0x7f14b8002870 2024-09-10T16:30:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.970+0000 7f14d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.970+0000 7f14d2ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:30:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.970+0000 7f14d2ffd640 10 monclient: dump: 2024-09-10T16:30:39.988 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.989 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.990 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.990 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.970+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2677363010 0 0) 0x7f14b80065d0 con 0x7f14b8002870 2024-09-10T16:30:39.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.970+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 --> v1:172.21.15.189:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f14b800a170 con 0x7f14b8002870 2024-09-10T16:30:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.970+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f14c4001650 con 0x7f14b8002870 2024-09-10T16:30:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.970+0000 7f14d2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.970+0000 7f14d2ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.970+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 >> v1:172.21.15.189:6791/0 conn(0x7f14b8002870 legacy=0x7f14b8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.970+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 >> v1:172.21.15.189:6791/0 conn(0x7f14b8002870 legacy=0x7f14b8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:39.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.974+0000 7f14dc6b0640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.974+0000 7f14dc6b0640 1 -- 172.21.15.81:0/2254604411 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f14b8009e80 con 0x7f14b8009140 2024-09-10T16:30:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3224932053 0 0) 0x7f14b8009e80 con 0x7f14b8009140 2024-09-10T16:30:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 10 monclient(hunting): my global_id is 4532 2024-09-10T16:30:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f14b80065d0 con 0x7f14b8009140 2024-09-10T16:30:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2489010150 0 0) 0x7f14b80065d0 con 0x7f14b8009140 2024-09-10T16:30:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f14b8009e80 con 0x7f14b8009140 2024-09-10T16:30:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f14c4004d20 con 0x7f14b8009140 2024-09-10T16:30:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:30:39.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 10 monclient: dump: 2024-09-10T16:30:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:39.993 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:39.994 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3939893637 0 0) 0x7f14b8009e80 con 0x7f14b8009140 2024-09-10T16:30:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 --> v1:172.21.15.189:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f14b800c420 con 0x7f14b8009140 2024-09-10T16:30:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7699 (unknown 0 0 941278504) 0x7f14c4004e50 con 0x7f14b8009140 2024-09-10T16:30:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 >> v1:172.21.15.189:6791/0 conn(0x7f14b8009140 legacy=0x7f14b80095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14d2ffd640 1 -- 172.21.15.81:0/2254604411 >> v1:172.21.15.189:6791/0 conn(0x7f14b8009140 legacy=0x7f14b80095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:39.994 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:39.994 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 12, 2024-09-10T16:30:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 49907, 2024-09-10T16:30:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:30:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.996 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:39.997 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:39.998 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:39.999 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.000 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.001 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.002 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.004 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:40.005 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.006 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:40.008 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.009 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:30:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:40.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.014 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:40.014 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:40.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14dc6b0640 1 -- 172.21.15.81:0/2254604411 >> v1:172.21.15.189:6812/1108603242 conn(0x7f14b403d050 legacy=0x7f14b403f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:40.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14dc6b0640 10 monclient: shutdown 2024-09-10T16:30:40.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14dc6b0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:40.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14dc6b0640 1 -- 172.21.15.81:0/2254604411 >> v1:172.21.15.81:6790/0 conn(0x7f14d413f730 legacy=0x7f14d41d6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:40.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14dac4d640 1 -- 172.21.15.81:0/2254604411 reap_dead start 2024-09-10T16:30:40.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14dac4d640 1 -- 172.21.15.81:0/2254604411 reap_dead start 2024-09-10T16:30:40.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14dc6b0640 1 -- 172.21.15.81:0/2254604411 shutdown_connections 2024-09-10T16:30:40.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14dc6b0640 1 -- 172.21.15.81:0/2254604411 >> 172.21.15.81:0/2254604411 conn(0x7f14d40a47e0 msgr2=0x7f14d4138890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:40.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14dc6b0640 1 -- 172.21.15.81:0/2254604411 shutdown_connections 2024-09-10T16:30:40.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:39.978+0000 7f14dc6b0640 1 -- 172.21.15.81:0/2254604411 wait complete. 2024-09-10T16:30:40.016 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-10T16:30:40.017 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 8 for mon i 2024-09-10T16:30:40.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-10T16:30:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 10 monclient: get_monmap_and_config 2024-09-10T16:30:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 10 monclient: build_initial_monmap 2024-09-10T16:30:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 10 monclient: monmap: 2024-09-10T16:30:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:30:40.138297+0000 2024-09-10T16:30:40.136 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:30:40.138297+0000 2024-09-10T16:30:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:40.137 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:40.137 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 1 Processor -- start 2024-09-10T16:30:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 1 -- start start 2024-09-10T16:30:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 10 monclient: init 2024-09-10T16:30:40.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 10 monclient: _add_conns ranks=[0,3,8,2,7,4,6,1,5] 2024-09-10T16:30:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 10 monclient(hunting): picked mon.noname-a con 0x7f6c2c135610 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 10 monclient(hunting): picked mon.noname-g con 0x7f6c2c0a5c60 addr v1:172.21.15.189:6790/0 2024-09-10T16:30:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 10 monclient(hunting): picked mon.noname-e con 0x7f6c2c13f5b0 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2c136240 con 0x7f6c2c135610 2024-09-10T16:30:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2c09cba0 con 0x7f6c2c0a5c60 2024-09-10T16:30:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2c09d720 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 10 monclient(hunting): authenticate will time out at 1007.537816s 2024-09-10T16:30:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2ad9d640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f6c2c13f5b0 0x7f6c2c1419a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:47406/0 (socket says 172.21.15.81:47406) 2024-09-10T16:30:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2ad9d640 1 -- 172.21.15.81:0/143818282 learned_addr learned my addr 172.21.15.81:0/143818282 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:40.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2a59c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6c2c135610 0x7f6c2c0a5550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33398/0 (socket says 172.21.15.81:33398) 2024-09-10T16:30:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c29d9b640 1 -- 172.21.15.81:0/143818282 >> v1:172.21.15.189:6790/0 conn(0x7f6c2c0a5c60 legacy=0x7f6c2c13de90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:30:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 1 -- 172.21.15.81:0/143818282 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1100663641 0 0) 0x7f6c2c136240 con 0x7f6c2c135610 2024-09-10T16:30:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient(hunting): my global_id is 4671 2024-09-10T16:30:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 1 -- 172.21.15.81:0/143818282 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c18003530 con 0x7f6c2c135610 2024-09-10T16:30:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 1 -- 172.21.15.81:0/143818282 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1941273945 0 0) 0x7f6c2c09d720 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient(hunting): _negotiate 2024-09-10T16:30:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient(hunting): my global_id is 4544 2024-09-10T16:30:40.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 1 -- 172.21.15.81:0/143818282 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c2c136240 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 1 -- 172.21.15.81:0/143818282 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 161044120 0 0) 0x7f6c18003530 con 0x7f6c2c135610 2024-09-10T16:30:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 1 -- 172.21.15.81:0/143818282 >> v1:172.21.15.81:6793/0 conn(0x7f6c2c13f5b0 legacy=0x7f6c2c1419a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 1 -- 172.21.15.81:0/143818282 >> v1:172.21.15.189:6790/0 conn(0x7f6c2c0a5c60 legacy=0x7f6c2c13de90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:30:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient: _finish_hunting 0 2024-09-10T16:30:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 1 monclient: found mon.noname-a 2024-09-10T16:30:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:30:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 1 -- 172.21.15.81:0/143818282 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c09da00 con 0x7f6c2c135610 2024-09-10T16:30:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient: _finish_auth 0 2024-09-10T16:30:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient: _check_auth_tickets 2024-09-10T16:30:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 1 -- 172.21.15.81:0/143818282 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6c24001770 con 0x7f6c2c135610 2024-09-10T16:30:40.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 5 monclient: authenticate success, global_id 4671 2024-09-10T16:30:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:30:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient: dump: 2024-09-10T16:30:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:40.148 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:40.149 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:30:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 1 -- 172.21.15.81:0/143818282 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c24001990 con 0x7f6c2c135610 2024-09-10T16:30:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 10 monclient: get_monmap_and_config success 2024-09-10T16:30:40.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 1 -- 172.21.15.81:0/143818282 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6c24004b30 con 0x7f6c2c135610 2024-09-10T16:30:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 4 set_mon_vals no callback set 2024-09-10T16:30:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c2959a640 10 monclient: dump: 2024-09-10T16:30:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:40.150 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:40.151 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 10 monclient: shutdown 2024-09-10T16:30:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 1 -- 172.21.15.81:0/143818282 >> v1:172.21.15.81:6789/0 conn(0x7f6c2c135610 legacy=0x7f6c2c0a5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 1 -- 172.21.15.81:0/143818282 shutdown_connections 2024-09-10T16:30:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 1 -- 172.21.15.81:0/143818282 >> 172.21.15.81:0/143818282 conn(0x7f6c2c06db50 msgr2=0x7f6c2c0ab9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 1 -- 172.21.15.81:0/143818282 shutdown_connections 2024-09-10T16:30:40.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.134+0000 7f6c30f24640 1 -- 172.21.15.81:0/143818282 wait complete. 2024-09-10T16:30:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 monclient: build_initial_monmap 2024-09-10T16:30:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 monclient: monmap: 2024-09-10T16:30:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:30:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:30:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:30:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:30:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:30:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:30:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:30:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:30:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:30:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:30:40.152 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:30:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:30:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:30:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:30:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:30:40.153 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 1 Processor -- start 2024-09-10T16:30:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 1 -- start start 2024-09-10T16:30:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 monclient: init 2024-09-10T16:30:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 monclient: _reopen_session rank -1 2024-09-10T16:30:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 monclient: _add_conns ranks=[7,0,8,1,5,4,2,3,6] 2024-09-10T16:30:40.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 monclient(hunting): picked mon.noname-i con 0x7f6c2c0a5c60 addr v1:172.21.15.189:6792/0 2024-09-10T16:30:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 monclient(hunting): picked mon.noname-a con 0x7f6c2c135610 addr v1:172.21.15.81:6789/0 2024-09-10T16:30:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 monclient(hunting): picked mon.noname-e con 0x7f6c2c13f5b0 addr v1:172.21.15.81:6793/0 2024-09-10T16:30:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2c142b50 con 0x7f6c2c135610 2024-09-10T16:30:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2c13d980 con 0x7f6c2c0a5c60 2024-09-10T16:30:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c2c1ce240 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 monclient(hunting): _renew_subs 2024-09-10T16:30:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 monclient(hunting): authenticate will time out at 1007.540909s 2024-09-10T16:30:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c29d9b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f6c2c135610 0x7f6c2c1cdb30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:33408/0 (socket says 172.21.15.81:33408) 2024-09-10T16:30:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c2ad9d640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f6c2c13f5b0 0x7f6c2c1d59d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:47408/0 (socket says 172.21.15.81:47408) 2024-09-10T16:30:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c29d9b640 1 -- 172.21.15.81:0/2726738861 learned_addr learned my addr 172.21.15.81:0/2726738861 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:30:40.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156742840 0 0) 0x7f6c14003ae0 con 0x7f6c2c135610 2024-09-10T16:30:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): my global_id is 4680 2024-09-10T16:30:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c0c003530 con 0x7f6c2c135610 2024-09-10T16:30:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2757957282 0 0) 0x7f6c2c1ce240 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): my global_id is 4553 2024-09-10T16:30:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c14003ae0 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3899141298 0 0) 0x7f6c14003ae0 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c2c1ce240 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1683158217 0 0) 0x7f6c0c003530 con 0x7f6c2c135610 2024-09-10T16:30:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c14003ae0 con 0x7f6c2c135610 2024-09-10T16:30:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6c1c0018e0 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:30:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:40.156 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:40.157 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:40.157 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:30:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6c14004550 con 0x7f6c2c135610 2024-09-10T16:30:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:30:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:30:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): dump: 2024-09-10T16:30:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:40.158 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:40.159 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3596691017 0 0) 0x7f6c2c13d980 con 0x7f6c2c0a5c60 2024-09-10T16:30:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): my global_id is 4570 2024-09-10T16:30:40.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c0c003530 con 0x7f6c2c0a5c60 2024-09-10T16:30:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4031122766 0 0) 0x7f6c2c1ce240 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 >> v1:172.21.15.189:6792/0 conn(0x7f6c2c0a5c60 legacy=0x7f6c2c1cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 >> v1:172.21.15.81:6789/0 conn(0x7f6c2c135610 legacy=0x7f6c2c1cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:30:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 monclient: found mon.e 2024-09-10T16:30:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:30:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c2c13b900 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient: _finish_auth 0 2024-09-10T16:30:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:30:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:30:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 5 monclient: authenticate success, global_id 4553 2024-09-10T16:30:40.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 monclient: _renew_subs 2024-09-10T16:30:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6c2c13d3c0 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 monclient: _renew_subs 2024-09-10T16:30:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:30:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f6c2c13e3e0 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6c1c001b40 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:30:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6c1c005160 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c28d99640 4 set_mon_vals no callback set 2024-09-10T16:30:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:30:40.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient: dump: 2024-09-10T16:30:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:40.163 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c30f24640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6c100065d0 con 0x7f6c10002870 2024-09-10T16:30:40.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f6c1c011070 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(25..25 src has 1..25) ==== 3898+0+0 (unknown 4255508053 0 0) 0x7f6c1c04b150 con 0x7f6c2c13f5b0 2024-09-10T16:30:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1237731226 0 0) 0x7f6c100065d0 con 0x7f6c10002870 2024-09-10T16:30:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient(hunting): my global_id is 4579 2024-09-10T16:30:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c2c1ce240 con 0x7f6c10002870 2024-09-10T16:30:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c29d9b640 10 monclient: get_auth_request con 0x7f6c0c03d630 auth_method 0 2024-09-10T16:30:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3578512106 0 0) 0x7f6c2c1ce240 con 0x7f6c10002870 2024-09-10T16:30:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c100065d0 con 0x7f6c10002870 2024-09-10T16:30:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6c24001730 con 0x7f6c10002870 2024-09-10T16:30:40.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:30:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.138+0000 7f6c22ffd640 10 monclient: dump: 2024-09-10T16:30:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:40.165 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:40.166 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.142+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1048057624 0 0) 0x7f6c100065d0 con 0x7f6c10002870 2024-09-10T16:30:40.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.142+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.189:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6c1000a170 con 0x7f6c10002870 2024-09-10T16:30:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.142+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.7 v1:172.21.15.189:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6c240049e0 con 0x7f6c10002870 2024-09-10T16:30:40.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.142+0000 7f6c22ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:30:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.142+0000 7f6c22ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:30:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.142+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 >> v1:172.21.15.189:6792/0 conn(0x7f6c10002870 legacy=0x7f6c10004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.142+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 >> v1:172.21.15.189:6792/0 conn(0x7f6c10002870 legacy=0x7f6c10004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.146+0000 7f6c30f24640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:30:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.146+0000 7f6c30f24640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6c10009e80 con 0x7f6c10009140 2024-09-10T16:30:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3855319147 0 0) 0x7f6c10009e80 con 0x7f6c10009140 2024-09-10T16:30:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:30:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:30:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:30:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 10 monclient(hunting): my global_id is 4588 2024-09-10T16:30:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6c100065d0 con 0x7f6c10009140 2024-09-10T16:30:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1810166153 0 0) 0x7f6c100065d0 con 0x7f6c10009140 2024-09-10T16:30:40.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6c10009e80 con 0x7f6c10009140 2024-09-10T16:30:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6c24001c80 con 0x7f6c10009140 2024-09-10T16:30:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:30:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:30:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 10 monclient: dump: 2024-09-10T16:30:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:30:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:30:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:30:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:30:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:30:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:30:40.169 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:30:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:30:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:30:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:30:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:30:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:30:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:30:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:30:40.170 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:30:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1668484778 0 0) 0x7f6c10009e80 con 0x7f6c10009140 2024-09-10T16:30:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 --> v1:172.21.15.189:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f6c1000c420 con 0x7f6c10009140 2024-09-10T16:30:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 <== mon.7 v1:172.21.15.189:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7699 (unknown 0 0 1470557360) 0x7f6c24005340 con 0x7f6c10009140 2024-09-10T16:30:40.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:30:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:30:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 >> v1:172.21.15.189:6792/0 conn(0x7f6c10009140 legacy=0x7f6c100095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:40.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c22ffd640 1 -- 172.21.15.81:0/2726738861 >> v1:172.21.15.189:6792/0 conn(0x7f6c10009140 legacy=0x7f6c100095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:30:40.171 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:30:40.171 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:40.171 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:40.171 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:30:40.171 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 12, 2024-09-10T16:30:40.171 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 50083, 2024-09-10T16:30:40.171 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:30:40.172 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:30:40.172 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:30:40.172 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:30:40.172 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:30:40.172 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:30:40.172 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:30:40.172 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:30:40.172 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:30:40.172 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:40.172 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:30:40.172 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:40.173 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:30:40.173 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:30:40.173 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:40.173 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:40.173 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:40.173 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:40.173 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:40.173 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:40.173 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:40.173 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:40.173 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:40.173 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:40.173 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:40.174 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:40.174 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:30:40.174 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:30:40.174 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:40.174 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:40.174 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:40.174 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:40.174 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:40.174 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:40.174 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:40.174 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:40.174 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:40.175 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:40.175 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:40.175 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.175 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:30:40.175 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:30:40.175 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:30:40.175 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:30:40.175 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:30:40.175 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:30:40.175 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:40.175 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:30:40.175 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:30:40.176 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:30:40.176 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:30:40.176 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:30:40.176 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:30:40.176 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:30:40.176 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:30:40.176 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:30:40.176 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:30:40.176 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:30:40.176 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:30:40.176 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:30:40.176 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:30:40.177 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:30:40.177 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:30:40.177 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:30:40.177 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:30:40.177 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:30:40.177 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:30:40.177 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:30:40.177 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:40.177 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:30:40.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.177 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:30:40.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.177 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:30:40.178 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:30:40.178 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.178 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.178 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:30:40.178 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.178 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.178 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:30:40.178 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:30:40.179 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.179 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.179 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.179 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:30:40.179 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:30:40.179 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:30:40.179 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.180 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.180 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:30:40.180 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:30:40.180 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.180 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.180 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.180 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.180 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:30:40.180 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:30:40.180 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.181 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.181 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:30:40.181 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.181 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.181 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.182 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:30:40.182 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:30:40.182 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.182 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.182 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.182 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.182 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:30:40.182 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:30:40.183 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:30:40.183 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.183 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.183 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:30:40.183 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:30:40.183 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:30:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:30:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:30:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:30:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:30:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:30:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:30:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:30:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:30:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:30:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.186 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:30:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:30:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:30:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:30:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:30:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:30:40.188 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:30:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:30:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:30:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:30:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.190 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:30:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:30:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:30:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:30:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:30:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:30:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:30:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:30:40.191 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:30:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:30:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:30:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:30:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:30:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:30:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:40.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:30:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:30:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:30:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:30:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:30:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:30:40.193 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:30:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:30:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:30:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:30:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:30:40.194 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:30:40.194 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:30:40.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c30f24640 1 -- 172.21.15.81:0/2726738861 >> v1:172.21.15.189:6812/1108603242 conn(0x7f6c0c03d630 legacy=0x7f6c0c03faf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:40.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c30f24640 10 monclient: shutdown 2024-09-10T16:30:40.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c30f24640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:30:40.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c30f24640 1 -- 172.21.15.81:0/2726738861 >> v1:172.21.15.81:6793/0 conn(0x7f6c2c13f5b0 legacy=0x7f6c2c1d59d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:30:40.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c2ad9d640 1 -- 172.21.15.81:0/2726738861 reap_dead start 2024-09-10T16:30:40.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c2ad9d640 1 -- 172.21.15.81:0/2726738861 reap_dead start 2024-09-10T16:30:40.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c30f24640 1 -- 172.21.15.81:0/2726738861 shutdown_connections 2024-09-10T16:30:40.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c30f24640 1 -- 172.21.15.81:0/2726738861 >> 172.21.15.81:0/2726738861 conn(0x7f6c2c06db50 msgr2=0x7f6c2c138710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:30:40.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c30f24640 1 -- 172.21.15.81:0/2726738861 shutdown_connections 2024-09-10T16:30:40.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:30:40.150+0000 7f6c30f24640 1 -- 172.21.15.81:0/2726738861 wait complete. 2024-09-10T16:30:40.196 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 8 2024-09-10T16:30:40.196 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-09-10T16:30:40.680 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:40.680 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28345]: starting. 2024-09-10T16:30:40.680 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28345]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28310 2024-09-10T16:30:40.680 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28345]: created object 0... 2024-09-10T16:30:40.681 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28345]: created object 25... 2024-09-10T16:30:40.681 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28345]: created object 49... 2024-09-10T16:30:40.681 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28345]: finishing. 2024-09-10T16:30:40.681 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28345]: shutting down. 2024-09-10T16:30:40.707 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:40.707 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28347]: starting. 2024-09-10T16:30:40.707 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28347]: listing objects. 2024-09-10T16:30:40.707 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28347]: listed object 0... 2024-09-10T16:30:40.707 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28347]: listed object 25... 2024-09-10T16:30:40.708 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28347]: saw 50 objects 2024-09-10T16:30:40.708 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28347]: shutting down. 2024-09-10T16:30:41.520 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:41.520 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28346]: starting. 2024-09-10T16:30:41.520 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28346]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28310 2024-09-10T16:30:41.520 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28346]: shutting down. 2024-09-10T16:30:41.523 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:41.523 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:41.523 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:30:41.526 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:30:43.707 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28398]: starting. 2024-09-10T16:30:43.707 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28398]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28397 2024-09-10T16:30:43.707 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28398]: created object 0... 2024-09-10T16:30:43.707 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28398]: created object 25... 2024-09-10T16:30:43.707 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28398]: created object 49... 2024-09-10T16:30:43.707 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28398]: finishing. 2024-09-10T16:30:43.707 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28398]: shutting down. 2024-09-10T16:30:44.564 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28399]: starting. 2024-09-10T16:30:44.564 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28399]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28397 2024-09-10T16:30:44.564 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28399]: shutting down. 2024-09-10T16:30:46.798 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:46.798 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28432]: starting. 2024-09-10T16:30:46.798 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28432]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28397 2024-09-10T16:30:46.799 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28432]: created object 0... 2024-09-10T16:30:46.799 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28432]: created object 25... 2024-09-10T16:30:46.799 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28432]: created object 49... 2024-09-10T16:30:46.799 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28432]: finishing. 2024-09-10T16:30:46.799 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28432]: shutting down. 2024-09-10T16:30:46.823 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:46.823 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28434]: starting. 2024-09-10T16:30:46.823 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28434]: listing objects. 2024-09-10T16:30:46.823 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28434]: listed object 0... 2024-09-10T16:30:46.823 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28434]: listed object 25... 2024-09-10T16:30:46.823 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28434]: saw 50 objects 2024-09-10T16:30:46.824 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28434]: shutting down. 2024-09-10T16:30:47.628 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:47.628 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28433]: starting. 2024-09-10T16:30:47.628 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28433]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28397 2024-09-10T16:30:47.628 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28433]: shutting down. 2024-09-10T16:30:47.633 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:47.633 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:47.633 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:30:47.636 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:30:49.857 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28485]: starting. 2024-09-10T16:30:49.857 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28485]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28484 2024-09-10T16:30:49.857 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28485]: created object 0... 2024-09-10T16:30:49.857 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28485]: created object 25... 2024-09-10T16:30:49.858 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28485]: created object 49... 2024-09-10T16:30:49.858 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28485]: finishing. 2024-09-10T16:30:49.858 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28485]: shutting down. 2024-09-10T16:30:50.679 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28486]: starting. 2024-09-10T16:30:50.679 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28486]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28484 2024-09-10T16:30:50.679 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28486]: shutting down. 2024-09-10T16:30:52.880 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:52.880 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28519]: starting. 2024-09-10T16:30:52.880 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28519]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28484 2024-09-10T16:30:52.880 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28519]: created object 0... 2024-09-10T16:30:52.880 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28519]: created object 25... 2024-09-10T16:30:52.880 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28519]: created object 49... 2024-09-10T16:30:52.880 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28519]: finishing. 2024-09-10T16:30:52.880 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28519]: shutting down. 2024-09-10T16:30:52.906 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:52.906 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28521]: starting. 2024-09-10T16:30:52.906 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28521]: listing objects. 2024-09-10T16:30:52.906 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28521]: listed object 0... 2024-09-10T16:30:52.906 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28521]: listed object 25... 2024-09-10T16:30:52.906 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28521]: saw 50 objects 2024-09-10T16:30:52.906 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28521]: shutting down. 2024-09-10T16:30:53.712 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:53.713 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28520]: starting. 2024-09-10T16:30:53.713 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28520]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28484 2024-09-10T16:30:53.713 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28520]: shutting down. 2024-09-10T16:30:53.716 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:53.716 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:53.716 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:30:53.721 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:30:55.910 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28572]: starting. 2024-09-10T16:30:55.910 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28572]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28571 2024-09-10T16:30:55.910 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28572]: created object 0... 2024-09-10T16:30:55.911 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28572]: created object 25... 2024-09-10T16:30:55.911 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28572]: created object 49... 2024-09-10T16:30:55.911 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28572]: finishing. 2024-09-10T16:30:55.911 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28572]: shutting down. 2024-09-10T16:30:56.762 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28573]: starting. 2024-09-10T16:30:56.763 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28573]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28571 2024-09-10T16:30:56.763 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28573]: shutting down. 2024-09-10T16:30:58.978 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:58.978 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28606]: starting. 2024-09-10T16:30:58.978 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28606]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28571 2024-09-10T16:30:58.978 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28606]: created object 0... 2024-09-10T16:30:58.978 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28606]: created object 25... 2024-09-10T16:30:58.978 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28606]: created object 49... 2024-09-10T16:30:58.978 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28606]: finishing. 2024-09-10T16:30:58.978 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28606]: shutting down. 2024-09-10T16:30:59.009 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:59.009 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28608]: starting. 2024-09-10T16:30:59.009 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28608]: listing objects. 2024-09-10T16:30:59.009 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28608]: listed object 0... 2024-09-10T16:30:59.009 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28608]: listed object 25... 2024-09-10T16:30:59.010 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28608]: saw 50 objects 2024-09-10T16:30:59.010 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28608]: shutting down. 2024-09-10T16:30:59.801 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:59.801 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28607]: starting. 2024-09-10T16:30:59.801 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28607]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28571 2024-09-10T16:30:59.801 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28607]: shutting down. 2024-09-10T16:30:59.804 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:59.804 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:30:59.804 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:30:59.807 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:31:01.281 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28659]: starting. 2024-09-10T16:31:01.281 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28659]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28658 2024-09-10T16:31:01.281 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28659]: created object 0... 2024-09-10T16:31:01.281 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28659]: created object 25... 2024-09-10T16:31:01.281 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28659]: created object 49... 2024-09-10T16:31:01.281 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28659]: finishing. 2024-09-10T16:31:01.282 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28659]: shutting down. 2024-09-10T16:31:02.119 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28660]: starting. 2024-09-10T16:31:02.119 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28660]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28658 2024-09-10T16:31:02.119 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28660]: shutting down. 2024-09-10T16:31:04.318 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:04.318 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28693]: starting. 2024-09-10T16:31:04.319 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28693]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28658 2024-09-10T16:31:04.319 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28693]: created object 0... 2024-09-10T16:31:04.319 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28693]: created object 25... 2024-09-10T16:31:04.319 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28693]: created object 49... 2024-09-10T16:31:04.319 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28693]: finishing. 2024-09-10T16:31:04.319 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28693]: shutting down. 2024-09-10T16:31:04.346 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:04.346 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28695]: starting. 2024-09-10T16:31:04.346 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28695]: listing objects. 2024-09-10T16:31:04.346 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28695]: listed object 0... 2024-09-10T16:31:04.346 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28695]: listed object 25... 2024-09-10T16:31:04.346 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28695]: saw 50 objects 2024-09-10T16:31:04.346 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28695]: shutting down. 2024-09-10T16:31:05.093 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:05.093 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28694]: starting. 2024-09-10T16:31:05.093 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28694]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28658 2024-09-10T16:31:05.093 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28694]: shutting down. 2024-09-10T16:31:05.097 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:05.097 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:05.097 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:31:05.101 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:31:07.372 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28746]: starting. 2024-09-10T16:31:07.372 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28746]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28745 2024-09-10T16:31:07.372 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28746]: created object 0... 2024-09-10T16:31:07.372 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28746]: created object 25... 2024-09-10T16:31:07.372 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28746]: created object 49... 2024-09-10T16:31:07.372 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28746]: finishing. 2024-09-10T16:31:07.373 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28746]: shutting down. 2024-09-10T16:31:08.185 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28747]: starting. 2024-09-10T16:31:08.185 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28747]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28745 2024-09-10T16:31:08.185 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28747]: shutting down. 2024-09-10T16:31:10.395 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:10.395 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28780]: starting. 2024-09-10T16:31:10.395 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28780]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28745 2024-09-10T16:31:10.395 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28780]: created object 0... 2024-09-10T16:31:10.396 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28780]: created object 25... 2024-09-10T16:31:10.396 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28780]: created object 49... 2024-09-10T16:31:10.396 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28780]: finishing. 2024-09-10T16:31:10.396 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28780]: shutting down. 2024-09-10T16:31:10.420 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:10.420 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28782]: starting. 2024-09-10T16:31:10.420 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28782]: listing objects. 2024-09-10T16:31:10.420 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28782]: listed object 0... 2024-09-10T16:31:10.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28782]: listed object 25... 2024-09-10T16:31:10.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28782]: saw 50 objects 2024-09-10T16:31:10.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28782]: shutting down. 2024-09-10T16:31:11.267 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:11.267 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28781]: starting. 2024-09-10T16:31:11.268 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28781]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28745 2024-09-10T16:31:11.268 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28781]: shutting down. 2024-09-10T16:31:11.270 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:11.270 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:11.270 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:31:11.273 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:31:13.470 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28833]: starting. 2024-09-10T16:31:13.470 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28833]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28832 2024-09-10T16:31:13.470 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28833]: created object 0... 2024-09-10T16:31:13.470 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28833]: created object 25... 2024-09-10T16:31:13.470 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28833]: created object 49... 2024-09-10T16:31:13.470 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28833]: finishing. 2024-09-10T16:31:13.470 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28833]: shutting down. 2024-09-10T16:31:14.283 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28834]: starting. 2024-09-10T16:31:14.284 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28834]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28832 2024-09-10T16:31:14.284 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28834]: shutting down. 2024-09-10T16:31:16.268 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:16.268 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28867]: starting. 2024-09-10T16:31:16.269 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28867]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28832 2024-09-10T16:31:16.269 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28867]: created object 0... 2024-09-10T16:31:16.269 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28867]: created object 25... 2024-09-10T16:31:16.269 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28867]: created object 49... 2024-09-10T16:31:16.269 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28867]: finishing. 2024-09-10T16:31:16.269 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28867]: shutting down. 2024-09-10T16:31:16.296 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:16.297 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28869]: starting. 2024-09-10T16:31:16.297 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28869]: listing objects. 2024-09-10T16:31:16.297 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28869]: listed object 0... 2024-09-10T16:31:16.297 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28869]: listed object 25... 2024-09-10T16:31:16.297 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28869]: saw 50 objects 2024-09-10T16:31:16.297 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28869]: shutting down. 2024-09-10T16:31:17.120 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:17.120 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28868]: starting. 2024-09-10T16:31:17.120 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28868]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28832 2024-09-10T16:31:17.120 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28868]: shutting down. 2024-09-10T16:31:17.123 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:17.124 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:17.124 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:31:17.127 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:31:19.302 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28920]: starting. 2024-09-10T16:31:19.302 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28920]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28919 2024-09-10T16:31:19.302 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28920]: created object 0... 2024-09-10T16:31:19.302 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28920]: created object 25... 2024-09-10T16:31:19.303 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28920]: created object 49... 2024-09-10T16:31:19.303 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28920]: finishing. 2024-09-10T16:31:19.303 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[28920]: shutting down. 2024-09-10T16:31:20.134 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28921]: starting. 2024-09-10T16:31:20.135 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28921]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28919 2024-09-10T16:31:20.135 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[28921]: shutting down. 2024-09-10T16:31:22.338 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:22.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28954]: starting. 2024-09-10T16:31:22.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28954]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-28919 2024-09-10T16:31:22.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28954]: created object 0... 2024-09-10T16:31:22.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28954]: created object 25... 2024-09-10T16:31:22.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28954]: created object 49... 2024-09-10T16:31:22.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28954]: finishing. 2024-09-10T16:31:22.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[28954]: shutting down. 2024-09-10T16:31:22.368 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:22.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28956]: starting. 2024-09-10T16:31:22.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28956]: listing objects. 2024-09-10T16:31:22.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28956]: listed object 0... 2024-09-10T16:31:22.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28956]: listed object 25... 2024-09-10T16:31:22.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28956]: saw 50 objects 2024-09-10T16:31:22.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[28956]: shutting down. 2024-09-10T16:31:23.181 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:23.182 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28955]: starting. 2024-09-10T16:31:23.182 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28955]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-28919 2024-09-10T16:31:23.182 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[28955]: shutting down. 2024-09-10T16:31:23.184 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:23.184 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:23.185 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:31:23.187 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:31:25.261 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29007]: starting. 2024-09-10T16:31:25.261 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29007]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29006 2024-09-10T16:31:25.261 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29007]: created object 0... 2024-09-10T16:31:25.261 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29007]: created object 25... 2024-09-10T16:31:25.261 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29007]: created object 49... 2024-09-10T16:31:25.262 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29007]: finishing. 2024-09-10T16:31:25.262 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29007]: shutting down. 2024-09-10T16:31:26.130 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29008]: starting. 2024-09-10T16:31:26.131 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29008]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29006 2024-09-10T16:31:26.131 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29008]: shutting down. 2024-09-10T16:31:28.349 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:28.349 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29041]: starting. 2024-09-10T16:31:28.349 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29041]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29006 2024-09-10T16:31:28.349 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29041]: created object 0... 2024-09-10T16:31:28.349 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29041]: created object 25... 2024-09-10T16:31:28.350 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29041]: created object 49... 2024-09-10T16:31:28.350 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29041]: finishing. 2024-09-10T16:31:28.350 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29041]: shutting down. 2024-09-10T16:31:28.376 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:28.376 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29043]: starting. 2024-09-10T16:31:28.376 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29043]: listing objects. 2024-09-10T16:31:28.376 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29043]: listed object 0... 2024-09-10T16:31:28.377 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29043]: listed object 25... 2024-09-10T16:31:28.377 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29043]: saw 50 objects 2024-09-10T16:31:28.377 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29043]: shutting down. 2024-09-10T16:31:29.176 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:29.176 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29042]: starting. 2024-09-10T16:31:29.177 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29042]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29006 2024-09-10T16:31:29.177 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29042]: shutting down. 2024-09-10T16:31:29.180 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:29.180 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:29.180 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:31:29.186 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:31:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29094]: starting. 2024-09-10T16:31:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29094]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29093 2024-09-10T16:31:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29094]: created object 0... 2024-09-10T16:31:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29094]: created object 25... 2024-09-10T16:31:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29094]: created object 49... 2024-09-10T16:31:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29094]: finishing. 2024-09-10T16:31:31.378 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29094]: shutting down. 2024-09-10T16:31:32.210 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29095]: starting. 2024-09-10T16:31:32.211 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29095]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29093 2024-09-10T16:31:32.211 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29095]: shutting down. 2024-09-10T16:31:34.421 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:34.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29128]: starting. 2024-09-10T16:31:34.422 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29128]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29093 2024-09-10T16:31:34.422 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29128]: created object 0... 2024-09-10T16:31:34.422 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29128]: created object 25... 2024-09-10T16:31:34.422 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29128]: created object 49... 2024-09-10T16:31:34.422 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29128]: finishing. 2024-09-10T16:31:34.422 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29128]: shutting down. 2024-09-10T16:31:34.449 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:34.449 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29130]: starting. 2024-09-10T16:31:34.450 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29130]: listing objects. 2024-09-10T16:31:34.450 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29130]: listed object 0... 2024-09-10T16:31:34.450 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29130]: listed object 25... 2024-09-10T16:31:34.450 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29130]: saw 50 objects 2024-09-10T16:31:34.450 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29130]: shutting down. 2024-09-10T16:31:35.104 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:35.104 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29129]: starting. 2024-09-10T16:31:35.104 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29129]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29093 2024-09-10T16:31:35.104 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29129]: shutting down. 2024-09-10T16:31:35.109 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:35.109 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:35.109 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:31:35.113 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:31:38.185 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29181]: starting. 2024-09-10T16:31:38.185 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29181]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29180 2024-09-10T16:31:38.185 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29181]: created object 0... 2024-09-10T16:31:38.185 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29181]: created object 25... 2024-09-10T16:31:38.186 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29181]: created object 49... 2024-09-10T16:31:38.186 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29181]: finishing. 2024-09-10T16:31:38.186 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29181]: shutting down. 2024-09-10T16:31:39.143 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29182]: starting. 2024-09-10T16:31:39.143 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29182]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29180 2024-09-10T16:31:39.144 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29182]: shutting down. 2024-09-10T16:31:41.264 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:41.264 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29215]: starting. 2024-09-10T16:31:41.265 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29215]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29180 2024-09-10T16:31:41.265 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29215]: created object 0... 2024-09-10T16:31:41.265 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29215]: created object 25... 2024-09-10T16:31:41.265 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29215]: created object 49... 2024-09-10T16:31:41.265 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29215]: finishing. 2024-09-10T16:31:41.265 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29215]: shutting down. 2024-09-10T16:31:41.287 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:41.287 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29217]: starting. 2024-09-10T16:31:41.287 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29217]: listing objects. 2024-09-10T16:31:41.287 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29217]: listed object 0... 2024-09-10T16:31:41.287 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29217]: listed object 25... 2024-09-10T16:31:41.287 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29217]: saw 50 objects 2024-09-10T16:31:41.288 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29217]: shutting down. 2024-09-10T16:31:42.139 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:42.139 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29216]: starting. 2024-09-10T16:31:42.139 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29216]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29180 2024-09-10T16:31:42.139 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29216]: shutting down. 2024-09-10T16:31:42.142 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:42.142 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:42.142 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:31:42.147 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:31:44.293 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29268]: starting. 2024-09-10T16:31:44.293 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29268]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29267 2024-09-10T16:31:44.293 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29268]: created object 0... 2024-09-10T16:31:44.294 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29268]: created object 25... 2024-09-10T16:31:44.294 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29268]: created object 49... 2024-09-10T16:31:44.294 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29268]: finishing. 2024-09-10T16:31:44.294 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29268]: shutting down. 2024-09-10T16:31:45.109 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29269]: starting. 2024-09-10T16:31:45.110 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29269]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29267 2024-09-10T16:31:45.110 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29269]: shutting down. 2024-09-10T16:31:47.289 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:47.289 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29302]: starting. 2024-09-10T16:31:47.289 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29302]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29267 2024-09-10T16:31:47.289 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29302]: created object 0... 2024-09-10T16:31:47.289 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29302]: created object 25... 2024-09-10T16:31:47.289 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29302]: created object 49... 2024-09-10T16:31:47.290 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29302]: finishing. 2024-09-10T16:31:47.290 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29302]: shutting down. 2024-09-10T16:31:47.314 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:47.314 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29304]: starting. 2024-09-10T16:31:47.314 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29304]: listing objects. 2024-09-10T16:31:47.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29304]: listed object 0... 2024-09-10T16:31:47.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29304]: listed object 25... 2024-09-10T16:31:47.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29304]: saw 50 objects 2024-09-10T16:31:47.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29304]: shutting down. 2024-09-10T16:31:48.124 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:48.124 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29303]: starting. 2024-09-10T16:31:48.124 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29303]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29267 2024-09-10T16:31:48.124 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29303]: shutting down. 2024-09-10T16:31:48.127 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:48.127 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:48.127 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:31:48.130 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:31:50.297 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29355]: starting. 2024-09-10T16:31:50.298 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29355]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29354 2024-09-10T16:31:50.298 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29355]: created object 0... 2024-09-10T16:31:50.298 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29355]: created object 25... 2024-09-10T16:31:50.298 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29355]: created object 49... 2024-09-10T16:31:50.298 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29355]: finishing. 2024-09-10T16:31:50.298 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29355]: shutting down. 2024-09-10T16:31:51.161 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29356]: starting. 2024-09-10T16:31:51.161 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29356]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29354 2024-09-10T16:31:51.161 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29356]: shutting down. 2024-09-10T16:31:53.348 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:53.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29389]: starting. 2024-09-10T16:31:53.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29389]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29354 2024-09-10T16:31:53.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29389]: created object 0... 2024-09-10T16:31:53.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29389]: created object 25... 2024-09-10T16:31:53.349 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29389]: created object 49... 2024-09-10T16:31:53.349 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29389]: finishing. 2024-09-10T16:31:53.349 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29389]: shutting down. 2024-09-10T16:31:53.377 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:53.377 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29391]: starting. 2024-09-10T16:31:53.377 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29391]: listing objects. 2024-09-10T16:31:53.377 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29391]: listed object 0... 2024-09-10T16:31:53.377 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29391]: listed object 25... 2024-09-10T16:31:53.380 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29391]: saw 50 objects 2024-09-10T16:31:53.380 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29391]: shutting down. 2024-09-10T16:31:54.165 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:54.165 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29390]: starting. 2024-09-10T16:31:54.165 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29390]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29354 2024-09-10T16:31:54.165 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29390]: shutting down. 2024-09-10T16:31:54.166 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:54.166 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:54.166 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:31:54.169 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:31:56.296 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29442]: starting. 2024-09-10T16:31:56.296 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29442]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29441 2024-09-10T16:31:56.296 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29442]: created object 0... 2024-09-10T16:31:56.296 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29442]: created object 25... 2024-09-10T16:31:56.296 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29442]: created object 49... 2024-09-10T16:31:56.297 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29442]: finishing. 2024-09-10T16:31:56.297 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29442]: shutting down. 2024-09-10T16:31:57.118 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29443]: starting. 2024-09-10T16:31:57.118 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29443]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29441 2024-09-10T16:31:57.118 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29443]: shutting down. 2024-09-10T16:31:59.289 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:59.289 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29476]: starting. 2024-09-10T16:31:59.289 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29476]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29441 2024-09-10T16:31:59.290 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29476]: created object 0... 2024-09-10T16:31:59.290 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29476]: created object 25... 2024-09-10T16:31:59.290 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29476]: created object 49... 2024-09-10T16:31:59.290 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29476]: finishing. 2024-09-10T16:31:59.290 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29476]: shutting down. 2024-09-10T16:31:59.314 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:31:59.331 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29478]: starting. 2024-09-10T16:31:59.331 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29478]: listing objects. 2024-09-10T16:31:59.331 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29478]: listed object 0... 2024-09-10T16:31:59.331 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29478]: listed object 25... 2024-09-10T16:31:59.331 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29478]: saw 50 objects 2024-09-10T16:31:59.331 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29478]: shutting down. 2024-09-10T16:32:00.132 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:00.133 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29477]: starting. 2024-09-10T16:32:00.133 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29477]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29441 2024-09-10T16:32:00.133 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29477]: shutting down. 2024-09-10T16:32:00.136 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:00.136 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:00.136 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:32:00.139 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:32:02.302 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29529]: starting. 2024-09-10T16:32:02.302 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29529]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29528 2024-09-10T16:32:02.302 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29529]: created object 0... 2024-09-10T16:32:02.302 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29529]: created object 25... 2024-09-10T16:32:02.302 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29529]: created object 49... 2024-09-10T16:32:02.302 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29529]: finishing. 2024-09-10T16:32:02.302 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29529]: shutting down. 2024-09-10T16:32:03.177 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29530]: starting. 2024-09-10T16:32:03.177 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29530]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29528 2024-09-10T16:32:03.177 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29530]: shutting down. 2024-09-10T16:32:05.304 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:05.304 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29563]: starting. 2024-09-10T16:32:05.304 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29563]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29528 2024-09-10T16:32:05.304 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29563]: created object 0... 2024-09-10T16:32:05.305 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29563]: created object 25... 2024-09-10T16:32:05.305 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29563]: created object 49... 2024-09-10T16:32:05.305 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29563]: finishing. 2024-09-10T16:32:05.305 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29563]: shutting down. 2024-09-10T16:32:05.330 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:05.330 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29565]: starting. 2024-09-10T16:32:05.330 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29565]: listing objects. 2024-09-10T16:32:05.330 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29565]: listed object 0... 2024-09-10T16:32:05.330 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29565]: listed object 25... 2024-09-10T16:32:05.330 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29565]: saw 50 objects 2024-09-10T16:32:05.330 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29565]: shutting down. 2024-09-10T16:32:06.119 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:06.119 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29564]: starting. 2024-09-10T16:32:06.120 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29564]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29528 2024-09-10T16:32:06.120 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29564]: shutting down. 2024-09-10T16:32:06.121 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:06.121 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:06.121 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:32:06.125 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:32:08.313 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29616]: starting. 2024-09-10T16:32:08.313 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29616]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29615 2024-09-10T16:32:08.313 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29616]: created object 0... 2024-09-10T16:32:08.313 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29616]: created object 25... 2024-09-10T16:32:08.313 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29616]: created object 49... 2024-09-10T16:32:08.313 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29616]: finishing. 2024-09-10T16:32:08.313 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29616]: shutting down. 2024-09-10T16:32:09.147 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29617]: starting. 2024-09-10T16:32:09.147 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29617]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29615 2024-09-10T16:32:09.147 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29617]: shutting down. 2024-09-10T16:32:10.197 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2024-09-10T16:32:10.197 INFO:tasks.ceph.mon.g:Restarting daemon 2024-09-10T16:32:10.198 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-09-10T16:32:10.201 INFO:tasks.ceph.mon.g:Started 2024-09-10T16:32:10.201 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-10T16:32:10.201 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T16:32:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 10 monclient: get_monmap_and_config 2024-09-10T16:32:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 10 monclient: build_initial_monmap 2024-09-10T16:32:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 10 monclient: monmap: 2024-09-10T16:32:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:10.327907+0000 2024-09-10T16:32:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:10.327907+0000 2024-09-10T16:32:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.328 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:10.329 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:10.329 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 1 Processor -- start 2024-09-10T16:32:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 1 -- start start 2024-09-10T16:32:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 10 monclient: init 2024-09-10T16:32:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 10 monclient: _add_conns ranks=[8,7,3,2,5,1,0,4,6] 2024-09-10T16:32:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 10 monclient(hunting): picked mon.noname-e con 0x7f646809d440 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:10.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 10 monclient(hunting): picked mon.noname-i con 0x7f64680a39e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 10 monclient(hunting): picked mon.noname-g con 0x7f64680a0900 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64680a37a0 con 0x7f64680a0900 2024-09-10T16:32:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6468074d30 con 0x7f64680a39e0 2024-09-10T16:32:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f646809d820 con 0x7f646809d440 2024-09-10T16:32:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646f8e4640 10 monclient(hunting): authenticate will time out at 1097.727565s 2024-09-10T16:32:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646d680640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f646809d440 0x7f646809fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:46702/0 (socket says 172.21.15.81:46702) 2024-09-10T16:32:10.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.322+0000 7f646d680640 1 -- 172.21.15.81:0/2184499330 learned_addr learned my addr 172.21.15.81:0/2184499330 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 1 -- 172.21.15.81:0/2184499330 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1863751704 0 0) 0x7f6468074d30 con 0x7f64680a39e0 2024-09-10T16:32:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient(hunting): my global_id is 4966 2024-09-10T16:32:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 1 -- 172.21.15.81:0/2184499330 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6454003530 con 0x7f64680a39e0 2024-09-10T16:32:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 1 -- 172.21.15.81:0/2184499330 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4242262204 0 0) 0x7f646809d820 con 0x7f646809d440 2024-09-10T16:32:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient(hunting): my global_id is 5075 2024-09-10T16:32:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 1 -- 172.21.15.81:0/2184499330 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6468074d30 con 0x7f646809d440 2024-09-10T16:32:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 1 -- 172.21.15.81:0/2184499330 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2368880163 0 0) 0x7f6468074d30 con 0x7f646809d440 2024-09-10T16:32:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 1 -- 172.21.15.81:0/2184499330 >> v1:172.21.15.189:6792/0 conn(0x7f64680a39e0 legacy=0x7f64680a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 1 -- 172.21.15.81:0/2184499330 >> v1:172.21.15.189:6790/0 conn(0x7f64680a0900 legacy=0x7f646813e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient: _finish_hunting 0 2024-09-10T16:32:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 1 monclient: found mon.noname-e 2024-09-10T16:32:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:32:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 1 -- 172.21.15.81:0/2184499330 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646809e1c0 con 0x7f646809d440 2024-09-10T16:32:10.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient: _finish_auth 0 2024-09-10T16:32:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient: _check_auth_tickets 2024-09-10T16:32:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 1 -- 172.21.15.81:0/2184499330 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6464001820 con 0x7f646809d440 2024-09-10T16:32:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:32:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient: dump: 2024-09-10T16:32:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.340 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f646f8e4640 5 monclient: authenticate success, global_id 5075 2024-09-10T16:32:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f646f8e4640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 1 -- 172.21.15.81:0/2184499330 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f64640019c0 con 0x7f646809d440 2024-09-10T16:32:10.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f646f8e4640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f646f8e4640 4 set_mon_vals no callback set 2024-09-10T16:32:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 1 -- 172.21.15.81:0/2184499330 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6464004bf0 con 0x7f646809d440 2024-09-10T16:32:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f645ffff640 10 monclient: dump: 2024-09-10T16:32:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.342 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f646f8e4640 10 monclient: shutdown 2024-09-10T16:32:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f646f8e4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.330+0000 7f646f8e4640 1 -- 172.21.15.81:0/2184499330 >> v1:172.21.15.81:6793/0 conn(0x7f646809d440 legacy=0x7f646809fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 1 -- 172.21.15.81:0/2184499330 shutdown_connections 2024-09-10T16:32:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 1 -- 172.21.15.81:0/2184499330 >> 172.21.15.81:0/2184499330 conn(0x7f64680a3fd0 msgr2=0x7f64680a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 1 -- 172.21.15.81:0/2184499330 shutdown_connections 2024-09-10T16:32:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 1 -- 172.21.15.81:0/2184499330 wait complete. 2024-09-10T16:32:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 10 monclient: build_initial_monmap 2024-09-10T16:32:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 10 monclient: monmap: 2024-09-10T16:32:10.344 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:10.345 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:10.346 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 1 Processor -- start 2024-09-10T16:32:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 1 -- start start 2024-09-10T16:32:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 10 monclient: init 2024-09-10T16:32:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 10 monclient: _add_conns ranks=[4,2,7,8,0,5,6,3,1] 2024-09-10T16:32:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 10 monclient(hunting): picked mon.noname-c con 0x7f646809d440 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 10 monclient(hunting): picked mon.noname-b con 0x7f64680a0900 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 10 monclient(hunting): picked mon.noname-i con 0x7f64680a39e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6468072120 con 0x7f64680a0900 2024-09-10T16:32:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f646809a8a0 con 0x7f646809d440 2024-09-10T16:32:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f646809f6c0 con 0x7f64680a39e0 2024-09-10T16:32:10.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:10.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646f8e4640 10 monclient(hunting): authenticate will time out at 1097.738828s 2024-09-10T16:32:10.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646ce7f640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f64680a0900 0x7f646809a190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:42338/0 (socket says 172.21.15.81:42338) 2024-09-10T16:32:10.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646d680640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f646809d440 0x7f6468099a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:35382/0 (socket says 172.21.15.81:35382) 2024-09-10T16:32:10.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.334+0000 7f646ce7f640 1 -- 172.21.15.81:0/3367841857 learned_addr learned my addr 172.21.15.81:0/3367841857 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.350+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 229278735 0 0) 0x7f646809a8a0 con 0x7f646809d440 2024-09-10T16:32:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.350+0000 7f645dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.350+0000 7f645dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.350+0000 7f645dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.350+0000 7f645dffb640 10 monclient(hunting): my global_id is 5053 2024-09-10T16:32:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.350+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f644c003530 con 0x7f646809d440 2024-09-10T16:32:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1177452629 0 0) 0x7f644c003530 con 0x7f646809d440 2024-09-10T16:32:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f646809a8a0 con 0x7f646809d440 2024-09-10T16:32:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f64640047f0 con 0x7f646809d440 2024-09-10T16:32:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:32:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 10 monclient(hunting): dump: 2024-09-10T16:32:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.360 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1131819727 0 0) 0x7f646809a8a0 con 0x7f646809d440 2024-09-10T16:32:10.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 >> v1:172.21.15.189:6792/0 conn(0x7f64680a39e0 legacy=0x7f64681d5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 >> v1:172.21.15.81:6790/0 conn(0x7f64680a0900 legacy=0x7f646809a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 10 monclient: _finish_hunting 0 2024-09-10T16:32:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 1 monclient: found mon.c 2024-09-10T16:32:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:32:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f646809acf0 con 0x7f646809d440 2024-09-10T16:32:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 10 monclient: _finish_auth 0 2024-09-10T16:32:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 10 monclient: _check_auth_tickets 2024-09-10T16:32:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f646f8e4640 5 monclient: authenticate success, global_id 5053 2024-09-10T16:32:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f646f8e4640 10 monclient: _renew_subs 2024-09-10T16:32:10.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f646f8e4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:32:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f646f8e4640 1 -- 172.21.15.81:0/3367841857 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f64680a5aa0 con 0x7f646809d440 2024-09-10T16:32:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f646f8e4640 10 monclient: _renew_subs 2024-09-10T16:32:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f646f8e4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:32:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f646f8e4640 1 -- 172.21.15.81:0/3367841857 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f6468071e40 con 0x7f646809d440 2024-09-10T16:32:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6464001920 con 0x7f646809d440 2024-09-10T16:32:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f64640051f0 con 0x7f646809d440 2024-09-10T16:32:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645f7fe640 4 set_mon_vals no callback set 2024-09-10T16:32:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 10 monclient: dump: 2024-09-10T16:32:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.363 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f646f8e4640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f646f8e4640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f646f8e4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:32:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f646f8e4640 1 -- 172.21.15.81:0/3367841857 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6448005090 con 0x7f646809d440 2024-09-10T16:32:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f6464011100 con 0x7f646809d440 2024-09-10T16:32:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(116..116 src has 1..116) ==== 3898+0+0 (unknown 723681296 0 0) 0x7f646404b030 con 0x7f646809d440 2024-09-10T16:32:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.354+0000 7f646ce7f640 10 monclient: get_auth_request con 0x7f644c04df80 auth_method 0 2024-09-10T16:32:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.358+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f6464016e90 con 0x7f646809d440 2024-09-10T16:32:10.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.358+0000 7f645dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:10.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.358+0000 7f645dffb640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:10.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.602+0000 7f646f8e4640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-10T16:32:10.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.602+0000 7f646f8e4640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-10T16:32:10.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.602+0000 7f646f8e4640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:32:10.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.602+0000 7f646f8e4640 1 -- 172.21.15.81:0/3367841857 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f6448005380 con 0x7f646809d440 2024-09-10T16:32:10.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.602+0000 7f645dffb640 1 -- 172.21.15.81:0/3367841857 <== mon.4 v1:172.21.15.81:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 3136070571) 0x7f6464016790 con 0x7f646809d440 2024-09-10T16:32:10.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.602+0000 7f645dffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-10T16:32:10.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.602+0000 7f645dffb640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:10.608 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":14,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","modified":"2024-09-10T16:29:22.909160Z","created":"2024-09-10T16:29:22.909160Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6790","nonce":0}]},"addr":"172.21.15.189:6790/0","public_addr":"172.21.15.189:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6791","nonce":0}]},"addr":"172.21.15.81:6791/0","public_addr":"172.21.15.81:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6791","nonce":0}]},"addr":"172.21.15.189:6791/0","public_addr":"172.21.15.189:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6792","nonce":0}]},"addr":"172.21.15.81:6792/0","public_addr":"172.21.15.81:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6792","nonce":0}]},"addr":"172.21.15.189:6792/0","public_addr":"172.21.15.189:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6793","nonce":0}]},"addr":"172.21.15.81:6793/0","public_addr":"172.21.15.81:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T16:32:10.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.606+0000 7f646f8e4640 1 -- 172.21.15.81:0/3367841857 >> v1:172.21.15.189:6812/1108603242 conn(0x7f644c04df80 legacy=0x7f644c050440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.606+0000 7f646f8e4640 10 monclient: shutdown 2024-09-10T16:32:10.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.606+0000 7f646f8e4640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:10.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.606+0000 7f646f8e4640 1 -- 172.21.15.81:0/3367841857 >> v1:172.21.15.81:6791/0 conn(0x7f646809d440 legacy=0x7f6468099a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.606+0000 7f646f8e4640 1 -- 172.21.15.81:0/3367841857 shutdown_connections 2024-09-10T16:32:10.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.606+0000 7f646f8e4640 1 -- 172.21.15.81:0/3367841857 >> 172.21.15.81:0/3367841857 conn(0x7f64680a3fd0 msgr2=0x7f6468094330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:10.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.606+0000 7f646f8e4640 1 -- 172.21.15.81:0/3367841857 shutdown_connections 2024-09-10T16:32:10.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.606+0000 7f646f8e4640 1 -- 172.21.15.81:0/3367841857 wait complete. 2024-09-10T16:32:10.626 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-10T16:32:10.626 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-10T16:32:10.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T16:32:10.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient: get_monmap_and_config 2024-09-10T16:32:10.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient: build_initial_monmap 2024-09-10T16:32:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient: monmap: 2024-09-10T16:32:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:10.742317+0000 2024-09-10T16:32:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:10.742317+0000 2024-09-10T16:32:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:10.744 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 1 Processor -- start 2024-09-10T16:32:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 1 -- start start 2024-09-10T16:32:10.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient: init 2024-09-10T16:32:10.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:10.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient: _add_conns ranks=[1,6,2,0,4,8,7,3,5] 2024-09-10T16:32:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient(hunting): picked mon.noname-f con 0x7f08a009ca10 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient(hunting): picked mon.noname-d con 0x7f08a00a56e0 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient(hunting): picked mon.noname-b con 0x7f08a00a5b00 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a01362b0 con 0x7f08a009ca10 2024-09-10T16:32:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a00a80b0 con 0x7f08a00a5b00 2024-09-10T16:32:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a009de70 con 0x7f08a00a56e0 2024-09-10T16:32:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient(hunting): authenticate will time out at 1098.141716s 2024-09-10T16:32:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089e7fc640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f08a00a56e0 0x7f08a013df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:58438/0 (socket says 172.21.15.81:58438) 2024-09-10T16:32:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089e7fc640 1 -- 172.21.15.81:0/2657713998 learned_addr learned my addr 172.21.15.81:0/2657713998 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089f7fe640 1 --1- 172.21.15.81:0/2657713998 >> v1:172.21.15.81:6790/0 conn(0x7f08a00a5b00 0x7f08a0141650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:42350/0 (socket says 172.21.15.81:42350) 2024-09-10T16:32:10.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 1 -- 172.21.15.81:0/2657713998 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3692399152 0 0) 0x7f08a00a80b0 con 0x7f08a00a5b00 2024-09-10T16:32:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient(hunting): my global_id is 5096 2024-09-10T16:32:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 1 -- 172.21.15.81:0/2657713998 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0888003530 con 0x7f08a00a5b00 2024-09-10T16:32:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 1 -- 172.21.15.81:0/2657713998 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1972517176 0 0) 0x7f08a009de70 con 0x7f08a00a56e0 2024-09-10T16:32:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient(hunting): my global_id is 5046 2024-09-10T16:32:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 1 -- 172.21.15.81:0/2657713998 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08a00a80b0 con 0x7f08a00a56e0 2024-09-10T16:32:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 1 -- 172.21.15.81:0/2657713998 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2793079525 0 0) 0x7f08a00a80b0 con 0x7f08a00a56e0 2024-09-10T16:32:10.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 1 -- 172.21.15.81:0/2657713998 >> v1:172.21.15.81:6790/0 conn(0x7f08a00a5b00 legacy=0x7f08a0141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 1 -- 172.21.15.81:0/2657713998 >> v1:172.21.15.189:6789/0 conn(0x7f08a009ca10 legacy=0x7f08a0135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient: _finish_hunting 0 2024-09-10T16:32:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 1 monclient: found mon.noname-d 2024-09-10T16:32:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:32:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 1 -- 172.21.15.81:0/2657713998 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a009e150 con 0x7f08a00a56e0 2024-09-10T16:32:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient: _finish_auth 0 2024-09-10T16:32:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient: _check_auth_tickets 2024-09-10T16:32:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 1 -- 172.21.15.81:0/2657713998 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f08940017a0 con 0x7f08a00a56e0 2024-09-10T16:32:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 5 monclient: authenticate success, global_id 5046 2024-09-10T16:32:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:10.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:32:10.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient: dump: 2024-09-10T16:32:10.754 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.754 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.754 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.754 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.754 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.754 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.754 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.754 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.754 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.754 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.754 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.754 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.755 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 1 -- 172.21.15.81:0/2657713998 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0894001940 con 0x7f08a00a56e0 2024-09-10T16:32:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 1 -- 172.21.15.81:0/2657713998 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f08940048b0 con 0x7f08a00a56e0 2024-09-10T16:32:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 4 set_mon_vals no callback set 2024-09-10T16:32:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:32:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f089dffb640 10 monclient: dump: 2024-09-10T16:32:10.755 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.756 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.757 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient: shutdown 2024-09-10T16:32:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 1 -- 172.21.15.81:0/2657713998 >> v1:172.21.15.81:6792/0 conn(0x7f08a00a56e0 legacy=0x7f08a013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 1 -- 172.21.15.81:0/2657713998 shutdown_connections 2024-09-10T16:32:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 1 -- 172.21.15.81:0/2657713998 >> 172.21.15.81:0/2657713998 conn(0x7f08a006dc90 msgr2=0x7f08a00ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 1 -- 172.21.15.81:0/2657713998 shutdown_connections 2024-09-10T16:32:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 1 -- 172.21.15.81:0/2657713998 wait complete. 2024-09-10T16:32:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient: build_initial_monmap 2024-09-10T16:32:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.738+0000 7f08a533d640 10 monclient: monmap: 2024-09-10T16:32:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:10.757 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:10.758 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:10.758 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 1 Processor -- start 2024-09-10T16:32:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 1 -- start start 2024-09-10T16:32:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 10 monclient: init 2024-09-10T16:32:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 10 monclient: _add_conns ranks=[7,3,0,4,1,8,2,5,6] 2024-09-10T16:32:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 10 monclient(hunting): picked mon.noname-i con 0x7f08a009ca10 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 10 monclient(hunting): picked mon.noname-g con 0x7f08a00a56e0 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 10 monclient(hunting): picked mon.noname-a con 0x7f08a00a5b00 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a0135230 con 0x7f08a00a5b00 2024-09-10T16:32:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a012ff60 con 0x7f08a00a56e0 2024-09-10T16:32:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08a01322c0 con 0x7f08a009ca10 2024-09-10T16:32:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:10.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 10 monclient(hunting): authenticate will time out at 1098.144861s 2024-09-10T16:32:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f089f7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f08a00a5b00 0x7f08a01d60f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40890/0 (socket says 172.21.15.81:40890) 2024-09-10T16:32:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f089f7fe640 1 -- 172.21.15.81:0/965039102 learned_addr learned my addr 172.21.15.81:0/965039102 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3676200978 0 0) 0x7f08a0135230 con 0x7f08a00a5b00 2024-09-10T16:32:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient(hunting): my global_id is 5139 2024-09-10T16:32:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f088c003530 con 0x7f08a00a5b00 2024-09-10T16:32:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1892589282 0 0) 0x7f088c003530 con 0x7f08a00a5b00 2024-09-10T16:32:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08a0135230 con 0x7f08a00a5b00 2024-09-10T16:32:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0898001cf0 con 0x7f08a00a5b00 2024-09-10T16:32:10.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:32:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient(hunting): dump: 2024-09-10T16:32:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.761 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.762 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2209471229 0 0) 0x7f08a0135230 con 0x7f08a00a5b00 2024-09-10T16:32:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 >> v1:172.21.15.189:6792/0 conn(0x7f08a009ca10 legacy=0x7f08a01421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 >> v1:172.21.15.189:6790/0 conn(0x7f08a00a56e0 legacy=0x7f08a01d29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient: _finish_hunting 0 2024-09-10T16:32:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 monclient: found mon.a 2024-09-10T16:32:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:10.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a0130f00 con 0x7f08a00a5b00 2024-09-10T16:32:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient: _finish_auth 0 2024-09-10T16:32:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient: _check_auth_tickets 2024-09-10T16:32:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 5 monclient: authenticate success, global_id 5139 2024-09-10T16:32:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 10 monclient: _renew_subs 2024-09-10T16:32:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 1 -- 172.21.15.81:0/965039102 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f08a0130ac0 con 0x7f08a00a5b00 2024-09-10T16:32:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 10 monclient: _renew_subs 2024-09-10T16:32:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 1 -- 172.21.15.81:0/965039102 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f08a0142a80 con 0x7f08a00a5b00 2024-09-10T16:32:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0898002050 con 0x7f08a00a5b00 2024-09-10T16:32:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:10.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0898005160 con 0x7f08a00a5b00 2024-09-10T16:32:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f089d7fa640 4 set_mon_vals no callback set 2024-09-10T16:32:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient: dump: 2024-09-10T16:32:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.764 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.765 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08a533d640 1 -- 172.21.15.81:0/965039102 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f08800065d0 con 0x7f0880002870 2024-09-10T16:32:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4026170246 0 0) 0x7f08800065d0 con 0x7f0880002870 2024-09-10T16:32:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient(hunting): my global_id is 5148 2024-09-10T16:32:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08a0135230 con 0x7f0880002870 2024-09-10T16:32:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1748939397 0 0) 0x7f08a0135230 con 0x7f0880002870 2024-09-10T16:32:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f08800065d0 con 0x7f0880002870 2024-09-10T16:32:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0890001980 con 0x7f0880002870 2024-09-10T16:32:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient: dump: 2024-09-10T16:32:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.766 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.767 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.767 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f0898011070 con 0x7f08a00a5b00 2024-09-10T16:32:10.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(116..116 src has 1..116) ==== 3898+0+0 (unknown 723681296 0 0) 0x7f089804b150 con 0x7f08a00a5b00 2024-09-10T16:32:10.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 589559457 0 0) 0x7f08800065d0 con 0x7f0880002870 2024-09-10T16:32:10.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 --> v1:172.21.15.81:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f088000a170 con 0x7f0880002870 2024-09-10T16:32:10.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f089e7fc640 10 monclient: get_auth_request con 0x7f088c03d600 auth_method 0 2024-09-10T16:32:10.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0890003600 con 0x7f0880002870 2024-09-10T16:32:10.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:10.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:10.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 >> v1:172.21.15.81:6789/0 conn(0x7f0880002870 legacy=0x7f0880004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.742+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 >> v1:172.21.15.81:6789/0 conn(0x7f0880002870 legacy=0x7f0880004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:10.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08a533d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:10.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08a533d640 1 -- 172.21.15.81:0/965039102 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0880009e90 con 0x7f0880009150 2024-09-10T16:32:10.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3369891071 0 0) 0x7f0880009e90 con 0x7f0880009150 2024-09-10T16:32:10.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 10 monclient(hunting): my global_id is 5157 2024-09-10T16:32:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f08800065d0 con 0x7f0880009150 2024-09-10T16:32:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3135564688 0 0) 0x7f08800065d0 con 0x7f0880009150 2024-09-10T16:32:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0880009e90 con 0x7f0880009150 2024-09-10T16:32:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0890003d60 con 0x7f0880009150 2024-09-10T16:32:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 10 monclient: dump: 2024-09-10T16:32:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.771 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.772 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.772 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.772 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.772 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.772 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.772 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.772 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.772 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.772 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2836534305 0 0) 0x7f0880009e90 con 0x7f0880009150 2024-09-10T16:32:10.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 --> v1:172.21.15.81:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f088000c420 con 0x7f0880009150 2024-09-10T16:32:10.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7713 (unknown 0 0 3170650207) 0x7f08900052b0 con 0x7f0880009150 2024-09-10T16:32:10.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:10.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:10.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 >> v1:172.21.15.81:6789/0 conn(0x7f0880009150 legacy=0x7f08800095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08877fe640 1 -- 172.21.15.81:0/965039102 >> v1:172.21.15.81:6789/0 conn(0x7f0880009150 legacy=0x7f08800095e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:10.773 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:10.773 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:10.773 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:10.773 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-09-10T16:32:10.773 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:10.774 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 140699, 2024-09-10T16:32:10.774 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:10.774 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:10.774 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:10.774 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:10.774 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:10.774 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:10.774 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:10.774 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:10.774 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:10.774 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:10.774 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:10.775 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-09-10T16:32:10.775 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:10.775 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:10.775 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:10.775 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:10.775 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:10.775 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:10.775 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:10.775 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:10.775 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:10.775 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:10.775 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:10.775 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:10.776 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:10.776 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:10.776 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:10.776 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:10.776 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:10.776 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:10.776 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:10.776 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:10.776 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:10.776 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:10.776 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:10.776 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:10.777 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:10.778 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:10.778 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:10.778 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:10.778 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:10.778 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:10.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:10.778 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:10.778 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:10.778 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:10.778 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:10.778 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:10.778 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:10.778 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:10.779 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:10.779 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:10.779 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:10.779 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:10.779 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:10.779 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:10.779 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:10.779 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:10.779 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:10.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.779 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:10.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.779 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:10.780 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:10.780 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:10.780 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.780 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:10.780 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:10.781 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.781 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.781 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.781 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:10.781 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:10.781 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:10.781 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.782 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.782 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:10.782 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:10.782 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.782 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.782 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.782 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:10.782 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:10.782 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:10.783 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.783 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:10.783 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:10.783 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.783 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.783 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:10.785 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:10.785 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.785 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.785 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.785 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:10.785 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:10.785 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.786 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:10.786 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.786 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:10.786 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:10.786 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.786 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.786 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:10.788 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:10.788 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.788 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.788 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.788 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:10.788 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:10.788 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.788 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:10.789 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:10.790 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.790 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.790 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:10.790 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.790 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:10.791 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:10.791 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.791 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.791 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.791 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:10.791 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:10.791 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.791 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.792 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:10.792 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.792 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:10.792 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:10.792 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.792 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.792 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.792 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.792 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.793 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:10.793 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:10.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.793 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:10.793 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:10.793 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:10.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.793 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:10.793 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:32:10.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.793 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:10.793 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:10.793 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:10.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.794 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:10.794 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:10.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.794 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:10.794 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:10.794 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:32:10.794 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.794 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.794 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:10.794 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:10.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08a533d640 1 -- 172.21.15.81:0/965039102 >> v1:172.21.15.189:6812/1108603242 conn(0x7f088c03d600 legacy=0x7f088c03fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08a533d640 10 monclient: shutdown 2024-09-10T16:32:10.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08a533d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:10.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08a533d640 1 -- 172.21.15.81:0/965039102 >> v1:172.21.15.81:6789/0 conn(0x7f08a00a5b00 legacy=0x7f08a01d60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f089f7fe640 1 -- 172.21.15.81:0/965039102 reap_dead start 2024-09-10T16:32:10.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f089f7fe640 1 -- 172.21.15.81:0/965039102 reap_dead start 2024-09-10T16:32:10.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08a533d640 1 -- 172.21.15.81:0/965039102 shutdown_connections 2024-09-10T16:32:10.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08a533d640 1 -- 172.21.15.81:0/965039102 >> 172.21.15.81:0/965039102 conn(0x7f08a006dc90 msgr2=0x7f08a00a82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:10.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08a533d640 1 -- 172.21.15.81:0/965039102 shutdown_connections 2024-09-10T16:32:10.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.750+0000 7f08a533d640 1 -- 172.21.15.81:0/965039102 wait complete. 2024-09-10T16:32:10.796 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:10.797 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-10T16:32:10.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T16:32:10.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.906+0000 7f13d07eb640 10 monclient: get_monmap_and_config 2024-09-10T16:32:10.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.906+0000 7f13d07eb640 10 monclient: build_initial_monmap 2024-09-10T16:32:10.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.906+0000 7f13d07eb640 10 monclient: monmap: 2024-09-10T16:32:10.913 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:10.913 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.913 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:10.912716+0000 2024-09-10T16:32:10.913 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:10.912716+0000 2024-09-10T16:32:10.913 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:10.914 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:10.914 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.906+0000 7f13d07eb640 1 Processor -- start 2024-09-10T16:32:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.906+0000 7f13d07eb640 1 -- start start 2024-09-10T16:32:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.906+0000 7f13d07eb640 10 monclient: init 2024-09-10T16:32:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient: _add_conns ranks=[3,7,5,8,6,2,4,1,0] 2024-09-10T16:32:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient(hunting): picked mon.noname-g con 0x7f13c809d440 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient(hunting): picked mon.noname-i con 0x7f13c80a39e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient(hunting): picked mon.noname-h con 0x7f13c80a0900 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c80a37a0 con 0x7f13c809d440 2024-09-10T16:32:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c8074d30 con 0x7f13c80a0900 2024-09-10T16:32:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c809d820 con 0x7f13c80a39e0 2024-09-10T16:32:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:10.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient(hunting): authenticate will time out at 1098.312163s 2024-09-10T16:32:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13ced88640 1 --1- >> v1:172.21.15.189:6791/0 conn(0x7f13c80a0900 0x7f13c813e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6791/0 says I am v1:172.21.15.81:60932/0 (socket says 172.21.15.81:60932) 2024-09-10T16:32:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13ced88640 1 -- 172.21.15.81:0/1277047649 learned_addr learned my addr 172.21.15.81:0/1277047649 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 1 -- 172.21.15.81:0/1277047649 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2635872106 0 0) 0x7f13c8074d30 con 0x7f13c80a0900 2024-09-10T16:32:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient(hunting): my global_id is 4865 2024-09-10T16:32:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 1 -- 172.21.15.81:0/1277047649 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13b4003530 con 0x7f13c80a0900 2024-09-10T16:32:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 1 -- 172.21.15.81:0/1277047649 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2623670658 0 0) 0x7f13c80a37a0 con 0x7f13c809d440 2024-09-10T16:32:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient(hunting): my global_id is 134112 2024-09-10T16:32:10.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 1 -- 172.21.15.81:0/1277047649 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13c8074d30 con 0x7f13c809d440 2024-09-10T16:32:10.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 1 -- 172.21.15.81:0/1277047649 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2720809933 0 0) 0x7f13c809d820 con 0x7f13c80a39e0 2024-09-10T16:32:10.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient(hunting): my global_id is 4984 2024-09-10T16:32:10.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 1 -- 172.21.15.81:0/1277047649 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13c80a37a0 con 0x7f13c80a39e0 2024-09-10T16:32:10.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 1 -- 172.21.15.81:0/1277047649 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3812812013 0 0) 0x7f13b4003530 con 0x7f13c80a0900 2024-09-10T16:32:10.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 1 -- 172.21.15.81:0/1277047649 >> v1:172.21.15.189:6792/0 conn(0x7f13c80a39e0 legacy=0x7f13c80a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 1 -- 172.21.15.81:0/1277047649 >> v1:172.21.15.189:6790/0 conn(0x7f13c809d440 legacy=0x7f13c809fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient: _finish_hunting 0 2024-09-10T16:32:10.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 1 monclient: found mon.noname-h 2024-09-10T16:32:10.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:10.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.189:6791/0 2024-09-10T16:32:10.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 1 -- 172.21.15.81:0/1277047649 --> v1:172.21.15.189:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c809e1c0 con 0x7f13c80a0900 2024-09-10T16:32:10.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient: _finish_auth 0 2024-09-10T16:32:10.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient: _check_auth_tickets 2024-09-10T16:32:10.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:10.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 5 monclient: authenticate success, global_id 4865 2024-09-10T16:32:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 1 -- 172.21.15.81:0/1277047649 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f13c4001840 con 0x7f13c80a0900 2024-09-10T16:32:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-10T16:32:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient: dump: 2024-09-10T16:32:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.927 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.928 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:10.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 1 -- 172.21.15.81:0/1277047649 <== mon.5 v1:172.21.15.189:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13c4001a60 con 0x7f13c80a0900 2024-09-10T16:32:10.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:10.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:10.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 4 set_mon_vals no callback set 2024-09-10T16:32:10.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 1 -- 172.21.15.81:0/1277047649 <== mon.5 v1:172.21.15.189:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f13c4001d50 con 0x7f13c80a0900 2024-09-10T16:32:10.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:10.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:32:10.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13cd585640 10 monclient: dump: 2024-09-10T16:32:10.929 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.929 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.929 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.929 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.929 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.930 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.930 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.930 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.930 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.930 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.930 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.930 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.930 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.930 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.930 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.930 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient: shutdown 2024-09-10T16:32:10.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:10.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 1 -- 172.21.15.81:0/1277047649 >> v1:172.21.15.189:6791/0 conn(0x7f13c80a0900 legacy=0x7f13c813e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 1 -- 172.21.15.81:0/1277047649 shutdown_connections 2024-09-10T16:32:10.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 1 -- 172.21.15.81:0/1277047649 >> 172.21.15.81:0/1277047649 conn(0x7f13c80a3fd0 msgr2=0x7f13c80a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:10.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 1 -- 172.21.15.81:0/1277047649 shutdown_connections 2024-09-10T16:32:10.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 1 -- 172.21.15.81:0/1277047649 wait complete. 2024-09-10T16:32:10.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient: build_initial_monmap 2024-09-10T16:32:10.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient: monmap: 2024-09-10T16:32:10.931 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:10.931 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:10.931 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:10.931 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:10.931 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:10.932 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:10.932 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:10.932 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:10.932 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:10.932 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:10.932 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:10.932 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:10.932 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:10.932 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:10.932 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:10.932 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 1 Processor -- start 2024-09-10T16:32:10.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 1 -- start start 2024-09-10T16:32:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient: init 2024-09-10T16:32:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient: _add_conns ranks=[7,2,5,3,8,1,0,4,6] 2024-09-10T16:32:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient(hunting): picked mon.noname-i con 0x7f13c809d440 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient(hunting): picked mon.noname-b con 0x7f13c80a0900 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient(hunting): picked mon.noname-h con 0x7f13c80a39e0 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c8073c60 con 0x7f13c80a0900 2024-09-10T16:32:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c81b6360 con 0x7f13c80a39e0 2024-09-10T16:32:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f13c81b6640 con 0x7f13c809d440 2024-09-10T16:32:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.910+0000 7f13d07eb640 10 monclient(hunting): authenticate will time out at 1098.315934s 2024-09-10T16:32:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13cdd86640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f13c80a0900 0x7f13c81d2e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:42354/0 (socket says 172.21.15.81:42354) 2024-09-10T16:32:10.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13cdd86640 1 -- 172.21.15.81:0/1080244602 learned_addr learned my addr 172.21.15.81:0/1080244602 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1076894326 0 0) 0x7f13c8073c60 con 0x7f13c80a0900 2024-09-10T16:32:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): my global_id is 5105 2024-09-10T16:32:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13ac003530 con 0x7f13c80a0900 2024-09-10T16:32:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2147060420 0 0) 0x7f13ac003530 con 0x7f13c80a0900 2024-09-10T16:32:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13c8073c60 con 0x7f13c80a0900 2024-09-10T16:32:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2889054591 0 0) 0x7f13c81b6360 con 0x7f13c80a39e0 2024-09-10T16:32:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): my global_id is 4874 2024-09-10T16:32:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13ac003530 con 0x7f13c80a39e0 2024-09-10T16:32:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f13b8001ae0 con 0x7f13c80a0900 2024-09-10T16:32:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:32:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): dump: 2024-09-10T16:32:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.935 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.936 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:10.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3318460757 0 0) 0x7f13c81b6640 con 0x7f13c809d440 2024-09-10T16:32:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): my global_id is 4993 2024-09-10T16:32:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13c81b6360 con 0x7f13c809d440 2024-09-10T16:32:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 765959413 0 0) 0x7f13c8073c60 con 0x7f13c80a0900 2024-09-10T16:32:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 >> v1:172.21.15.189:6792/0 conn(0x7f13c809d440 legacy=0x7f13c81cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 >> v1:172.21.15.189:6791/0 conn(0x7f13c80a39e0 legacy=0x7f13c81d65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient: _finish_hunting 0 2024-09-10T16:32:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 monclient: found mon.b 2024-09-10T16:32:10.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13c81b75e0 con 0x7f13c80a0900 2024-09-10T16:32:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient: _finish_auth 0 2024-09-10T16:32:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient: _check_auth_tickets 2024-09-10T16:32:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13d07eb640 5 monclient: authenticate success, global_id 5105 2024-09-10T16:32:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13d07eb640 10 monclient: _renew_subs 2024-09-10T16:32:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13d07eb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13d07eb640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f13c80747c0 con 0x7f13c80a0900 2024-09-10T16:32:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13d07eb640 10 monclient: _renew_subs 2024-09-10T16:32:10.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13d07eb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13d07eb640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f13c81b92c0 con 0x7f13c80a0900 2024-09-10T16:32:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f13b8001c80 con 0x7f13c80a0900 2024-09-10T16:32:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f13b8003c50 con 0x7f13c80a0900 2024-09-10T16:32:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13ccd84640 4 set_mon_vals no callback set 2024-09-10T16:32:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient: dump: 2024-09-10T16:32:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.939 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.940 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.941 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13d07eb640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13d07eb640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f13b00065d0 con 0x7f13b0002870 2024-09-10T16:32:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f13b8003e70 con 0x7f13c80a0900 2024-09-10T16:32:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(116..116 src has 1..116) ==== 3898+0+0 (unknown 723681296 0 0) 0x7f13b804ae80 con 0x7f13c80a0900 2024-09-10T16:32:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2883606989 0 0) 0x7f13b00065d0 con 0x7f13b0002870 2024-09-10T16:32:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient(hunting): my global_id is 5114 2024-09-10T16:32:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13c8073c60 con 0x7f13b0002870 2024-09-10T16:32:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 249924751 0 0) 0x7f13c8073c60 con 0x7f13b0002870 2024-09-10T16:32:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13b00065d0 con 0x7f13b0002870 2024-09-10T16:32:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f13c0001cc0 con 0x7f13b0002870 2024-09-10T16:32:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient: dump: 2024-09-10T16:32:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.942 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.943 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.944 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13ced88640 10 monclient: get_auth_request con 0x7f13ac03d1c0 auth_method 0 2024-09-10T16:32:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2469868589 0 0) 0x7f13b00065d0 con 0x7f13b0002870 2024-09-10T16:32:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.81:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f13b000a170 con 0x7f13b0002870 2024-09-10T16:32:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f13c0002040 con 0x7f13b0002870 2024-09-10T16:32:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 >> v1:172.21.15.81:6790/0 conn(0x7f13b0002870 legacy=0x7f13b0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.914+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 >> v1:172.21.15.81:6790/0 conn(0x7f13b0002870 legacy=0x7f13b0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13d07eb640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13d07eb640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f13b0009e60 con 0x7f13b0009120 2024-09-10T16:32:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4261606436 0 0) 0x7f13b0009e60 con 0x7f13b0009120 2024-09-10T16:32:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:10.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 10 monclient(hunting): my global_id is 5123 2024-09-10T16:32:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f13b00065d0 con 0x7f13b0009120 2024-09-10T16:32:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 475734234 0 0) 0x7f13b00065d0 con 0x7f13b0009120 2024-09-10T16:32:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f13b0009e60 con 0x7f13b0009120 2024-09-10T16:32:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f13c0003f30 con 0x7f13b0009120 2024-09-10T16:32:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 10 monclient: dump: 2024-09-10T16:32:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:10.947 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:10.948 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:10.949 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1619572424 0 0) 0x7f13b0009e60 con 0x7f13b0009120 2024-09-10T16:32:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 --> v1:172.21.15.81:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f13b000c400 con 0x7f13b0009120 2024-09-10T16:32:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 767590907) 0x7f13c0005480 con 0x7f13b0009120 2024-09-10T16:32:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 >> v1:172.21.15.81:6790/0 conn(0x7f13b0009120 legacy=0x7f13b00095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13beffd640 1 -- 172.21.15.81:0/1080244602 >> v1:172.21.15.81:6790/0 conn(0x7f13b0009120 legacy=0x7f13b00095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:10.950 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 140891, 2024-09-10T16:32:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:10.950 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-09-10T16:32:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:10.951 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:10.952 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:10.953 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:10.954 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:10.955 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:10.956 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.957 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.960 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:10.961 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.962 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.964 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.965 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:10.966 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.967 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:10.968 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:10.969 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.970 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:32:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-09-10T16:32:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:10.971 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:10.972 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13d07eb640 1 -- 172.21.15.81:0/1080244602 >> v1:172.21.15.189:6812/1108603242 conn(0x7f13ac03d1c0 legacy=0x7f13ac03f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13d07eb640 10 monclient: shutdown 2024-09-10T16:32:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13d07eb640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13d07eb640 1 -- 172.21.15.81:0/1080244602 >> v1:172.21.15.81:6790/0 conn(0x7f13c80a0900 legacy=0x7f13c81d2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13ced88640 1 -- 172.21.15.81:0/1080244602 reap_dead start 2024-09-10T16:32:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13ced88640 1 -- 172.21.15.81:0/1080244602 reap_dead start 2024-09-10T16:32:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13d07eb640 1 -- 172.21.15.81:0/1080244602 shutdown_connections 2024-09-10T16:32:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13d07eb640 1 -- 172.21.15.81:0/1080244602 >> 172.21.15.81:0/1080244602 conn(0x7f13c80a3fd0 msgr2=0x7f13c809a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:10.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13d07eb640 1 -- 172.21.15.81:0/1080244602 shutdown_connections 2024-09-10T16:32:10.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:10.922+0000 7f13d07eb640 1 -- 172.21.15.81:0/1080244602 wait complete. 2024-09-10T16:32:10.974 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:10.974 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-10T16:32:10.974 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T16:32:11.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.082+0000 7f3fac022640 10 monclient: get_monmap_and_config 2024-09-10T16:32:11.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.082+0000 7f3fac022640 10 monclient: build_initial_monmap 2024-09-10T16:32:11.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.082+0000 7f3fac022640 10 monclient: monmap: 2024-09-10T16:32:11.090 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:11.090 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.090 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:11.089855+0000 2024-09-10T16:32:11.090 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:11.089855+0000 2024-09-10T16:32:11.090 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:11.090 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.090 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:11.090 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:11.090 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:11.091 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:11.091 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:11.091 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:11.091 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:11.091 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:11.091 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:11.091 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 1 Processor -- start 2024-09-10T16:32:11.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 1 -- start start 2024-09-10T16:32:11.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 10 monclient: init 2024-09-10T16:32:11.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:11.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 10 monclient: _add_conns ranks=[8,6,7,3,4,5,2,0,1] 2024-09-10T16:32:11.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 10 monclient(hunting): picked mon.noname-e con 0x7f3fa409ca10 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:11.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 10 monclient(hunting): picked mon.noname-d con 0x7f3fa40a56e0 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:11.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 10 monclient(hunting): picked mon.noname-i con 0x7f3fa40a5b00 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:11.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa41362b0 con 0x7f3fa40a56e0 2024-09-10T16:32:11.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa40a80b0 con 0x7f3fa40a5b00 2024-09-10T16:32:11.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa409de70 con 0x7f3fa409ca10 2024-09-10T16:32:11.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:11.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 10 monclient(hunting): authenticate will time out at 1098.489639s 2024-09-10T16:32:11.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa9dbe640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f3fa409ca10 0x7f3fa4135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:46706/0 (socket says 172.21.15.81:46706) 2024-09-10T16:32:11.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa9dbe640 1 -- 172.21.15.81:0/874832450 learned_addr learned my addr 172.21.15.81:0/874832450 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:11.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 1 -- 172.21.15.81:0/874832450 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4011357066 0 0) 0x7f3fa409de70 con 0x7f3fa409ca10 2024-09-10T16:32:11.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient(hunting): my global_id is 5084 2024-09-10T16:32:11.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 1 -- 172.21.15.81:0/874832450 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f90003530 con 0x7f3fa409ca10 2024-09-10T16:32:11.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 1 -- 172.21.15.81:0/874832450 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2886643594 0 0) 0x7f3fa41362b0 con 0x7f3fa40a56e0 2024-09-10T16:32:11.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient(hunting): my global_id is 5055 2024-09-10T16:32:11.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 1 -- 172.21.15.81:0/874832450 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fa409de70 con 0x7f3fa40a56e0 2024-09-10T16:32:11.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 1 -- 172.21.15.81:0/874832450 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2124932661 0 0) 0x7f3f90003530 con 0x7f3fa409ca10 2024-09-10T16:32:11.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 1 -- 172.21.15.81:0/874832450 >> v1:172.21.15.189:6792/0 conn(0x7f3fa40a5b00 legacy=0x7f3fa4141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 1 -- 172.21.15.81:0/874832450 >> v1:172.21.15.81:6792/0 conn(0x7f3fa40a56e0 legacy=0x7f3fa413df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient: _finish_hunting 0 2024-09-10T16:32:11.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 1 monclient: found mon.noname-e 2024-09-10T16:32:11.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:11.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:32:11.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 1 -- 172.21.15.81:0/874832450 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa409e150 con 0x7f3fa409ca10 2024-09-10T16:32:11.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient: _finish_auth 0 2024-09-10T16:32:11.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient: _check_auth_tickets 2024-09-10T16:32:11.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:11.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 1 -- 172.21.15.81:0/874832450 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3fa0001840 con 0x7f3fa409ca10 2024-09-10T16:32:11.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:32:11.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient: dump: 2024-09-10T16:32:11.101 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.101 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.101 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.101 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.101 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.101 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.101 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.101 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.101 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.101 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.102 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.102 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.102 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.102 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.102 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.102 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 5 monclient: authenticate success, global_id 5084 2024-09-10T16:32:11.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:11.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 1 -- 172.21.15.81:0/874832450 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3fa0001a60 con 0x7f3fa409ca10 2024-09-10T16:32:11.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:11.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 1 -- 172.21.15.81:0/874832450 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3fa0004bf0 con 0x7f3fa409ca10 2024-09-10T16:32:11.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:11.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 4 set_mon_vals no callback set 2024-09-10T16:32:11.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:11.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fa8dbc640 10 monclient: dump: 2024-09-10T16:32:11.103 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.103 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.103 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.103 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.103 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.103 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.103 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.103 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.104 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.104 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.104 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.104 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.104 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.104 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.104 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.104 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 10 monclient: shutdown 2024-09-10T16:32:11.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:11.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 1 -- 172.21.15.81:0/874832450 >> v1:172.21.15.81:6793/0 conn(0x7f3fa409ca10 legacy=0x7f3fa4135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 1 -- 172.21.15.81:0/874832450 shutdown_connections 2024-09-10T16:32:11.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 1 -- 172.21.15.81:0/874832450 >> 172.21.15.81:0/874832450 conn(0x7f3fa406dc90 msgr2=0x7f3fa40ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:11.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 1 -- 172.21.15.81:0/874832450 shutdown_connections 2024-09-10T16:32:11.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 1 -- 172.21.15.81:0/874832450 wait complete. 2024-09-10T16:32:11.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 10 monclient: build_initial_monmap 2024-09-10T16:32:11.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.086+0000 7f3fac022640 10 monclient: monmap: 2024-09-10T16:32:11.105 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:11.105 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:11.105 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:11.105 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:11.105 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:11.106 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:11.106 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:11.106 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:11.106 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:11.106 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:11.106 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:11.106 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:11.106 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:11.106 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:11.106 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:11.106 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 1 Processor -- start 2024-09-10T16:32:11.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 1 -- start start 2024-09-10T16:32:11.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 10 monclient: init 2024-09-10T16:32:11.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:11.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 10 monclient: _add_conns ranks=[6,5,7,2,3,0,8,4,1] 2024-09-10T16:32:11.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 10 monclient(hunting): picked mon.noname-d con 0x7f3fa409ca10 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:11.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 10 monclient(hunting): picked mon.noname-h con 0x7f3fa40a56e0 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:11.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 10 monclient(hunting): picked mon.noname-i con 0x7f3fa40a5b00 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:11.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa40aa130 con 0x7f3fa40a56e0 2024-09-10T16:32:11.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa4135180 con 0x7f3fa409ca10 2024-09-10T16:32:11.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3fa409ee00 con 0x7f3fa40a5b00 2024-09-10T16:32:11.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:11.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 10 monclient(hunting): authenticate will time out at 1098.492829s 2024-09-10T16:32:11.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fa9dbe640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f3fa409ca10 0x7f3fa40a4bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:58446/0 (socket says 172.21.15.81:58446) 2024-09-10T16:32:11.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fa9dbe640 1 -- 172.21.15.81:0/3263069597 learned_addr learned my addr 172.21.15.81:0/3263069597 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2983336277 0 0) 0x7f3fa4135180 con 0x7f3fa409ca10 2024-09-10T16:32:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient(hunting): my global_id is 5064 2024-09-10T16:32:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f88003530 con 0x7f3fa409ca10 2024-09-10T16:32:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 122622246 0 0) 0x7f3f88003530 con 0x7f3fa409ca10 2024-09-10T16:32:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3fa4135180 con 0x7f3fa409ca10 2024-09-10T16:32:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3fa0004b30 con 0x7f3fa409ca10 2024-09-10T16:32:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:32:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient(hunting): dump: 2024-09-10T16:32:11.108 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.109 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.110 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1104093075 0 0) 0x7f3fa4135180 con 0x7f3fa409ca10 2024-09-10T16:32:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 >> v1:172.21.15.189:6792/0 conn(0x7f3fa40a5b00 legacy=0x7f3fa41d5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 >> v1:172.21.15.189:6791/0 conn(0x7f3fa40a56e0 legacy=0x7f3fa41d2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:32:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 monclient: found mon.d 2024-09-10T16:32:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:32:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fa409f0e0 con 0x7f3fa409ca10 2024-09-10T16:32:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient: _finish_auth 0 2024-09-10T16:32:11.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:32:11.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:11.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 5 monclient: authenticate success, global_id 5064 2024-09-10T16:32:11.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 10 monclient: _renew_subs 2024-09-10T16:32:11.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:32:11.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 1 -- 172.21.15.81:0/3263069597 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3fa4132b20 con 0x7f3fa409ca10 2024-09-10T16:32:11.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 10 monclient: _renew_subs 2024-09-10T16:32:11.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:32:11.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 1 -- 172.21.15.81:0/3263069597 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f3fa4131fd0 con 0x7f3fa409ca10 2024-09-10T16:32:11.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3fa00011c0 con 0x7f3fa409ca10 2024-09-10T16:32:11.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:11.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3fa0001980 con 0x7f3fa409ca10 2024-09-10T16:32:11.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:32:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9bfff640 4 set_mon_vals no callback set 2024-09-10T16:32:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient: dump: 2024-09-10T16:32:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.112 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.113 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3fac022640 1 -- 172.21.15.81:0/3263069597 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3f8c0065d0 con 0x7f3f8c002870 2024-09-10T16:32:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f3fa0010f60 con 0x7f3fa409ca10 2024-09-10T16:32:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(116..116 src has 1..116) ==== 3898+0+0 (unknown 723681296 0 0) 0x7f3fa004b000 con 0x7f3fa409ca10 2024-09-10T16:32:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1267869380 0 0) 0x7f3f8c0065d0 con 0x7f3f8c002870 2024-09-10T16:32:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient(hunting): my global_id is 5062 2024-09-10T16:32:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3fa4135180 con 0x7f3f8c002870 2024-09-10T16:32:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3855740246 0 0) 0x7f3fa4135180 con 0x7f3f8c002870 2024-09-10T16:32:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f8c0065d0 con 0x7f3f8c002870 2024-09-10T16:32:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3f94001320 con 0x7f3f8c002870 2024-09-10T16:32:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3faa5bf640 10 monclient: get_auth_request con 0x7f3f8803cf50 auth_method 0 2024-09-10T16:32:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient: dump: 2024-09-10T16:32:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.114 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.115 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.115 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1319617092 0 0) 0x7f3f8c0065d0 con 0x7f3f8c002870 2024-09-10T16:32:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 --> v1:172.21.15.81:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f8c00a170 con 0x7f3f8c002870 2024-09-10T16:32:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3f94001670 con 0x7f3f8c002870 2024-09-10T16:32:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 >> v1:172.21.15.81:6791/0 conn(0x7f3f8c002870 legacy=0x7f3f8c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.090+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 >> v1:172.21.15.81:6791/0 conn(0x7f3f8c002870 legacy=0x7f3f8c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:11.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3fac022640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:11.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3fac022640 1 -- 172.21.15.81:0/3263069597 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3f8c009e80 con 0x7f3f8c009140 2024-09-10T16:32:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 540250472 0 0) 0x7f3f8c009e80 con 0x7f3f8c009140 2024-09-10T16:32:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 10 monclient(hunting): my global_id is 5071 2024-09-10T16:32:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3f8c0065d0 con 0x7f3f8c009140 2024-09-10T16:32:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3013419081 0 0) 0x7f3f8c0065d0 con 0x7f3f8c009140 2024-09-10T16:32:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3f8c009e80 con 0x7f3f8c009140 2024-09-10T16:32:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3f94003b30 con 0x7f3f8c009140 2024-09-10T16:32:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:11.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 10 monclient: dump: 2024-09-10T16:32:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.119 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.120 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3903782160 0 0) 0x7f3f8c009e80 con 0x7f3f8c009140 2024-09-10T16:32:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 --> v1:172.21.15.81:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3f8c00c420 con 0x7f3f8c009140 2024-09-10T16:32:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 2071023929) 0x7f3f94004f60 con 0x7f3f8c009140 2024-09-10T16:32:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 >> v1:172.21.15.81:6791/0 conn(0x7f3f8c009140 legacy=0x7f3f8c0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3f9a7fc640 1 -- 172.21.15.81:0/3263069597 >> v1:172.21.15.81:6791/0 conn(0x7f3f8c009140 legacy=0x7f3f8c0095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 141055, 2024-09-10T16:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:11.121 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-09-10T16:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.122 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.123 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.124 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:11.125 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.126 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.127 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:11.128 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.129 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.130 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.131 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.132 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.134 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.135 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.137 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.138 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:11.140 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:32:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:11.141 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.142 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:11.142 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3fac022640 1 -- 172.21.15.81:0/3263069597 >> v1:172.21.15.189:6812/1108603242 conn(0x7f3f8803cf50 legacy=0x7f3f8803f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3fac022640 10 monclient: shutdown 2024-09-10T16:32:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3fac022640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3fac022640 1 -- 172.21.15.81:0/3263069597 >> v1:172.21.15.81:6792/0 conn(0x7f3fa409ca10 legacy=0x7f3fa40a4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3faa5bf640 1 -- 172.21.15.81:0/3263069597 reap_dead start 2024-09-10T16:32:11.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3faa5bf640 1 -- 172.21.15.81:0/3263069597 reap_dead start 2024-09-10T16:32:11.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3fac022640 1 -- 172.21.15.81:0/3263069597 shutdown_connections 2024-09-10T16:32:11.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3fac022640 1 -- 172.21.15.81:0/3263069597 >> 172.21.15.81:0/3263069597 conn(0x7f3fa406dc90 msgr2=0x7f3fa40a82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:11.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3fac022640 1 -- 172.21.15.81:0/3263069597 shutdown_connections 2024-09-10T16:32:11.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.098+0000 7f3fac022640 1 -- 172.21.15.81:0/3263069597 wait complete. 2024-09-10T16:32:11.144 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:11.144 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-10T16:32:11.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-10T16:32:11.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.258+0000 7f440bc15640 10 monclient: get_monmap_and_config 2024-09-10T16:32:11.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.258+0000 7f440bc15640 10 monclient: build_initial_monmap 2024-09-10T16:32:11.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.258+0000 7f440bc15640 10 monclient: monmap: 2024-09-10T16:32:11.265 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:11.266 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.266 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:11.265321+0000 2024-09-10T16:32:11.266 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:11.265321+0000 2024-09-10T16:32:11.266 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:11.266 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.266 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:11.266 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:11.266 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:11.266 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:11.266 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:11.266 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:11.266 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:11.266 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:11.266 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:11.267 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.258+0000 7f440bc15640 1 Processor -- start 2024-09-10T16:32:11.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.258+0000 7f440bc15640 1 -- start start 2024-09-10T16:32:11.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.258+0000 7f440bc15640 10 monclient: init 2024-09-10T16:32:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient: _add_conns ranks=[5,2,4,0,6,8,3,7,1] 2024-09-10T16:32:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient(hunting): picked mon.noname-h con 0x7f44040a0a90 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient(hunting): picked mon.noname-b con 0x7f44040a35f0 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient(hunting): picked mon.noname-c con 0x7f44040a3a40 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f440409df70 con 0x7f44040a35f0 2024-09-10T16:32:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f440409fa30 con 0x7f44040a3a40 2024-09-10T16:32:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f440409fd10 con 0x7f44040a0a90 2024-09-10T16:32:11.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient(hunting): authenticate will time out at 1098.664425s 2024-09-10T16:32:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44091b0640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f44040a35f0 0x7f440413c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:42390/0 (socket says 172.21.15.81:42390) 2024-09-10T16:32:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44091b0640 1 -- 172.21.15.81:0/3329614534 learned_addr learned my addr 172.21.15.81:0/3329614534 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 1 -- 172.21.15.81:0/3329614534 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3699885527 0 0) 0x7f440409df70 con 0x7f44040a35f0 2024-09-10T16:32:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient(hunting): my global_id is 5132 2024-09-10T16:32:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 1 -- 172.21.15.81:0/3329614534 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43f0003530 con 0x7f44040a35f0 2024-09-10T16:32:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 1 -- 172.21.15.81:0/3329614534 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2608358863 0 0) 0x7f440409fa30 con 0x7f44040a3a40 2024-09-10T16:32:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient(hunting): my global_id is 5080 2024-09-10T16:32:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 1 -- 172.21.15.81:0/3329614534 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f440409df70 con 0x7f44040a3a40 2024-09-10T16:32:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 1 -- 172.21.15.81:0/3329614534 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2575303766 0 0) 0x7f43f0003530 con 0x7f44040a35f0 2024-09-10T16:32:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 1 -- 172.21.15.81:0/3329614534 >> v1:172.21.15.189:6791/0 conn(0x7f44040a0a90 legacy=0x7f44040a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 1 -- 172.21.15.81:0/3329614534 >> v1:172.21.15.81:6791/0 conn(0x7f44040a3a40 legacy=0x7f440413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient: _finish_hunting 0 2024-09-10T16:32:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 1 monclient: found mon.noname-b 2024-09-10T16:32:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:32:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 1 -- 172.21.15.81:0/3329614534 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f440409fff0 con 0x7f44040a35f0 2024-09-10T16:32:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient: _finish_auth 0 2024-09-10T16:32:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient: _check_auth_tickets 2024-09-10T16:32:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 1 -- 172.21.15.81:0/3329614534 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f43f4001860 con 0x7f44040a35f0 2024-09-10T16:32:11.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:32:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient: dump: 2024-09-10T16:32:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.276 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 5 monclient: authenticate success, global_id 5132 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 1 -- 172.21.15.81:0/3329614534 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f43f4001a80 con 0x7f44040a35f0 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 1 -- 172.21.15.81:0/3329614534 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f43f4004bf0 con 0x7f44040a35f0 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 4 set_mon_vals no callback set 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:11.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44089af640 10 monclient: dump: 2024-09-10T16:32:11.278 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.278 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.278 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.278 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.278 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.278 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.278 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.278 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.278 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.278 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.278 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.278 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.278 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.278 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.279 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.279 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient: shutdown 2024-09-10T16:32:11.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:11.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 1 -- 172.21.15.81:0/3329614534 >> v1:172.21.15.81:6790/0 conn(0x7f44040a35f0 legacy=0x7f440413c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 1 -- 172.21.15.81:0/3329614534 shutdown_connections 2024-09-10T16:32:11.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 1 -- 172.21.15.81:0/3329614534 >> 172.21.15.81:0/3329614534 conn(0x7f44040a3fd0 msgr2=0x7f44040a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:11.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 1 -- 172.21.15.81:0/3329614534 shutdown_connections 2024-09-10T16:32:11.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 1 -- 172.21.15.81:0/3329614534 wait complete. 2024-09-10T16:32:11.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient: build_initial_monmap 2024-09-10T16:32:11.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient: monmap: 2024-09-10T16:32:11.279 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:11.279 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:11.279 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:11.280 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 1 Processor -- start 2024-09-10T16:32:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 1 -- start start 2024-09-10T16:32:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient: init 2024-09-10T16:32:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient: _add_conns ranks=[8,5,1,2,4,0,3,6,7] 2024-09-10T16:32:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient(hunting): picked mon.noname-e con 0x7f44040a0a90 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient(hunting): picked mon.noname-h con 0x7f44040a35f0 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient(hunting): picked mon.noname-f con 0x7f44040a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44041cc730 con 0x7f44040a3a40 2024-09-10T16:32:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44041b2930 con 0x7f44040a35f0 2024-09-10T16:32:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f44041b1440 con 0x7f44040a0a90 2024-09-10T16:32:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f440bc15640 10 monclient(hunting): authenticate will time out at 1098.667165s 2024-09-10T16:32:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44099b1640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f44040a0a90 0x7f44041cb910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:46712/0 (socket says 172.21.15.81:46712) 2024-09-10T16:32:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f44099b1640 1 -- 172.21.15.81:0/461072223 learned_addr learned my addr 172.21.15.81:0/461072223 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 133548510 0 0) 0x7f44041b1440 con 0x7f44040a0a90 2024-09-10T16:32:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): my global_id is 5093 2024-09-10T16:32:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43e8003530 con 0x7f44040a0a90 2024-09-10T16:32:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 762897310 0 0) 0x7f43e8003530 con 0x7f44040a0a90 2024-09-10T16:32:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f44041b1440 con 0x7f44040a0a90 2024-09-10T16:32:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4400001f60 con 0x7f44040a0a90 2024-09-10T16:32:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:32:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): dump: 2024-09-10T16:32:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.282 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.283 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2305679218 0 0) 0x7f44041b2930 con 0x7f44040a35f0 2024-09-10T16:32:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): my global_id is 4901 2024-09-10T16:32:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43e8003530 con 0x7f44040a35f0 2024-09-10T16:32:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3838643477 0 0) 0x7f44041cc730 con 0x7f44040a3a40 2024-09-10T16:32:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 10 monclient(hunting): my global_id is 5140 2024-09-10T16:32:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.262+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44041b2930 con 0x7f44040a3a40 2024-09-10T16:32:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1091484364 0 0) 0x7f44041b1440 con 0x7f44040a0a90 2024-09-10T16:32:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 >> v1:172.21.15.189:6791/0 conn(0x7f44040a35f0 legacy=0x7f44041cc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 >> v1:172.21.15.189:6789/0 conn(0x7f44040a3a40 legacy=0x7f44041d3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:32:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 monclient: found mon.e 2024-09-10T16:32:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:32:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44041b2f00 con 0x7f44040a0a90 2024-09-10T16:32:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient: _finish_auth 0 2024-09-10T16:32:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:32:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f440bc15640 5 monclient: authenticate success, global_id 5093 2024-09-10T16:32:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f440bc15640 10 monclient: _renew_subs 2024-09-10T16:32:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f440bc15640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:32:11.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f440bc15640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f44041b2230 con 0x7f44040a0a90 2024-09-10T16:32:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f440bc15640 10 monclient: _renew_subs 2024-09-10T16:32:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f440bc15640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:32:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f440bc15640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f44041b3d90 con 0x7f44040a0a90 2024-09-10T16:32:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4400003c50 con 0x7f44040a0a90 2024-09-10T16:32:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f44000041c0 con 0x7f44040a0a90 2024-09-10T16:32:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fbfff640 4 set_mon_vals no callback set 2024-09-10T16:32:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient: dump: 2024-09-10T16:32:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.286 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.287 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.287 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.287 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.287 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.287 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.287 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.287 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.287 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.287 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.288 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f440bc15640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f440bc15640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f43ec0065d0 con 0x7f43ec002870 2024-09-10T16:32:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f4400004360 con 0x7f44040a0a90 2024-09-10T16:32:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 3257020974 0 0) 0x7f440004b3a0 con 0x7f44040a0a90 2024-09-10T16:32:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2402474007 0 0) 0x7f43ec0065d0 con 0x7f43ec002870 2024-09-10T16:32:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient(hunting): my global_id is 5073 2024-09-10T16:32:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f44041b1440 con 0x7f43ec002870 2024-09-10T16:32:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f440a1b2640 10 monclient: get_auth_request con 0x7f43e803d270 auth_method 0 2024-09-10T16:32:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 234910506 0 0) 0x7f44041b1440 con 0x7f43ec002870 2024-09-10T16:32:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43ec0065d0 con 0x7f43ec002870 2024-09-10T16:32:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f43f4001200 con 0x7f43ec002870 2024-09-10T16:32:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:32:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient: dump: 2024-09-10T16:32:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.289 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.290 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.290 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.290 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.290 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.290 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.290 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.290 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.290 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.290 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.290 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 144433305 0 0) 0x7f43ec0065d0 con 0x7f43ec002870 2024-09-10T16:32:11.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.81:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f43ec00a170 con 0x7f43ec002870 2024-09-10T16:32:11.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f43f4001660 con 0x7f43ec002870 2024-09-10T16:32:11.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:11.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:11.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 >> v1:172.21.15.81:6792/0 conn(0x7f43ec002870 legacy=0x7f43ec004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.266+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 >> v1:172.21.15.81:6792/0 conn(0x7f43ec002870 legacy=0x7f43ec004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f440bc15640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f440bc15640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f43ec009e80 con 0x7f43ec009140 2024-09-10T16:32:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632212319 0 0) 0x7f43ec009e80 con 0x7f43ec009140 2024-09-10T16:32:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 10 monclient(hunting): my global_id is 5082 2024-09-10T16:32:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43ec0065d0 con 0x7f43ec009140 2024-09-10T16:32:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2925948474 0 0) 0x7f43ec0065d0 con 0x7f43ec009140 2024-09-10T16:32:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43ec009e80 con 0x7f43ec009140 2024-09-10T16:32:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f43f4005000 con 0x7f43ec009140 2024-09-10T16:32:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:32:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 10 monclient: dump: 2024-09-10T16:32:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.293 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.294 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.294 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.294 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.294 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.294 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.294 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.294 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.294 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.294 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2532878332 0 0) 0x7f43ec009e80 con 0x7f43ec009140 2024-09-10T16:32:11.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 --> v1:172.21.15.81:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f43ec00c420 con 0x7f43ec009140 2024-09-10T16:32:11.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 2727894352) 0x7f43f4005130 con 0x7f43ec009140 2024-09-10T16:32:11.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:11.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:11.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 >> v1:172.21.15.81:6792/0 conn(0x7f43ec009140 legacy=0x7f43ec0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f43fa7fc640 1 -- 172.21.15.81:0/461072223 >> v1:172.21.15.81:6792/0 conn(0x7f43ec009140 legacy=0x7f43ec0095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:11.295 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:11.295 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:11.295 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:11.295 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:11.295 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:11.295 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 141235, 2024-09-10T16:32:11.295 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:11.295 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-09-10T16:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:11.296 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:11.297 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.298 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:11.299 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.300 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:11.301 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.302 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.304 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:11.305 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:11.306 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.308 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:11.309 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.310 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:11.312 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.313 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:32:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:32:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.314 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.315 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:11.315 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f440bc15640 1 -- 172.21.15.81:0/461072223 >> v1:172.21.15.189:6812/1108603242 conn(0x7f43e803d270 legacy=0x7f43e803f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f440bc15640 10 monclient: shutdown 2024-09-10T16:32:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f440bc15640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f440bc15640 1 -- 172.21.15.81:0/461072223 >> v1:172.21.15.81:6793/0 conn(0x7f44040a0a90 legacy=0x7f44041cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f440a1b2640 1 -- 172.21.15.81:0/461072223 reap_dead start 2024-09-10T16:32:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f440a1b2640 1 -- 172.21.15.81:0/461072223 reap_dead start 2024-09-10T16:32:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f440bc15640 1 -- 172.21.15.81:0/461072223 shutdown_connections 2024-09-10T16:32:11.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f440bc15640 1 -- 172.21.15.81:0/461072223 >> 172.21.15.81:0/461072223 conn(0x7f44040a3fd0 msgr2=0x7f440409a950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:11.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f440bc15640 1 -- 172.21.15.81:0/461072223 shutdown_connections 2024-09-10T16:32:11.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.274+0000 7f440bc15640 1 -- 172.21.15.81:0/461072223 wait complete. 2024-09-10T16:32:11.317 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:11.317 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-10T16:32:11.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-10T16:32:11.338 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:11.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29650]: starting. 2024-09-10T16:32:11.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29650]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29615 2024-09-10T16:32:11.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29650]: created object 0... 2024-09-10T16:32:11.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29650]: created object 25... 2024-09-10T16:32:11.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29650]: created object 49... 2024-09-10T16:32:11.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29650]: finishing. 2024-09-10T16:32:11.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29650]: shutting down. 2024-09-10T16:32:11.359 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:11.359 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29652]: starting. 2024-09-10T16:32:11.359 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29652]: listing objects. 2024-09-10T16:32:11.359 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29652]: listed object 0... 2024-09-10T16:32:11.359 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29652]: listed object 25... 2024-09-10T16:32:11.359 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29652]: saw 50 objects 2024-09-10T16:32:11.359 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29652]: shutting down. 2024-09-10T16:32:11.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient: get_monmap_and_config 2024-09-10T16:32:11.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient: build_initial_monmap 2024-09-10T16:32:11.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient: monmap: 2024-09-10T16:32:11.426 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:11.426 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.426 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:11.426122+0000 2024-09-10T16:32:11.426 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:11.426122+0000 2024-09-10T16:32:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:11.427 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:11.427 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 1 Processor -- start 2024-09-10T16:32:11.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 1 -- start start 2024-09-10T16:32:11.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient: init 2024-09-10T16:32:11.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:11.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient: _add_conns ranks=[5,4,8,6,3,7,1,0,2] 2024-09-10T16:32:11.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient(hunting): picked mon.noname-h con 0x7f22e40a5ad0 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:11.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient(hunting): picked mon.noname-c con 0x7f22e4137080 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:11.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient(hunting): picked mon.noname-e con 0x7f22e409ef60 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:11.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e40a2010 con 0x7f22e4137080 2024-09-10T16:32:11.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e4069120 con 0x7f22e40a5ad0 2024-09-10T16:32:11.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e4069400 con 0x7f22e409ef60 2024-09-10T16:32:11.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:11.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient(hunting): authenticate will time out at 1098.825508s 2024-09-10T16:32:11.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e2ffd640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f22e4137080 0x7f22e413be90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:35402/0 (socket says 172.21.15.81:35402) 2024-09-10T16:32:11.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e3fff640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f22e409ef60 0x7f22e413f5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:46722/0 (socket says 172.21.15.81:46722) 2024-09-10T16:32:11.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e2ffd640 1 -- 172.21.15.81:0/2307990249 learned_addr learned my addr 172.21.15.81:0/2307990249 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:11.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 1 -- 172.21.15.81:0/2307990249 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1559082319 0 0) 0x7f22e4069400 con 0x7f22e409ef60 2024-09-10T16:32:11.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient(hunting): my global_id is 5102 2024-09-10T16:32:11.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 1 -- 172.21.15.81:0/2307990249 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22cc003530 con 0x7f22e409ef60 2024-09-10T16:32:11.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 1 -- 172.21.15.81:0/2307990249 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3830574926 0 0) 0x7f22e40a2010 con 0x7f22e4137080 2024-09-10T16:32:11.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient(hunting): my global_id is 5089 2024-09-10T16:32:11.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 1 -- 172.21.15.81:0/2307990249 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22e4069400 con 0x7f22e4137080 2024-09-10T16:32:11.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 1 -- 172.21.15.81:0/2307990249 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3292500307 0 0) 0x7f22e4069120 con 0x7f22e40a5ad0 2024-09-10T16:32:11.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient(hunting): my global_id is 4910 2024-09-10T16:32:11.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 1 -- 172.21.15.81:0/2307990249 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22e40a2010 con 0x7f22e40a5ad0 2024-09-10T16:32:11.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 1 -- 172.21.15.81:0/2307990249 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4262975914 0 0) 0x7f22e4069400 con 0x7f22e4137080 2024-09-10T16:32:11.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 1 -- 172.21.15.81:0/2307990249 >> v1:172.21.15.81:6793/0 conn(0x7f22e409ef60 legacy=0x7f22e413f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 1 -- 172.21.15.81:0/2307990249 >> v1:172.21.15.189:6791/0 conn(0x7f22e40a5ad0 legacy=0x7f22e409e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient: _finish_hunting 0 2024-09-10T16:32:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 1 monclient: found mon.noname-c 2024-09-10T16:32:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:32:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 1 -- 172.21.15.81:0/2307990249 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e40696e0 con 0x7f22e4137080 2024-09-10T16:32:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient: _finish_auth 0 2024-09-10T16:32:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient: _check_auth_tickets 2024-09-10T16:32:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 1 -- 172.21.15.81:0/2307990249 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f22dc001a50 con 0x7f22e4137080 2024-09-10T16:32:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 5 monclient: authenticate success, global_id 5089 2024-09-10T16:32:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:32:11.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient: dump: 2024-09-10T16:32:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.438 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.439 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 1 -- 172.21.15.81:0/2307990249 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f22dc001bf0 con 0x7f22e4137080 2024-09-10T16:32:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 4 set_mon_vals no callback set 2024-09-10T16:32:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 1 -- 172.21.15.81:0/2307990249 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f22dc004c30 con 0x7f22e4137080 2024-09-10T16:32:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22e27fc640 10 monclient: dump: 2024-09-10T16:32:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.439 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.440 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.440 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.440 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.440 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.440 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.440 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.440 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.440 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.440 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.440 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.440 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.440 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.440 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient: shutdown 2024-09-10T16:32:11.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:11.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 1 -- 172.21.15.81:0/2307990249 >> v1:172.21.15.81:6791/0 conn(0x7f22e4137080 legacy=0x7f22e413be90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 1 -- 172.21.15.81:0/2307990249 shutdown_connections 2024-09-10T16:32:11.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 1 -- 172.21.15.81:0/2307990249 >> 172.21.15.81:0/2307990249 conn(0x7f22e40a4fe0 msgr2=0x7f22e40a53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:11.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 1 -- 172.21.15.81:0/2307990249 shutdown_connections 2024-09-10T16:32:11.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 1 -- 172.21.15.81:0/2307990249 wait complete. 2024-09-10T16:32:11.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient: build_initial_monmap 2024-09-10T16:32:11.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.422+0000 7f22ea23e640 10 monclient: monmap: 2024-09-10T16:32:11.441 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:11.441 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:11.441 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:11.441 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:11.441 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:11.442 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:11.442 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:11.442 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:11.442 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:11.442 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:11.442 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:11.442 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:11.442 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:11.442 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:11.442 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:11.442 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 1 Processor -- start 2024-09-10T16:32:11.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 1 -- start start 2024-09-10T16:32:11.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 10 monclient: init 2024-09-10T16:32:11.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:11.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 10 monclient: _add_conns ranks=[0,1,7,4,6,8,3,5,2] 2024-09-10T16:32:11.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 10 monclient(hunting): picked mon.noname-a con 0x7f22e409ef60 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:11.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 10 monclient(hunting): picked mon.noname-f con 0x7f22e40a5ad0 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:11.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 10 monclient(hunting): picked mon.noname-i con 0x7f22e4137080 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:11.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e4099fb0 con 0x7f22e409ef60 2024-09-10T16:32:11.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e40976b0 con 0x7f22e40a5ad0 2024-09-10T16:32:11.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22e409a290 con 0x7f22e4137080 2024-09-10T16:32:11.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:11.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 10 monclient(hunting): authenticate will time out at 1098.828760s 2024-09-10T16:32:11.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22e37fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f22e409ef60 0x7f22e4096890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:40918/0 (socket says 172.21.15.81:40918) 2024-09-10T16:32:11.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22e37fe640 1 -- 172.21.15.81:0/445451074 learned_addr learned my addr 172.21.15.81:0/445451074 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:11.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3422668739 0 0) 0x7f22e4099fb0 con 0x7f22e409ef60 2024-09-10T16:32:11.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient(hunting): my global_id is 5166 2024-09-10T16:32:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22d0003530 con 0x7f22e409ef60 2024-09-10T16:32:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3665358734 0 0) 0x7f22d0003530 con 0x7f22e409ef60 2024-09-10T16:32:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22e4099fb0 con 0x7f22e409ef60 2024-09-10T16:32:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f22d8001bc0 con 0x7f22e409ef60 2024-09-10T16:32:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:32:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient(hunting): dump: 2024-09-10T16:32:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.444 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.445 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.445 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.445 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.445 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.445 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.445 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.445 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.445 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.445 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.445 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.445 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.445 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.445 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2415162309 0 0) 0x7f22e4099fb0 con 0x7f22e409ef60 2024-09-10T16:32:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 >> v1:172.21.15.189:6792/0 conn(0x7f22e4137080 legacy=0x7f22e41d3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 >> v1:172.21.15.189:6789/0 conn(0x7f22e40a5ad0 legacy=0x7f22e4096fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient: _finish_hunting 0 2024-09-10T16:32:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 monclient: found mon.a 2024-09-10T16:32:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e40a7510 con 0x7f22e409ef60 2024-09-10T16:32:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient: _finish_auth 0 2024-09-10T16:32:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient: _check_auth_tickets 2024-09-10T16:32:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 5 monclient: authenticate success, global_id 5166 2024-09-10T16:32:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 10 monclient: _renew_subs 2024-09-10T16:32:11.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:11.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 1 -- 172.21.15.81:0/445451074 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f22e40a4b30 con 0x7f22e409ef60 2024-09-10T16:32:11.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 10 monclient: _renew_subs 2024-09-10T16:32:11.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:11.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 1 -- 172.21.15.81:0/445451074 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f22e4099cd0 con 0x7f22e409ef60 2024-09-10T16:32:11.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f22d80038d0 con 0x7f22e409ef60 2024-09-10T16:32:11.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:11.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f22d8003f00 con 0x7f22e409ef60 2024-09-10T16:32:11.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22e1ffb640 4 set_mon_vals no callback set 2024-09-10T16:32:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient: dump: 2024-09-10T16:32:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.448 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.449 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22ea23e640 1 -- 172.21.15.81:0/445451074 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f22c40065d0 con 0x7f22c4002870 2024-09-10T16:32:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f22d80040a0 con 0x7f22e409ef60 2024-09-10T16:32:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 3257020974 0 0) 0x7f22d804af90 con 0x7f22e409ef60 2024-09-10T16:32:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2045031783 0 0) 0x7f22c40065d0 con 0x7f22c4002870 2024-09-10T16:32:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient(hunting): my global_id is 5111 2024-09-10T16:32:11.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22e4099fb0 con 0x7f22c4002870 2024-09-10T16:32:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2988298873 0 0) 0x7f22e4099fb0 con 0x7f22c4002870 2024-09-10T16:32:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22c40065d0 con 0x7f22c4002870 2024-09-10T16:32:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f22dc001bb0 con 0x7f22c4002870 2024-09-10T16:32:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient: dump: 2024-09-10T16:32:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.450 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.451 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22e3fff640 10 monclient: get_auth_request con 0x7f22d003cf70 auth_method 0 2024-09-10T16:32:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2986461060 0 0) 0x7f22c40065d0 con 0x7f22c4002870 2024-09-10T16:32:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 --> v1:172.21.15.81:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f22c400a170 con 0x7f22c4002870 2024-09-10T16:32:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f22dc001f20 con 0x7f22c4002870 2024-09-10T16:32:11.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 >> v1:172.21.15.81:6793/0 conn(0x7f22c4002870 legacy=0x7f22c4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.426+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 >> v1:172.21.15.81:6793/0 conn(0x7f22c4002870 legacy=0x7f22c4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22ea23e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22ea23e640 1 -- 172.21.15.81:0/445451074 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f22c4009e80 con 0x7f22c4009140 2024-09-10T16:32:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2439192505 0 0) 0x7f22c4009e80 con 0x7f22c4009140 2024-09-10T16:32:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 10 monclient(hunting): my global_id is 5120 2024-09-10T16:32:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22c40065d0 con 0x7f22c4009140 2024-09-10T16:32:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2093940415 0 0) 0x7f22c40065d0 con 0x7f22c4009140 2024-09-10T16:32:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f22c4009e80 con 0x7f22c4009140 2024-09-10T16:32:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f22dc0050a0 con 0x7f22c4009140 2024-09-10T16:32:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 10 monclient: dump: 2024-09-10T16:32:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.454 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.455 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1040863927 0 0) 0x7f22c4009e80 con 0x7f22c4009140 2024-09-10T16:32:11.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 --> v1:172.21.15.81:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f22c400c420 con 0x7f22c4009140 2024-09-10T16:32:11.456 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:11.456 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:11.456 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:11.456 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:11.456 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:11.456 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 141395, 2024-09-10T16:32:11.456 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:11.456 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:11.456 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:11.456 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:11.456 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:11.456 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:11.456 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:11.457 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:11.457 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:11.457 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:11.457 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.457 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:32:11.457 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:11.457 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:11.457 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:11.457 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.457 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.457 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.457 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.457 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.458 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.458 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.458 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.458 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.458 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.458 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.458 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.458 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:11.458 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:11.458 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.458 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.458 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.458 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.458 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.459 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.459 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.459 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.459 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.459 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.459 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.459 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.459 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.459 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:11.459 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:11.459 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:11.459 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:11.459 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:11.460 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:11.460 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:11.460 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:11.460 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:11.460 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:11.460 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:11.460 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:11.460 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:11.460 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:11.460 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:11.460 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:11.460 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:11.460 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.460 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.461 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.461 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.461 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.461 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.461 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.461 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.461 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.461 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.461 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.461 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.461 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:11.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.461 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:11.461 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.462 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:11.462 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:11.462 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.462 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.462 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.462 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:11.462 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.462 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.462 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.462 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:11.462 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:11.463 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.463 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.463 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.463 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:11.463 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:11.463 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.463 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.463 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:11.463 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.463 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.464 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.464 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:11.464 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:11.464 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.464 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.464 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.464 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.464 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:11.464 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:11.464 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.464 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.465 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:11.465 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.465 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.465 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:11.465 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:11.465 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.465 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.465 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.465 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.466 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:11.466 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:11.466 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.466 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.466 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:11.466 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.466 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.466 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.466 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:11.466 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:11.467 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.467 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.467 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.467 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:11.467 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:11.467 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.467 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.467 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:11.467 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.468 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.468 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:11.468 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:11.468 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.468 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.468 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.468 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.468 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:11.468 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:11.468 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.468 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.468 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.469 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:11.470 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:11.470 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.470 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.470 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.470 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.470 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:11.470 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.470 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.470 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.470 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:11.470 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:11.470 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.470 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.471 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.471 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:11.471 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:11.471 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.471 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.471 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.471 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:11.471 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.471 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.471 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.472 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:11.472 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:11.472 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.472 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.472 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.472 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.472 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:11.472 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:11.472 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.472 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.472 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.473 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:11.473 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.473 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.473 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.473 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:11.473 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:11.473 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.473 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.473 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.473 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.473 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.473 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:11.474 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:11.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.474 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:11.474 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:11.474 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:11.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.474 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.474 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:11.474 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.474 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:11.474 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:11.474 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:11.474 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.474 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.475 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.475 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:11.475 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 1897169554) 0x7f22dc007320 con 0x7f22c4009140 2024-09-10T16:32:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 >> v1:172.21.15.81:6793/0 conn(0x7f22c4009140 legacy=0x7f22c40095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22cbfff640 1 -- 172.21.15.81:0/445451074 >> v1:172.21.15.81:6793/0 conn(0x7f22c4009140 legacy=0x7f22c40095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22ea23e640 1 -- 172.21.15.81:0/445451074 >> v1:172.21.15.189:6812/1108603242 conn(0x7f22d003cf70 legacy=0x7f22d003f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22ea23e640 10 monclient: shutdown 2024-09-10T16:32:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22ea23e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22ea23e640 1 -- 172.21.15.81:0/445451074 >> v1:172.21.15.81:6789/0 conn(0x7f22e409ef60 legacy=0x7f22e4096890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22e3fff640 1 -- 172.21.15.81:0/445451074 reap_dead start 2024-09-10T16:32:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22e3fff640 1 -- 172.21.15.81:0/445451074 reap_dead start 2024-09-10T16:32:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22ea23e640 1 -- 172.21.15.81:0/445451074 shutdown_connections 2024-09-10T16:32:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22ea23e640 1 -- 172.21.15.81:0/445451074 >> 172.21.15.81:0/445451074 conn(0x7f22e40a4fe0 msgr2=0x7f22e4095110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22ea23e640 1 -- 172.21.15.81:0/445451074 shutdown_connections 2024-09-10T16:32:11.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.434+0000 7f22ea23e640 1 -- 172.21.15.81:0/445451074 wait complete. 2024-09-10T16:32:11.477 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:11.477 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-10T16:32:11.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-10T16:32:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 10 monclient: get_monmap_and_config 2024-09-10T16:32:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 10 monclient: build_initial_monmap 2024-09-10T16:32:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 10 monclient: monmap: 2024-09-10T16:32:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:11.590875+0000 2024-09-10T16:32:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:11.590875+0000 2024-09-10T16:32:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:11.593 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 1 Processor -- start 2024-09-10T16:32:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 1 -- start start 2024-09-10T16:32:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 10 monclient: init 2024-09-10T16:32:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 10 monclient: _add_conns ranks=[3,4,5,1,2,6,7,0,8] 2024-09-10T16:32:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 10 monclient(hunting): picked mon.noname-g con 0x7fdd2009e9d0 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:11.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 10 monclient(hunting): picked mon.noname-c con 0x7fdd2009f4c0 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 10 monclient(hunting): picked mon.noname-h con 0x7fdd2013bf80 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2009fd40 con 0x7fdd2009e9d0 2024-09-10T16:32:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd200a01c0 con 0x7fdd2009f4c0 2024-09-10T16:32:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2009fb00 con 0x7fdd2013bf80 2024-09-10T16:32:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 10 monclient(hunting): authenticate will time out at 1098.990436s 2024-09-10T16:32:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1e7fc640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fdd2009f4c0 0x7fdd2013a860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:35410/0 (socket says 172.21.15.81:35410) 2024-09-10T16:32:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1e7fc640 1 -- 172.21.15.81:0/2611412139 learned_addr learned my addr 172.21.15.81:0/2611412139 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 1 -- 172.21.15.81:0/2611412139 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1467289730 0 0) 0x7fdd200a01c0 con 0x7fdd2009f4c0 2024-09-10T16:32:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient(hunting): my global_id is 5098 2024-09-10T16:32:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 1 -- 172.21.15.81:0/2611412139 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd08003530 con 0x7fdd2009f4c0 2024-09-10T16:32:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 1 -- 172.21.15.81:0/2611412139 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 166798884 0 0) 0x7fdd08003530 con 0x7fdd2009f4c0 2024-09-10T16:32:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 1 -- 172.21.15.81:0/2611412139 >> v1:172.21.15.189:6791/0 conn(0x7fdd2013bf80 legacy=0x7fdd2013e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 1 -- 172.21.15.81:0/2611412139 >> v1:172.21.15.189:6790/0 conn(0x7fdd2009e9d0 legacy=0x7fdd2009edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient: _finish_hunting 0 2024-09-10T16:32:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 1 monclient: found mon.noname-c 2024-09-10T16:32:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:32:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 1 -- 172.21.15.81:0/2611412139 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2009ff40 con 0x7fdd2009f4c0 2024-09-10T16:32:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient: _finish_auth 0 2024-09-10T16:32:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient: _check_auth_tickets 2024-09-10T16:32:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 1 -- 172.21.15.81:0/2611412139 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdd14001840 con 0x7fdd2009f4c0 2024-09-10T16:32:11.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 5 monclient: authenticate success, global_id 5098 2024-09-10T16:32:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:32:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient: dump: 2024-09-10T16:32:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.603 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.604 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.605 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 1 -- 172.21.15.81:0/2611412139 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd14001a60 con 0x7fdd2009f4c0 2024-09-10T16:32:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 4 set_mon_vals no callback set 2024-09-10T16:32:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 1 -- 172.21.15.81:0/2611412139 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdd14004bf0 con 0x7fdd2009f4c0 2024-09-10T16:32:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:11.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd1dffb640 10 monclient: dump: 2024-09-10T16:32:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.606 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.607 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 10 monclient: shutdown 2024-09-10T16:32:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 1 -- 172.21.15.81:0/2611412139 >> v1:172.21.15.81:6791/0 conn(0x7fdd2009f4c0 legacy=0x7fdd2013a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 1 -- 172.21.15.81:0/2611412139 shutdown_connections 2024-09-10T16:32:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 1 -- 172.21.15.81:0/2611412139 >> 172.21.15.81:0/2611412139 conn(0x7fdd200a3fd0 msgr2=0x7fdd200a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:11.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.586+0000 7fdd25342640 1 -- 172.21.15.81:0/2611412139 shutdown_connections 2024-09-10T16:32:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 1 -- 172.21.15.81:0/2611412139 wait complete. 2024-09-10T16:32:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 monclient: build_initial_monmap 2024-09-10T16:32:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 monclient: monmap: 2024-09-10T16:32:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:11.608 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:11.609 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 1 Processor -- start 2024-09-10T16:32:11.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 1 -- start start 2024-09-10T16:32:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 monclient: init 2024-09-10T16:32:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 monclient: _add_conns ranks=[6,2,8,3,7,5,1,4,0] 2024-09-10T16:32:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 monclient(hunting): picked mon.noname-d con 0x7fdd2009e9d0 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 monclient(hunting): picked mon.noname-b con 0x7fdd2009f4c0 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 monclient(hunting): picked mon.noname-e con 0x7fdd2013bf80 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2008fca0 con 0x7fdd2009f4c0 2024-09-10T16:32:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd20074640 con 0x7fdd2009e9d0 2024-09-10T16:32:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdd2013b870 con 0x7fdd2013bf80 2024-09-10T16:32:11.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 monclient(hunting): authenticate will time out at 1098.993560s 2024-09-10T16:32:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd1e7fc640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fdd2009f4c0 0x7fdd201ce6b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:42396/0 (socket says 172.21.15.81:42396) 2024-09-10T16:32:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd1e7fc640 1 -- 172.21.15.81:0/776223764 learned_addr learned my addr 172.21.15.81:0/776223764 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd1effd640 1 --1- 172.21.15.81:0/776223764 >> v1:172.21.15.81:6792/0 conn(0x7fdd2009e9d0 0x7fdd20097540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:58462/0 (socket says 172.21.15.81:58462) 2024-09-10T16:32:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3327940055 0 0) 0x7fdd20074640 con 0x7fdd2009e9d0 2024-09-10T16:32:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): my global_id is 5091 2024-09-10T16:32:11.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd0c003530 con 0x7fdd2009e9d0 2024-09-10T16:32:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2369784502 0 0) 0x7fdd2008fca0 con 0x7fdd2009f4c0 2024-09-10T16:32:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): my global_id is 5141 2024-09-10T16:32:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd20074640 con 0x7fdd2009f4c0 2024-09-10T16:32:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2807414264 0 0) 0x7fdd2013b870 con 0x7fdd2013bf80 2024-09-10T16:32:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): my global_id is 5129 2024-09-10T16:32:11.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd2008fca0 con 0x7fdd2013bf80 2024-09-10T16:32:11.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 644113289 0 0) 0x7fdd0c003530 con 0x7fdd2009e9d0 2024-09-10T16:32:11.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd2013b870 con 0x7fdd2009e9d0 2024-09-10T16:32:11.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdd10001ae0 con 0x7fdd2009e9d0 2024-09-10T16:32:11.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:11.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:32:11.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): dump: 2024-09-10T16:32:11.613 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.613 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.613 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.614 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.615 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3787393883 0 0) 0x7fdd20074640 con 0x7fdd2009f4c0 2024-09-10T16:32:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd0c003530 con 0x7fdd2009f4c0 2024-09-10T16:32:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4204030323 0 0) 0x7fdd2008fca0 con 0x7fdd2013bf80 2024-09-10T16:32:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd20074640 con 0x7fdd2013bf80 2024-09-10T16:32:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdd14004b30 con 0x7fdd2009f4c0 2024-09-10T16:32:11.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): dump: 2024-09-10T16:32:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.616 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.617 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdd18001c30 con 0x7fdd2013bf80 2024-09-10T16:32:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient(hunting): dump: 2024-09-10T16:32:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.617 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.618 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.618 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2597934133 0 0) 0x7fdd0c003530 con 0x7fdd2009f4c0 2024-09-10T16:32:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 >> v1:172.21.15.81:6793/0 conn(0x7fdd2013bf80 legacy=0x7fdd201d1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 >> v1:172.21.15.81:6792/0 conn(0x7fdd2009e9d0 legacy=0x7fdd20097540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient: _finish_hunting 0 2024-09-10T16:32:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 monclient: found mon.b 2024-09-10T16:32:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd2008e630 con 0x7fdd2009f4c0 2024-09-10T16:32:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient: _finish_auth 0 2024-09-10T16:32:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient: _check_auth_tickets 2024-09-10T16:32:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 5 monclient: authenticate success, global_id 5141 2024-09-10T16:32:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 monclient: _renew_subs 2024-09-10T16:32:11.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdd20090720 con 0x7fdd2009f4c0 2024-09-10T16:32:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 monclient: _renew_subs 2024-09-10T16:32:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fdd2008f800 con 0x7fdd2009f4c0 2024-09-10T16:32:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdd140011c0 con 0x7fdd2009f4c0 2024-09-10T16:32:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdd14004eb0 con 0x7fdd2009f4c0 2024-09-10T16:32:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd1d7fa640 4 set_mon_vals no callback set 2024-09-10T16:32:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 10 monclient: dump: 2024-09-10T16:32:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.620 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.621 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.622 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd25342640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdd000065d0 con 0x7fdd00002870 2024-09-10T16:32:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.590+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fdd14010dc0 con 0x7fdd2009f4c0 2024-09-10T16:32:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 3257020974 0 0) 0x7fdd1404af00 con 0x7fdd2009f4c0 2024-09-10T16:32:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd1f7fe640 10 monclient: get_auth_request con 0x7fdd0c03fb80 auth_method 0 2024-09-10T16:32:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4050792914 0 0) 0x7fdd000065d0 con 0x7fdd00002870 2024-09-10T16:32:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 10 monclient(hunting): my global_id is 5158 2024-09-10T16:32:11.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd0c003530 con 0x7fdd00002870 2024-09-10T16:32:11.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1073328398 0 0) 0x7fdd0c003530 con 0x7fdd00002870 2024-09-10T16:32:11.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd000065d0 con 0x7fdd00002870 2024-09-10T16:32:11.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdd10003f40 con 0x7fdd00002870 2024-09-10T16:32:11.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:32:11.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 10 monclient: dump: 2024-09-10T16:32:11.623 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.623 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.623 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.623 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.624 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.624 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.624 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.624 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.624 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.624 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.624 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.624 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.624 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.624 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.624 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.625 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3578377011 0 0) 0x7fdd000065d0 con 0x7fdd00002870 2024-09-10T16:32:11.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.189:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdd0000a170 con 0x7fdd00002870 2024-09-10T16:32:11.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fdd10004160 con 0x7fdd00002870 2024-09-10T16:32:11.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:11.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:11.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 >> v1:172.21.15.189:6789/0 conn(0x7fdd00002870 legacy=0x7fdd00004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.594+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 >> v1:172.21.15.189:6789/0 conn(0x7fdd00002870 legacy=0x7fdd00004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:11.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd25342640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:11.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd25342640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdd00009e60 con 0x7fdd00009120 2024-09-10T16:32:11.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1441074156 0 0) 0x7fdd00009e60 con 0x7fdd00009120 2024-09-10T16:32:11.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 10 monclient(hunting): my global_id is 5167 2024-09-10T16:32:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdd000065d0 con 0x7fdd00009120 2024-09-10T16:32:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1352708877 0 0) 0x7fdd000065d0 con 0x7fdd00009120 2024-09-10T16:32:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdd00009e60 con 0x7fdd00009120 2024-09-10T16:32:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdd10005b90 con 0x7fdd00009120 2024-09-10T16:32:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:32:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 10 monclient: dump: 2024-09-10T16:32:11.628 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.629 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.630 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4133888527 0 0) 0x7fdd00009e60 con 0x7fdd00009120 2024-09-10T16:32:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 --> v1:172.21.15.189:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdd0000c400 con 0x7fdd00009120 2024-09-10T16:32:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 2644298090) 0x7fdd10006ef0 con 0x7fdd00009120 2024-09-10T16:32:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:11.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 >> v1:172.21.15.189:6789/0 conn(0x7fdd00009120 legacy=0x7fdd000095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd077fe640 1 -- 172.21.15.81:0/776223764 >> v1:172.21.15.189:6789/0 conn(0x7fdd00009120 legacy=0x7fdd000095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:11.631 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 141524, 2024-09-10T16:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:11.632 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.633 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.634 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:11.636 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.637 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.638 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.640 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.641 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:11.642 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:11.643 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.645 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.646 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:11.647 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:11.648 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:11.649 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.650 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.651 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:11.652 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:11.653 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:11.654 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-09-10T16:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.655 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:11.656 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd25342640 1 -- 172.21.15.81:0/776223764 >> v1:172.21.15.189:6812/1108603242 conn(0x7fdd0c03fb80 legacy=0x7fdd0c042040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd25342640 10 monclient: shutdown 2024-09-10T16:32:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd25342640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:11.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd25342640 1 -- 172.21.15.81:0/776223764 >> v1:172.21.15.81:6790/0 conn(0x7fdd2009f4c0 legacy=0x7fdd201ce6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd1f7fe640 1 -- 172.21.15.81:0/776223764 reap_dead start 2024-09-10T16:32:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd1f7fe640 1 -- 172.21.15.81:0/776223764 reap_dead start 2024-09-10T16:32:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd25342640 1 -- 172.21.15.81:0/776223764 shutdown_connections 2024-09-10T16:32:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd25342640 1 -- 172.21.15.81:0/776223764 >> 172.21.15.81:0/776223764 conn(0x7fdd200a3fd0 msgr2=0x7fdd2009a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd25342640 1 -- 172.21.15.81:0/776223764 shutdown_connections 2024-09-10T16:32:11.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.602+0000 7fdd25342640 1 -- 172.21.15.81:0/776223764 wait complete. 2024-09-10T16:32:11.658 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:11.659 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-10T16:32:11.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-10T16:32:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.766+0000 7fb6a6e61640 10 monclient: get_monmap_and_config 2024-09-10T16:32:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.766+0000 7fb6a6e61640 10 monclient: build_initial_monmap 2024-09-10T16:32:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.766+0000 7fb6a6e61640 10 monclient: monmap: 2024-09-10T16:32:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:11.773039+0000 2024-09-10T16:32:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:11.773039+0000 2024-09-10T16:32:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:11.773 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:11.774 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:11.774 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.766+0000 7fb6a6e61640 1 Processor -- start 2024-09-10T16:32:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 1 -- start start 2024-09-10T16:32:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient: init 2024-09-10T16:32:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient: _add_conns ranks=[5,7,6,1,0,4,8,2,3] 2024-09-10T16:32:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient(hunting): picked mon.noname-h con 0x7fb6a00a5510 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient(hunting): picked mon.noname-i con 0x7fb6a0135bf0 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient(hunting): picked mon.noname-d con 0x7fb6a0136060 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a009d7e0 con 0x7fb6a00a5510 2024-09-10T16:32:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a009dac0 con 0x7fb6a0136060 2024-09-10T16:32:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a009dda0 con 0x7fb6a0135bf0 2024-09-10T16:32:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient(hunting): authenticate will time out at 1099.172830s 2024-09-10T16:32:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a53fe640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fb6a0136060 0x7fb6a0141560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:58472/0 (socket says 172.21.15.81:58472) 2024-09-10T16:32:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a53fe640 1 -- 172.21.15.81:0/3504198105 learned_addr learned my addr 172.21.15.81:0/3504198105 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 1 -- 172.21.15.81:0/3504198105 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3698750733 0 0) 0x7fb6a009dac0 con 0x7fb6a0136060 2024-09-10T16:32:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient(hunting): my global_id is 5100 2024-09-10T16:32:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 1 -- 172.21.15.81:0/3504198105 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb68c003530 con 0x7fb6a0136060 2024-09-10T16:32:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 1 -- 172.21.15.81:0/3504198105 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1806010339 0 0) 0x7fb68c003530 con 0x7fb6a0136060 2024-09-10T16:32:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 1 -- 172.21.15.81:0/3504198105 >> v1:172.21.15.189:6792/0 conn(0x7fb6a0135bf0 legacy=0x7fb6a013de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 1 -- 172.21.15.81:0/3504198105 >> v1:172.21.15.189:6791/0 conn(0x7fb6a00a5510 legacy=0x7fb6a00a58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:32:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 1 monclient: found mon.noname-d 2024-09-10T16:32:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:32:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 1 -- 172.21.15.81:0/3504198105 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a009cca0 con 0x7fb6a0136060 2024-09-10T16:32:11.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient: _finish_auth 0 2024-09-10T16:32:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:32:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 1 -- 172.21.15.81:0/3504198105 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb690001840 con 0x7fb6a0136060 2024-09-10T16:32:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:32:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient: dump: 2024-09-10T16:32:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.787 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 5 monclient: authenticate success, global_id 5100 2024-09-10T16:32:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 1 -- 172.21.15.81:0/3504198105 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb690001a60 con 0x7fb6a0136060 2024-09-10T16:32:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 1 -- 172.21.15.81:0/3504198105 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb690001d50 con 0x7fb6a0136060 2024-09-10T16:32:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 4 set_mon_vals no callback set 2024-09-10T16:32:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:32:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb69f7fe640 10 monclient: dump: 2024-09-10T16:32:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.790 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient: shutdown 2024-09-10T16:32:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3504198105 >> v1:172.21.15.81:6792/0 conn(0x7fb6a0136060 legacy=0x7fb6a0141560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3504198105 shutdown_connections 2024-09-10T16:32:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3504198105 >> 172.21.15.81:0/3504198105 conn(0x7fb6a006dae0 msgr2=0x7fb6a00ab8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:11.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3504198105 shutdown_connections 2024-09-10T16:32:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3504198105 wait complete. 2024-09-10T16:32:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient: build_initial_monmap 2024-09-10T16:32:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient: monmap: 2024-09-10T16:32:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:11.792 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 1 Processor -- start 2024-09-10T16:32:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 1 -- start start 2024-09-10T16:32:11.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient: init 2024-09-10T16:32:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient: _add_conns ranks=[4,7,0,2,1,3,8,6,5] 2024-09-10T16:32:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient(hunting): picked mon.noname-c con 0x7fb6a00a5510 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient(hunting): picked mon.noname-i con 0x7fb6a0135bf0 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient(hunting): picked mon.noname-a con 0x7fb6a0136060 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a00a2420 con 0x7fb6a0136060 2024-09-10T16:32:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a00a0600 con 0x7fb6a00a5510 2024-09-10T16:32:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb6a00a2700 con 0x7fb6a0135bf0 2024-09-10T16:32:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:11.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a6e61640 10 monclient(hunting): authenticate will time out at 1099.175668s 2024-09-10T16:32:11.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a4bfd640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fb6a00a5510 0x7fb6a009e9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:35412/0 (socket says 172.21.15.81:35412) 2024-09-10T16:32:11.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.770+0000 7fb6a4bfd640 1 -- 172.21.15.81:0/3977335850 learned_addr learned my addr 172.21.15.81:0/3977335850 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:11.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1956770872 0 0) 0x7fb6a00a0600 con 0x7fb6a00a5510 2024-09-10T16:32:11.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): my global_id is 5107 2024-09-10T16:32:11.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb680003530 con 0x7fb6a00a5510 2024-09-10T16:32:11.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2896860883 0 0) 0x7fb6a00a2420 con 0x7fb6a0136060 2024-09-10T16:32:11.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): my global_id is 5175 2024-09-10T16:32:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a00a0600 con 0x7fb6a0136060 2024-09-10T16:32:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2326762661 0 0) 0x7fb680003530 con 0x7fb6a00a5510 2024-09-10T16:32:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6a00a2420 con 0x7fb6a00a5510 2024-09-10T16:32:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb698001ba0 con 0x7fb6a00a5510 2024-09-10T16:32:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:32:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): dump: 2024-09-10T16:32:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.795 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.796 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.797 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4103856934 0 0) 0x7fb6a00a2700 con 0x7fb6a0135bf0 2024-09-10T16:32:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): my global_id is 5038 2024-09-10T16:32:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb680003530 con 0x7fb6a0135bf0 2024-09-10T16:32:11.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3892413483 0 0) 0x7fb6a00a0600 con 0x7fb6a0136060 2024-09-10T16:32:11.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6a00a2700 con 0x7fb6a0136060 2024-09-10T16:32:11.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb6900010b0 con 0x7fb6a0136060 2024-09-10T16:32:11.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:11.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:11.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): dump: 2024-09-10T16:32:11.798 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.798 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.798 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.798 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.798 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.798 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.799 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.799 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.799 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.799 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.799 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.799 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.799 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.799 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.799 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.799 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1570683943 0 0) 0x7fb6a00a2420 con 0x7fb6a00a5510 2024-09-10T16:32:11.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 >> v1:172.21.15.189:6792/0 conn(0x7fb6a0135bf0 legacy=0x7fb6a009f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 >> v1:172.21.15.81:6789/0 conn(0x7fb6a0136060 legacy=0x7fb6a01d5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient: _finish_hunting 0 2024-09-10T16:32:11.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 monclient: found mon.c 2024-09-10T16:32:11.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:11.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:32:11.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6a00a6330 con 0x7fb6a00a5510 2024-09-10T16:32:11.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient: _finish_auth 0 2024-09-10T16:32:11.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient: _check_auth_tickets 2024-09-10T16:32:11.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:11.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb6a6e61640 5 monclient: authenticate success, global_id 5107 2024-09-10T16:32:11.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb6a6e61640 10 monclient: _renew_subs 2024-09-10T16:32:11.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb6a6e61640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:32:11.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb6a009f7c0 con 0x7fb6a00a5510 2024-09-10T16:32:11.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb6a6e61640 10 monclient: _renew_subs 2024-09-10T16:32:11.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb6a6e61640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:32:11.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fb6a00a4e90 con 0x7fb6a00a5510 2024-09-10T16:32:11.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb6980038d0 con 0x7fb6a00a5510 2024-09-10T16:32:11.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:11.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb698003e80 con 0x7fb6a00a5510 2024-09-10T16:32:11.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:11.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69effd640 4 set_mon_vals no callback set 2024-09-10T16:32:11.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient: dump: 2024-09-10T16:32:11.802 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.802 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.802 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.802 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.803 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.803 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.803 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.803 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.803 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.803 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.803 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.803 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.803 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.804 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.804 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.804 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb6a6e61640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:11.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fb6980040a0 con 0x7fb6a00a5510 2024-09-10T16:32:11.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb6840065d0 con 0x7fb684002870 2024-09-10T16:32:11.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 3257020974 0 0) 0x7fb69804b070 con 0x7fb6a00a5510 2024-09-10T16:32:11.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb6a53fe640 10 monclient: get_auth_request con 0x7fb68003d820 auth_method 0 2024-09-10T16:32:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3263086224 0 0) 0x7fb6840065d0 con 0x7fb684002870 2024-09-10T16:32:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient(hunting): my global_id is 134130 2024-09-10T16:32:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a00a2420 con 0x7fb684002870 2024-09-10T16:32:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3327335488 0 0) 0x7fb6a00a2420 con 0x7fb684002870 2024-09-10T16:32:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb6840065d0 con 0x7fb684002870 2024-09-10T16:32:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb688001d10 con 0x7fb684002870 2024-09-10T16:32:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:32:11.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 10 monclient: dump: 2024-09-10T16:32:11.806 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.806 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.806 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.806 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.806 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.806 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.806 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.806 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.806 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.806 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.807 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 936877600 0 0) 0x7fb6840065d0 con 0x7fb684002870 2024-09-10T16:32:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.774+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.189:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb68400a170 con 0x7fb684002870 2024-09-10T16:32:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.778+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.3 v1:172.21.15.189:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb688001fe0 con 0x7fb684002870 2024-09-10T16:32:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.778+0000 7fb69d7fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.778+0000 7fb69d7fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.778+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 >> v1:172.21.15.189:6790/0 conn(0x7fb684002870 legacy=0x7fb684004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.778+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 >> v1:172.21.15.189:6790/0 conn(0x7fb684002870 legacy=0x7fb684004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:11.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb6a6e61640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:11.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb684009e80 con 0x7fb684009140 2024-09-10T16:32:11.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1266902653 0 0) 0x7fb684009e80 con 0x7fb684009140 2024-09-10T16:32:11.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 10 monclient(hunting): my global_id is 134139 2024-09-10T16:32:11.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6840065d0 con 0x7fb684009140 2024-09-10T16:32:11.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69ffff640 1 -- 172.21.15.81:0/3977335850 >> v1:172.21.15.189:6790/0 conn(0x7fb684009140 legacy=0x7fb6840095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T16:32:11.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69ffff640 1 -- 172.21.15.81:0/3977335850 >> v1:172.21.15.189:6790/0 conn(0x7fb684009140 legacy=0x7fb6840095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T16:32:11.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69ffff640 1 --1- 172.21.15.81:0/3977335850 >> v1:172.21.15.189:6790/0 conn(0x7fb684009140 0x7fb6840095d0 :-1 s=OPENED pgs=48 cs=1 l=1).handle_message read tag failed 2024-09-10T16:32:11.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69ffff640 1 --1- 172.21.15.81:0/3977335850 >> v1:172.21.15.189:6790/0 conn(0x7fb684009140 0x7fb6840095d0 :-1 s=OPENED pgs=48 cs=1 l=1).fault on lossy channel, failing 2024-09-10T16:32:11.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 >> v1:172.21.15.189:6790/0 conn(0x7fb684009140 legacy=0x7fb6840095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:11.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 >> v1:172.21.15.189:6790/0 conn(0x7fb684009140 legacy=0x7fb6840095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb684009e80 con 0x7fb680046400 2024-09-10T16:32:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1031091545 0 0) 0x7fb684009e80 con 0x7fb680046400 2024-09-10T16:32:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 10 monclient(hunting): my global_id is 134148 2024-09-10T16:32:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.782+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb6a00a2420 con 0x7fb680046400 2024-09-10T16:32:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3529039360 0 0) 0x7fb6a00a2420 con 0x7fb680046400 2024-09-10T16:32:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb684009e80 con 0x7fb680046400 2024-09-10T16:32:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb6880050b0 con 0x7fb680046400 2024-09-10T16:32:11.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb69d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb69d7fa640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:32:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb69d7fa640 10 monclient: dump: 2024-09-10T16:32:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.812 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.813 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.813 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.813 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.813 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.813 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.813 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.813 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 834216258 0 0) 0x7fb684009e80 con 0x7fb680046400 2024-09-10T16:32:11.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 --> v1:172.21.15.189:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb688001fe0 con 0x7fb680046400 2024-09-10T16:32:11.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 <== mon.3 v1:172.21.15.189:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7542 (unknown 0 0 1852828955) 0x7fb688007350 con 0x7fb680046400 2024-09-10T16:32:11.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb69d7fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:11.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb69d7fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:11.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 >> v1:172.21.15.189:6790/0 conn(0x7fb680046400 legacy=0x7fb680044a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb69d7fa640 1 -- 172.21.15.81:0/3977335850 >> v1:172.21.15.189:6790/0 conn(0x7fb680046400 legacy=0x7fb680044a50 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:11.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb6a53fe640 1 -- 172.21.15.81:0/3977335850 reap_dead start 2024-09-10T16:32:11.814 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:11.814 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 1511, 2024-09-10T16:32:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:11.815 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:32:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.816 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.817 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.818 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:11.819 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:11.820 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.821 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.822 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.823 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.824 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:11.825 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.826 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.828 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.830 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.831 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.833 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.834 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.835 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:11.836 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:11.837 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.839 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.840 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.841 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:11.841 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3977335850 >> v1:172.21.15.189:6812/1108603242 conn(0x7fb68003d820 legacy=0x7fb68003fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb6a6e61640 10 monclient: shutdown 2024-09-10T16:32:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb6a6e61640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3977335850 >> v1:172.21.15.81:6791/0 conn(0x7fb6a00a5510 legacy=0x7fb6a009e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3977335850 shutdown_connections 2024-09-10T16:32:11.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3977335850 >> 172.21.15.81:0/3977335850 conn(0x7fb6a006dae0 msgr2=0x7fb6a00a7c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:11.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3977335850 shutdown_connections 2024-09-10T16:32:11.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.786+0000 7fb6a6e61640 1 -- 172.21.15.81:0/3977335850 wait complete. 2024-09-10T16:32:11.844 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:11.844 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-10T16:32:11.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-10T16:32:11.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient: get_monmap_and_config 2024-09-10T16:32:11.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient: build_initial_monmap 2024-09-10T16:32:11.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient: monmap: 2024-09-10T16:32:11.954 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:11.954 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.954 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:11.954227+0000 2024-09-10T16:32:11.954 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:11.954227+0000 2024-09-10T16:32:11.954 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:11.954 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.955 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:11.955 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:11.955 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:11.955 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:11.955 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:11.955 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:11.955 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:11.955 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:11.955 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:11.955 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 1 Processor -- start 2024-09-10T16:32:11.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 1 -- start start 2024-09-10T16:32:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient: init 2024-09-10T16:32:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient: _add_conns ranks=[1,3,4,8,5,0,7,2,6] 2024-09-10T16:32:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient(hunting): picked mon.noname-f con 0x7fdf8409b4c0 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient(hunting): picked mon.noname-g con 0x7fdf840a2620 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient(hunting): picked mon.noname-c con 0x7fdf8413c320 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf840a15d0 con 0x7fdf8409b4c0 2024-09-10T16:32:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf840a0d30 con 0x7fdf840a2620 2024-09-10T16:32:11.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf840a1010 con 0x7fdf8413c320 2024-09-10T16:32:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient(hunting): authenticate will time out at 1099.353757s 2024-09-10T16:32:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf82d9d640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fdf8413c320 0x7fdf8413e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:35416/0 (socket says 172.21.15.81:35416) 2024-09-10T16:32:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf82d9d640 1 -- 172.21.15.81:0/287342971 learned_addr learned my addr 172.21.15.81:0/287342971 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 1 -- 172.21.15.81:0/287342971 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1929479902 0 0) 0x7fdf840a1010 con 0x7fdf8413c320 2024-09-10T16:32:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient(hunting): my global_id is 5116 2024-09-10T16:32:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 1 -- 172.21.15.81:0/287342971 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf6c003530 con 0x7fdf8413c320 2024-09-10T16:32:11.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 1 -- 172.21.15.81:0/287342971 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1701560442 0 0) 0x7fdf6c003530 con 0x7fdf8413c320 2024-09-10T16:32:11.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 1 -- 172.21.15.81:0/287342971 >> v1:172.21.15.189:6790/0 conn(0x7fdf840a2620 legacy=0x7fdf8413ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 1 -- 172.21.15.81:0/287342971 >> v1:172.21.15.189:6789/0 conn(0x7fdf8409b4c0 legacy=0x7fdf8409b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient: _finish_hunting 0 2024-09-10T16:32:11.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 1 monclient: found mon.noname-c 2024-09-10T16:32:11.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:11.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:32:11.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 1 -- 172.21.15.81:0/287342971 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf840a12f0 con 0x7fdf8413c320 2024-09-10T16:32:11.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient: _finish_auth 0 2024-09-10T16:32:11.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient: _check_auth_tickets 2024-09-10T16:32:11.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:11.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 1 -- 172.21.15.81:0/287342971 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdf74001840 con 0x7fdf8413c320 2024-09-10T16:32:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:32:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient: dump: 2024-09-10T16:32:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.967 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.968 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.968 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.968 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.968 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.968 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.968 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.968 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.968 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 5 monclient: authenticate success, global_id 5116 2024-09-10T16:32:11.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 1 -- 172.21.15.81:0/287342971 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdf74001a60 con 0x7fdf8413c320 2024-09-10T16:32:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 1 -- 172.21.15.81:0/287342971 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdf74004bf0 con 0x7fdf8413c320 2024-09-10T16:32:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf8159a640 10 monclient: dump: 2024-09-10T16:32:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.969 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.970 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.971 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 4 set_mon_vals no callback set 2024-09-10T16:32:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient: shutdown 2024-09-10T16:32:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 1 -- 172.21.15.81:0/287342971 >> v1:172.21.15.81:6791/0 conn(0x7fdf8413c320 legacy=0x7fdf8413e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 1 -- 172.21.15.81:0/287342971 shutdown_connections 2024-09-10T16:32:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 1 -- 172.21.15.81:0/287342971 >> 172.21.15.81:0/287342971 conn(0x7fdf840a85d0 msgr2=0x7fdf840a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 1 -- 172.21.15.81:0/287342971 shutdown_connections 2024-09-10T16:32:11.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 1 -- 172.21.15.81:0/287342971 wait complete. 2024-09-10T16:32:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient: build_initial_monmap 2024-09-10T16:32:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.950+0000 7fdf88f8e640 10 monclient: monmap: 2024-09-10T16:32:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:11.972 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:11.973 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 1 Processor -- start 2024-09-10T16:32:11.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 1 -- start start 2024-09-10T16:32:11.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 10 monclient: init 2024-09-10T16:32:11.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:11.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 10 monclient: _add_conns ranks=[7,4,2,3,8,5,6,0,1] 2024-09-10T16:32:11.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 10 monclient(hunting): picked mon.noname-i con 0x7fdf8409b4c0 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:11.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 10 monclient(hunting): picked mon.noname-c con 0x7fdf840a2620 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:11.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 10 monclient(hunting): picked mon.noname-b con 0x7fdf8413c320 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:11.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf8413fb60 con 0x7fdf8413c320 2024-09-10T16:32:11.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf84136ed0 con 0x7fdf840a2620 2024-09-10T16:32:11.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf84069780 con 0x7fdf8409b4c0 2024-09-10T16:32:11.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 10 monclient(hunting): authenticate will time out at 1099.356632s 2024-09-10T16:32:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf81d9b640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fdf840a2620 0x7fdf84069070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:35430/0 (socket says 172.21.15.81:35430) 2024-09-10T16:32:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf81d9b640 1 -- 172.21.15.81:0/3549514802 learned_addr learned my addr 172.21.15.81:0/3549514802 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2206269081 0 0) 0x7fdf84136ed0 con 0x7fdf840a2620 2024-09-10T16:32:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): my global_id is 5125 2024-09-10T16:32:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf64003560 con 0x7fdf840a2620 2024-09-10T16:32:11.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1548574325 0 0) 0x7fdf840a12f0 con 0x7fdf8413c320 2024-09-10T16:32:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): my global_id is 5150 2024-09-10T16:32:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf84136ed0 con 0x7fdf8413c320 2024-09-10T16:32:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3477886417 0 0) 0x7fdf64003560 con 0x7fdf840a2620 2024-09-10T16:32:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf840a12f0 con 0x7fdf840a2620 2024-09-10T16:32:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdf78001be0 con 0x7fdf840a2620 2024-09-10T16:32:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:32:11.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): dump: 2024-09-10T16:32:11.977 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.977 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.977 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.977 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.977 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.977 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.977 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.977 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.977 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.977 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.977 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.978 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.978 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.978 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.978 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.978 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:11.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 427099286 0 0) 0x7fdf84136ed0 con 0x7fdf8413c320 2024-09-10T16:32:11.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf64003560 con 0x7fdf8413c320 2024-09-10T16:32:11.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdf74001030 con 0x7fdf8413c320 2024-09-10T16:32:11.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:11.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): dump: 2024-09-10T16:32:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.979 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.980 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.980 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.980 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.980 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.980 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 355681233 0 0) 0x7fdf84069780 con 0x7fdf8409b4c0 2024-09-10T16:32:11.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): my global_id is 5047 2024-09-10T16:32:11.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf84136ed0 con 0x7fdf8409b4c0 2024-09-10T16:32:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1636833506 0 0) 0x7fdf840a12f0 con 0x7fdf840a2620 2024-09-10T16:32:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 >> v1:172.21.15.189:6792/0 conn(0x7fdf8409b4c0 legacy=0x7fdf84068960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 >> v1:172.21.15.81:6790/0 conn(0x7fdf8413c320 legacy=0x7fdf841d3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:32:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 monclient: found mon.c 2024-09-10T16:32:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:32:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf840a7210 con 0x7fdf840a2620 2024-09-10T16:32:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient: _finish_auth 0 2024-09-10T16:32:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:32:11.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 5 monclient: authenticate success, global_id 5125 2024-09-10T16:32:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 10 monclient: _renew_subs 2024-09-10T16:32:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:32:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdf84136bf0 con 0x7fdf840a2620 2024-09-10T16:32:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 10 monclient: _renew_subs 2024-09-10T16:32:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:32:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fdf840740f0 con 0x7fdf840a2620 2024-09-10T16:32:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdf780038d0 con 0x7fdf840a2620 2024-09-10T16:32:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdf78003ec0 con 0x7fdf840a2620 2024-09-10T16:32:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf80d99640 4 set_mon_vals no callback set 2024-09-10T16:32:11.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:11.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient: dump: 2024-09-10T16:32:11.983 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.983 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.983 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.983 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.983 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.983 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.983 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.983 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.983 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.984 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.984 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.984 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.984 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.984 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.984 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.984 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:11.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf88f8e640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdf680065d0 con 0x7fdf68002870 2024-09-10T16:32:11.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fdf78004060 con 0x7fdf840a2620 2024-09-10T16:32:11.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 3257020974 0 0) 0x7fdf7804aee0 con 0x7fdf840a2620 2024-09-10T16:32:11.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf82d9d640 10 monclient: get_auth_request con 0x7fdf6403d5d0 auth_method 0 2024-09-10T16:32:11.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2297056805 0 0) 0x7fdf680065d0 con 0x7fdf68002870 2024-09-10T16:32:11.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient(hunting): my global_id is 4937 2024-09-10T16:32:11.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf840a12f0 con 0x7fdf68002870 2024-09-10T16:32:11.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4042107885 0 0) 0x7fdf840a12f0 con 0x7fdf68002870 2024-09-10T16:32:11.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf680065d0 con 0x7fdf68002870 2024-09-10T16:32:11.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdf7c001c70 con 0x7fdf68002870 2024-09-10T16:32:11.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:32:11.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 10 monclient: dump: 2024-09-10T16:32:11.986 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.986 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.986 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.986 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.986 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.986 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.986 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.987 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4012361565 0 0) 0x7fdf680065d0 con 0x7fdf68002870 2024-09-10T16:32:11.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.954+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.189:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdf6800a170 con 0x7fdf68002870 2024-09-10T16:32:11.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.958+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fdf7c002090 con 0x7fdf68002870 2024-09-10T16:32:11.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.958+0000 7fdf72ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:11.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.958+0000 7fdf72ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:11.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.958+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 >> v1:172.21.15.189:6791/0 conn(0x7fdf68002870 legacy=0x7fdf68004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.958+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 >> v1:172.21.15.189:6791/0 conn(0x7fdf68002870 legacy=0x7fdf68004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf88f8e640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf88f8e640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdf68009e60 con 0x7fdf68009120 2024-09-10T16:32:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4156604258 0 0) 0x7fdf68009e60 con 0x7fdf68009120 2024-09-10T16:32:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf72ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf72ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:11.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf72ffd640 10 monclient(hunting): my global_id is 4946 2024-09-10T16:32:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdf680065d0 con 0x7fdf68009120 2024-09-10T16:32:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1558141130 0 0) 0x7fdf680065d0 con 0x7fdf68009120 2024-09-10T16:32:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdf68009e60 con 0x7fdf68009120 2024-09-10T16:32:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdf7c003ff0 con 0x7fdf68009120 2024-09-10T16:32:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf72ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf72ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:32:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf72ffd640 10 monclient: dump: 2024-09-10T16:32:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.991 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:11.992 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:11.993 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 910030730 0 0) 0x7fdf68009e60 con 0x7fdf68009120 2024-09-10T16:32:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.962+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 --> v1:172.21.15.189:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdf6800c3b0 con 0x7fdf68009120 2024-09-10T16:32:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 3382266634) 0x7fdf7c0049d0 con 0x7fdf68009120 2024-09-10T16:32:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf72ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf72ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 >> v1:172.21.15.189:6791/0 conn(0x7fdf68009120 legacy=0x7fdf680095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:11.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf72ffd640 1 -- 172.21.15.81:0/3549514802 >> v1:172.21.15.189:6791/0 conn(0x7fdf68009120 legacy=0x7fdf680095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:11.994 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 141892, 2024-09-10T16:32:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:11.994 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:32:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:11.995 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.996 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:11.997 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:11.998 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:11.999 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:12.000 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.001 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.002 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.003 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.005 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.006 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.007 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.008 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.009 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.010 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.011 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.013 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.015 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.016 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:32:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:12.017 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.018 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:12.018 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf88f8e640 1 -- 172.21.15.81:0/3549514802 >> v1:172.21.15.189:6812/1108603242 conn(0x7fdf6403d5d0 legacy=0x7fdf6403fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf88f8e640 10 monclient: shutdown 2024-09-10T16:32:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf88f8e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:12.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf88f8e640 1 -- 172.21.15.81:0/3549514802 >> v1:172.21.15.81:6791/0 conn(0x7fdf840a2620 legacy=0x7fdf84069070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf82d9d640 1 -- 172.21.15.81:0/3549514802 reap_dead start 2024-09-10T16:32:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf82d9d640 1 -- 172.21.15.81:0/3549514802 reap_dead start 2024-09-10T16:32:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf88f8e640 1 -- 172.21.15.81:0/3549514802 shutdown_connections 2024-09-10T16:32:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf88f8e640 1 -- 172.21.15.81:0/3549514802 >> 172.21.15.81:0/3549514802 conn(0x7fdf840a85d0 msgr2=0x7fdf8413bbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf88f8e640 1 -- 172.21.15.81:0/3549514802 shutdown_connections 2024-09-10T16:32:12.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:11.966+0000 7fdf88f8e640 1 -- 172.21.15.81:0/3549514802 wait complete. 2024-09-10T16:32:12.022 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:12.022 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-10T16:32:12.022 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-10T16:32:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient: get_monmap_and_config 2024-09-10T16:32:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient: build_initial_monmap 2024-09-10T16:32:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient: monmap: 2024-09-10T16:32:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:12.130 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:12.130361+0000 2024-09-10T16:32:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:12.130361+0000 2024-09-10T16:32:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:12.131 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:12.132 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:12.132 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 1 Processor -- start 2024-09-10T16:32:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 1 -- start start 2024-09-10T16:32:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient: init 2024-09-10T16:32:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient: _add_conns ranks=[4,2,5,3,1,7,6,8,0] 2024-09-10T16:32:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient(hunting): picked mon.noname-c con 0x7fb2d809e560 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:12.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient(hunting): picked mon.noname-b con 0x7fb2d8136ec0 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient(hunting): picked mon.noname-h con 0x7fb2d813d490 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d80a4200 con 0x7fb2d8136ec0 2024-09-10T16:32:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d80a44e0 con 0x7fb2d809e560 2024-09-10T16:32:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d80a47c0 con 0x7fb2d813d490 2024-09-10T16:32:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient(hunting): authenticate will time out at 1099.529818s 2024-09-10T16:32:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d6ffd640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fb2d8136ec0 0x7fb2d813bd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:42402/0 (socket says 172.21.15.81:42402) 2024-09-10T16:32:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d6ffd640 1 -- 172.21.15.81:0/4044595918 learned_addr learned my addr 172.21.15.81:0/4044595918 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 1 -- 172.21.15.81:0/4044595918 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 824880664 0 0) 0x7fb2d80a4200 con 0x7fb2d8136ec0 2024-09-10T16:32:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:12.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient(hunting): my global_id is 5159 2024-09-10T16:32:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 1 -- 172.21.15.81:0/4044595918 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2c4003530 con 0x7fb2d8136ec0 2024-09-10T16:32:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 1 -- 172.21.15.81:0/4044595918 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3011649958 0 0) 0x7fb2d80a44e0 con 0x7fb2d809e560 2024-09-10T16:32:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient(hunting): my global_id is 5134 2024-09-10T16:32:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 1 -- 172.21.15.81:0/4044595918 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2d80a4200 con 0x7fb2d809e560 2024-09-10T16:32:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 1 -- 172.21.15.81:0/4044595918 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2469163197 0 0) 0x7fb2d80a4200 con 0x7fb2d809e560 2024-09-10T16:32:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 1 -- 172.21.15.81:0/4044595918 >> v1:172.21.15.189:6791/0 conn(0x7fb2d813d490 legacy=0x7fb2d813f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 1 -- 172.21.15.81:0/4044595918 >> v1:172.21.15.81:6790/0 conn(0x7fb2d8136ec0 legacy=0x7fb2d813bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient: _finish_hunting 0 2024-09-10T16:32:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 1 monclient: found mon.noname-c 2024-09-10T16:32:12.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:32:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 1 -- 172.21.15.81:0/4044595918 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d81372e0 con 0x7fb2d809e560 2024-09-10T16:32:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient: _finish_auth 0 2024-09-10T16:32:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient: _check_auth_tickets 2024-09-10T16:32:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 5 monclient: authenticate success, global_id 5134 2024-09-10T16:32:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 1 -- 172.21.15.81:0/4044595918 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb2d0001b20 con 0x7fb2d809e560 2024-09-10T16:32:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:32:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient: dump: 2024-09-10T16:32:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:12.143 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:12.144 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:12.145 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:12.145 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:12.145 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:12.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 1 -- 172.21.15.81:0/4044595918 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2d0001cc0 con 0x7fb2d809e560 2024-09-10T16:32:12.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:12.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:12.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 1 -- 172.21.15.81:0/4044595918 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb2d0003ce0 con 0x7fb2d809e560 2024-09-10T16:32:12.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:12.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 4 set_mon_vals no callback set 2024-09-10T16:32:12.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:12.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2d67fc640 10 monclient: dump: 2024-09-10T16:32:12.145 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:12.146 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:12.146 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.146 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.146 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:12.146 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:12.146 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:12.146 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:12.146 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:12.146 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:12.146 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:12.146 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:12.146 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:12.147 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:12.147 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:12.147 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient: shutdown 2024-09-10T16:32:12.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:12.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 1 -- 172.21.15.81:0/4044595918 >> v1:172.21.15.81:6791/0 conn(0x7fb2d809e560 legacy=0x7fb2d809e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 1 -- 172.21.15.81:0/4044595918 shutdown_connections 2024-09-10T16:32:12.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 1 -- 172.21.15.81:0/4044595918 >> 172.21.15.81:0/4044595918 conn(0x7fb2d80a85d0 msgr2=0x7fb2d80a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:12.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 1 -- 172.21.15.81:0/4044595918 shutdown_connections 2024-09-10T16:32:12.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 1 -- 172.21.15.81:0/4044595918 wait complete. 2024-09-10T16:32:12.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient: build_initial_monmap 2024-09-10T16:32:12.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.126+0000 7fb2ddefa640 10 monclient: monmap: 2024-09-10T16:32:12.148 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:12.148 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:12.148 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:12.148 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:12.148 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:12.148 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:12.148 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:12.148 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:12.148 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:12.148 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:12.149 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:12.149 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:12.149 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:12.149 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:12.149 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:12.149 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 1 Processor -- start 2024-09-10T16:32:12.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 1 -- start start 2024-09-10T16:32:12.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 10 monclient: init 2024-09-10T16:32:12.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:12.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 10 monclient: _add_conns ranks=[7,1,8,2,4,5,3,0,6] 2024-09-10T16:32:12.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 10 monclient(hunting): picked mon.noname-i con 0x7fb2d809e560 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:12.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 10 monclient(hunting): picked mon.noname-f con 0x7fb2d8136ec0 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:12.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 10 monclient(hunting): picked mon.noname-e con 0x7fb2d813d490 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:12.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d8140ac0 con 0x7fb2d8136ec0 2024-09-10T16:32:12.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d812d660 con 0x7fb2d809e560 2024-09-10T16:32:12.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2d80a16c0 con 0x7fb2d813d490 2024-09-10T16:32:12.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:12.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 10 monclient(hunting): authenticate will time out at 1099.532806s 2024-09-10T16:32:12.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2d7fff640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fb2d813d490 0x7fb2d81d5f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:46760/0 (socket says 172.21.15.81:46760) 2024-09-10T16:32:12.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2d7fff640 1 -- 172.21.15.81:0/1507194921 learned_addr learned my addr 172.21.15.81:0/1507194921 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:12.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4002048191 0 0) 0x7fb2d80a16c0 con 0x7fb2d813d490 2024-09-10T16:32:12.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:12.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:12.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:12.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient(hunting): my global_id is 5138 2024-09-10T16:32:12.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2b8003530 con 0x7fb2d813d490 2024-09-10T16:32:12.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2149481630 0 0) 0x7fb2b8003530 con 0x7fb2d813d490 2024-09-10T16:32:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2d80a16c0 con 0x7fb2d813d490 2024-09-10T16:32:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb2c8001aa0 con 0x7fb2d813d490 2024-09-10T16:32:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:32:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient(hunting): dump: 2024-09-10T16:32:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.152 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:12.153 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:12.154 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2081354378 0 0) 0x7fb2d80a16c0 con 0x7fb2d813d490 2024-09-10T16:32:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 >> v1:172.21.15.189:6792/0 conn(0x7fb2d809e560 legacy=0x7fb2d8135c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 >> v1:172.21.15.189:6789/0 conn(0x7fb2d8136ec0 legacy=0x7fb2d81d2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient: _finish_hunting 0 2024-09-10T16:32:12.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 monclient: found mon.e 2024-09-10T16:32:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:32:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2d80a0070 con 0x7fb2d813d490 2024-09-10T16:32:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient: _finish_auth 0 2024-09-10T16:32:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient: _check_auth_tickets 2024-09-10T16:32:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 5 monclient: authenticate success, global_id 5138 2024-09-10T16:32:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 10 monclient: _renew_subs 2024-09-10T16:32:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:32:12.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 1 -- 172.21.15.81:0/1507194921 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb2d8136310 con 0x7fb2d813d490 2024-09-10T16:32:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 10 monclient: _renew_subs 2024-09-10T16:32:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:32:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 1 -- 172.21.15.81:0/1507194921 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fb2d81c9f50 con 0x7fb2d813d490 2024-09-10T16:32:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb2c80038d0 con 0x7fb2d813d490 2024-09-10T16:32:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb2c8003e40 con 0x7fb2d813d490 2024-09-10T16:32:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2d5ffb640 4 set_mon_vals no callback set 2024-09-10T16:32:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient: dump: 2024-09-10T16:32:12.156 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:12.157 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:12.158 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2ddefa640 1 -- 172.21.15.81:0/1507194921 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb2bc0065d0 con 0x7fb2bc002870 2024-09-10T16:32:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fb2c8003fe0 con 0x7fb2d813d490 2024-09-10T16:32:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(117..117 src has 1..117) ==== 3898+0+0 (unknown 3257020974 0 0) 0x7fb2c804aec0 con 0x7fb2d813d490 2024-09-10T16:32:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3103247503 0 0) 0x7fb2bc0065d0 con 0x7fb2bc002870 2024-09-10T16:32:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:12.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient(hunting): my global_id is 5065 2024-09-10T16:32:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2d80a16c0 con 0x7fb2bc002870 2024-09-10T16:32:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2d6ffd640 10 monclient: get_auth_request con 0x7fb2b803d040 auth_method 0 2024-09-10T16:32:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3602347216 0 0) 0x7fb2d80a16c0 con 0x7fb2bc002870 2024-09-10T16:32:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2bc0065d0 con 0x7fb2bc002870 2024-09-10T16:32:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb2d0001500 con 0x7fb2bc002870 2024-09-10T16:32:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:32:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 10 monclient: dump: 2024-09-10T16:32:12.159 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:12.160 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:12.161 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 682100978 0 0) 0x7fb2bc0065d0 con 0x7fb2bc002870 2024-09-10T16:32:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.130+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 --> v1:172.21.15.189:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2bc00a170 con 0x7fb2bc002870 2024-09-10T16:32:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.134+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.7 v1:172.21.15.189:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb2d0003d50 con 0x7fb2bc002870 2024-09-10T16:32:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.134+0000 7fb2cffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:12.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.134+0000 7fb2cffff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.134+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 >> v1:172.21.15.189:6792/0 conn(0x7fb2bc002870 legacy=0x7fb2bc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.134+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 >> v1:172.21.15.189:6792/0 conn(0x7fb2bc002870 legacy=0x7fb2bc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.138+0000 7fb2ddefa640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.138+0000 7fb2ddefa640 1 -- 172.21.15.81:0/1507194921 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb2bc009e80 con 0x7fb2bc009140 2024-09-10T16:32:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.138+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1575015847 0 0) 0x7fb2bc009e80 con 0x7fb2bc009140 2024-09-10T16:32:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.138+0000 7fb2cffff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.138+0000 7fb2cffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.138+0000 7fb2cffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:12.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.138+0000 7fb2cffff640 10 monclient(hunting): my global_id is 5074 2024-09-10T16:32:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.138+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2bc0065d0 con 0x7fb2bc009140 2024-09-10T16:32:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.138+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2404603203 0 0) 0x7fb2bc0065d0 con 0x7fb2bc009140 2024-09-10T16:32:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.138+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb2bc009e80 con 0x7fb2bc009140 2024-09-10T16:32:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.138+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb2d0004000 con 0x7fb2bc009140 2024-09-10T16:32:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.138+0000 7fb2cffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.138+0000 7fb2cffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:32:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.138+0000 7fb2cffff640 10 monclient: dump: 2024-09-10T16:32:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.164 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:12.165 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:12.166 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1365898927 0 0) 0x7fb2bc009e80 con 0x7fb2bc009140 2024-09-10T16:32:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 --> v1:172.21.15.189:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb2bc00c420 con 0x7fb2bc009140 2024-09-10T16:32:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 <== mon.7 v1:172.21.15.189:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 4017418316) 0x7fb2d0004260 con 0x7fb2bc009140 2024-09-10T16:32:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2cffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2cffff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 >> v1:172.21.15.189:6792/0 conn(0x7fb2bc009140 legacy=0x7fb2bc0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2cffff640 1 -- 172.21.15.81:0/1507194921 >> v1:172.21.15.189:6792/0 conn(0x7fb2bc009140 legacy=0x7fb2bc0095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:12.166 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:12.167 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:12.167 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:12.167 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:12.167 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:12.167 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 142072, 2024-09-10T16:32:12.167 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:12.167 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:12.167 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:12.167 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:12.167 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:12.168 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:12.168 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:12.168 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:12.168 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:12.168 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:12.168 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:12.168 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:32:12.168 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:12.168 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:12.168 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:12.168 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:12.169 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:12.169 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:12.169 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:12.169 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:12.169 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:12.169 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:12.169 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:12.169 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:12.169 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:12.169 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:12.169 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:12.170 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:12.170 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:12.170 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:12.170 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:12.170 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:12.170 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:12.170 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:12.170 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:12.170 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:12.170 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:12.170 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:12.170 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:12.171 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:12.171 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.171 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:12.171 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:12.171 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:12.171 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:12.171 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:12.171 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:12.171 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:12.171 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:12.172 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:12.172 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:12.172 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:12.172 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:12.172 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:12.172 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:12.172 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:12.172 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:12.172 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:12.173 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:12.173 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:12.173 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:12.173 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:12.173 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:12.173 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:12.173 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:12.173 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:12.173 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:12.173 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:12.174 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:12.174 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:12.174 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:12.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.174 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:12.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.174 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:12.174 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:12.174 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.174 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.175 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.175 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:12.175 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.175 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.175 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:12.175 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:12.175 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.175 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.176 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.176 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:12.176 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:12.176 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.176 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.176 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.176 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.176 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:12.176 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.177 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.177 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.177 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:12.177 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:12.177 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.177 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.177 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.177 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.177 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.177 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:12.178 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:12.178 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.178 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.178 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.178 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:12.178 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.178 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.178 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.178 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:12.178 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:12.179 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.179 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.179 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.179 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:12.179 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:12.179 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.179 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.179 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.180 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:12.180 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.180 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.180 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.180 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:12.180 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:12.180 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.180 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.181 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.181 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:12.181 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:12.181 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.181 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.181 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.181 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:12.182 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.182 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.182 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.182 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:12.182 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:12.182 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.182 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.182 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.183 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:12.183 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:12.183 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.183 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.183 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:12.183 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.184 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.184 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.184 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:12.184 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:12.184 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.184 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.184 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.185 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:12.185 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:12.185 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:12.186 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.186 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.186 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:12.186 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:12.186 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.186 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.186 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.187 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:12.187 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:12.187 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:12.187 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.188 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:12.188 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:12.188 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.188 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.188 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.189 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:12.189 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:12.189 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:12.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:12.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:12.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:12.189 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:12.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.190 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.190 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:12.190 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:12.190 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:12.190 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:12.190 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:12.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.190 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.191 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:12.191 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:12.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.191 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:12.191 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:12.191 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:12.191 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.191 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:12.191 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:32:12.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.191 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:12.191 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:12.192 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:32:12.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.192 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:12.192 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:12.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:12.192 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:12.192 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:12.192 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:12.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:12.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:12.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:12.193 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:12.193 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:12.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2ddefa640 1 -- 172.21.15.81:0/1507194921 >> v1:172.21.15.189:6812/1108603242 conn(0x7fb2b803d040 legacy=0x7fb2b803f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2ddefa640 10 monclient: shutdown 2024-09-10T16:32:12.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2ddefa640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:12.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2ddefa640 1 -- 172.21.15.81:0/1507194921 >> v1:172.21.15.81:6793/0 conn(0x7fb2d813d490 legacy=0x7fb2d81d5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2d7fff640 1 -- 172.21.15.81:0/1507194921 reap_dead start 2024-09-10T16:32:12.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2d7fff640 1 -- 172.21.15.81:0/1507194921 reap_dead start 2024-09-10T16:32:12.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2ddefa640 1 -- 172.21.15.81:0/1507194921 shutdown_connections 2024-09-10T16:32:12.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2ddefa640 1 -- 172.21.15.81:0/1507194921 >> 172.21.15.81:0/1507194921 conn(0x7fb2d80a85d0 msgr2=0x7fb2d80a6980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:12.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2ddefa640 1 -- 172.21.15.81:0/1507194921 shutdown_connections 2024-09-10T16:32:12.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.142+0000 7fb2ddefa640 1 -- 172.21.15.81:0/1507194921 wait complete. 2024-09-10T16:32:12.195 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:12.196 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T16:32:12.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T16:32:12.222 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:12.223 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29651]: starting. 2024-09-10T16:32:12.223 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29651]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29615 2024-09-10T16:32:12.223 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29651]: shutting down. 2024-09-10T16:32:12.229 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:12.229 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:12.229 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:32:12.229 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:32:12.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.302+0000 7fd0e6809640 10 monclient: get_monmap_and_config 2024-09-10T16:32:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.302+0000 7fd0e6809640 10 monclient: build_initial_monmap 2024-09-10T16:32:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.302+0000 7fd0e6809640 10 monclient: monmap: 2024-09-10T16:32:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:12.308788+0000 2024-09-10T16:32:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:12.308788+0000 2024-09-10T16:32:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:12.309 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:12.310 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:12.310 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:12.310 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:12.310 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:12.310 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:12.310 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.302+0000 7fd0e6809640 1 Processor -- start 2024-09-10T16:32:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.302+0000 7fd0e6809640 1 -- start start 2024-09-10T16:32:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.302+0000 7fd0e6809640 10 monclient: init 2024-09-10T16:32:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient: _add_conns ranks=[6,0,5,1,7,8,2,4,3] 2024-09-10T16:32:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient(hunting): picked mon.noname-d con 0x7fd0e009ca10 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient(hunting): picked mon.noname-a con 0x7fd0e00a56e0 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient(hunting): picked mon.noname-h con 0x7fd0e00a5b00 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:12.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e01362b0 con 0x7fd0e00a56e0 2024-09-10T16:32:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e00a80b0 con 0x7fd0e00a5b00 2024-09-10T16:32:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e009de70 con 0x7fd0e009ca10 2024-09-10T16:32:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dffff640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fd0e009ca10 0x7fd0e0135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:58488/0 (socket says 172.21.15.81:58488) 2024-09-10T16:32:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient(hunting): authenticate will time out at 1099.708359s 2024-09-10T16:32:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dffff640 1 -- 172.21.15.81:0/3600247256 learned_addr learned my addr 172.21.15.81:0/3600247256 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 1 -- 172.21.15.81:0/3600247256 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846142591 0 0) 0x7fd0e009de70 con 0x7fd0e009ca10 2024-09-10T16:32:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient(hunting): my global_id is 5109 2024-09-10T16:32:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 1 -- 172.21.15.81:0/3600247256 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0cc003530 con 0x7fd0e009ca10 2024-09-10T16:32:12.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 1 -- 172.21.15.81:0/3600247256 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2245617847 0 0) 0x7fd0e01362b0 con 0x7fd0e00a56e0 2024-09-10T16:32:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient(hunting): my global_id is 5184 2024-09-10T16:32:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 1 -- 172.21.15.81:0/3600247256 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0e009de70 con 0x7fd0e00a56e0 2024-09-10T16:32:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 1 -- 172.21.15.81:0/3600247256 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639803863 0 0) 0x7fd0e00a80b0 con 0x7fd0e00a5b00 2024-09-10T16:32:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient(hunting): my global_id is 4973 2024-09-10T16:32:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 1 -- 172.21.15.81:0/3600247256 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0e01362b0 con 0x7fd0e00a5b00 2024-09-10T16:32:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 1 -- 172.21.15.81:0/3600247256 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3743459685 0 0) 0x7fd0cc003530 con 0x7fd0e009ca10 2024-09-10T16:32:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 1 -- 172.21.15.81:0/3600247256 >> v1:172.21.15.189:6791/0 conn(0x7fd0e00a5b00 legacy=0x7fd0e0141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 1 -- 172.21.15.81:0/3600247256 >> v1:172.21.15.81:6789/0 conn(0x7fd0e00a56e0 legacy=0x7fd0e013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:32:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 1 monclient: found mon.noname-d 2024-09-10T16:32:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:32:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 1 -- 172.21.15.81:0/3600247256 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e009e150 con 0x7fd0e009ca10 2024-09-10T16:32:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient: _finish_auth 0 2024-09-10T16:32:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:32:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 1 -- 172.21.15.81:0/3600247256 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd0d0001840 con 0x7fd0e009ca10 2024-09-10T16:32:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:32:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient: dump: 2024-09-10T16:32:12.319 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:12.320 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:12.321 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 5 monclient: authenticate success, global_id 5109 2024-09-10T16:32:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 1 -- 172.21.15.81:0/3600247256 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0d00019e0 con 0x7fd0e009ca10 2024-09-10T16:32:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 1 -- 172.21.15.81:0/3600247256 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd0d0004bf0 con 0x7fd0e009ca10 2024-09-10T16:32:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:32:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0df7fe640 10 monclient: dump: 2024-09-10T16:32:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.321 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:12.322 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:12.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 4 set_mon_vals no callback set 2024-09-10T16:32:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient: shutdown 2024-09-10T16:32:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 1 -- 172.21.15.81:0/3600247256 >> v1:172.21.15.81:6792/0 conn(0x7fd0e009ca10 legacy=0x7fd0e0135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 1 -- 172.21.15.81:0/3600247256 shutdown_connections 2024-09-10T16:32:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 1 -- 172.21.15.81:0/3600247256 >> 172.21.15.81:0/3600247256 conn(0x7fd0e006dc90 msgr2=0x7fd0e00ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 1 -- 172.21.15.81:0/3600247256 shutdown_connections 2024-09-10T16:32:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 1 -- 172.21.15.81:0/3600247256 wait complete. 2024-09-10T16:32:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient: build_initial_monmap 2024-09-10T16:32:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient: monmap: 2024-09-10T16:32:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:12.323 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:12.324 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 1 Processor -- start 2024-09-10T16:32:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 1 -- start start 2024-09-10T16:32:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient: init 2024-09-10T16:32:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient: _add_conns ranks=[3,7,2,8,1,6,0,4,5] 2024-09-10T16:32:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient(hunting): picked mon.noname-g con 0x7fd0e009ca10 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient(hunting): picked mon.noname-i con 0x7fd0e00a56e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient(hunting): picked mon.noname-b con 0x7fd0e00a5b00 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e00aa130 con 0x7fd0e00a5b00 2024-09-10T16:32:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e0131e80 con 0x7fd0e009ca10 2024-09-10T16:32:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0e0132160 con 0x7fd0e00a56e0 2024-09-10T16:32:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e6809640 10 monclient(hunting): authenticate will time out at 1099.711458s 2024-09-10T16:32:12.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e4da6640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fd0e00a5b00 0x7fd0e01d5a80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:42406/0 (socket says 172.21.15.81:42406) 2024-09-10T16:32:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0e4da6640 1 -- 172.21.15.81:0/682308987 learned_addr learned my addr 172.21.15.81:0/682308987 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2203797987 0 0) 0x7fd0e01362b0 con 0x7fd0e00a5b00 2024-09-10T16:32:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 10 monclient(hunting): my global_id is 5186 2024-09-10T16:32:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0c0003560 con 0x7fd0e00a5b00 2024-09-10T16:32:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3665555142 0 0) 0x7fd0e0131e80 con 0x7fd0e009ca10 2024-09-10T16:32:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 10 monclient(hunting): my global_id is 134184 2024-09-10T16:32:12.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0e01362b0 con 0x7fd0e009ca10 2024-09-10T16:32:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3696178684 0 0) 0x7fd0e0132160 con 0x7fd0e00a56e0 2024-09-10T16:32:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 10 monclient(hunting): my global_id is 5092 2024-09-10T16:32:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.306+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd0e0131e80 con 0x7fd0e00a56e0 2024-09-10T16:32:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2049619579 0 0) 0x7fd0c0003560 con 0x7fd0e00a5b00 2024-09-10T16:32:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0e0132160 con 0x7fd0e00a5b00 2024-09-10T16:32:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd0d8001dc0 con 0x7fd0e00a5b00 2024-09-10T16:32:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:32:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient(hunting): dump: 2024-09-10T16:32:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:12.327 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:12.328 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:12.329 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3584544034 0 0) 0x7fd0e01362b0 con 0x7fd0e009ca10 2024-09-10T16:32:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd0c0003560 con 0x7fd0e009ca10 2024-09-10T16:32:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd0d0001800 con 0x7fd0e009ca10 2024-09-10T16:32:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-10T16:32:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient(hunting): dump: 2024-09-10T16:32:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:12.329 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:12.330 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2803943903 0 0) 0x7fd0e0132160 con 0x7fd0e00a5b00 2024-09-10T16:32:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 >> v1:172.21.15.189:6792/0 conn(0x7fd0e00a56e0 legacy=0x7fd0e01ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 >> v1:172.21.15.189:6790/0 conn(0x7fd0e009ca10 legacy=0x7fd0e01c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient: _finish_hunting 0 2024-09-10T16:32:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 monclient: found mon.b 2024-09-10T16:32:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0e01cadb0 con 0x7fd0e00a5b00 2024-09-10T16:32:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient: _finish_auth 0 2024-09-10T16:32:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient: _check_auth_tickets 2024-09-10T16:32:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0e6809640 5 monclient: authenticate success, global_id 5186 2024-09-10T16:32:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0e6809640 10 monclient: _renew_subs 2024-09-10T16:32:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0e6809640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0e6809640 1 -- 172.21.15.81:0/682308987 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd0e0130b80 con 0x7fd0e00a5b00 2024-09-10T16:32:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0e6809640 10 monclient: _renew_subs 2024-09-10T16:32:12.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0e6809640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0e6809640 1 -- 172.21.15.81:0/682308987 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd0e01328e0 con 0x7fd0e00a5b00 2024-09-10T16:32:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd0d80020c0 con 0x7fd0e00a5b00 2024-09-10T16:32:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd0d8003f90 con 0x7fd0e00a5b00 2024-09-10T16:32:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0deffd640 4 set_mon_vals no callback set 2024-09-10T16:32:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 10 monclient: dump: 2024-09-10T16:32:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:12.332 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:12.333 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0e6809640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:12.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0e6809640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fd0d8004130 con 0x7fd0e00a5b00 2024-09-10T16:32:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0e6809640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0e6809640 1 -- 172.21.15.81:0/682308987 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c4005090 con 0x7fd0e00a5b00 2024-09-10T16:32:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(118..118 src has 1..118) ==== 3506+0+0 (unknown 1049849911 0 0) 0x7fd0d804afc0 con 0x7fd0e00a5b00 2024-09-10T16:32:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.310+0000 7fd0dffff640 10 monclient: get_auth_request con 0x7fd0c003d640 auth_method 0 2024-09-10T16:32:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.314+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7fd0e00aa130 con 0x7fd0e00a5b00 2024-09-10T16:32:12.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.314+0000 7fd0dd7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:12.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.314+0000 7fd0dd7fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:12.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.566+0000 7fd0e6809640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-10T16:32:12.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.566+0000 7fd0e6809640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-10T16:32:12.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.566+0000 7fd0e6809640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:12.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.566+0000 7fd0e6809640 1 -- 172.21.15.81:0/682308987 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fd0c4005c50 con 0x7fd0e00a5b00 2024-09-10T16:32:12.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.570+0000 7fd0dd7fa640 1 -- 172.21.15.81:0/682308987 <== mon.2 v1:172.21.15.81:6790/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fd0d8016ee0 con 0x7fd0e00a5b00 2024-09-10T16:32:12.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.570+0000 7fd0dd7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-10T16:32:12.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.570+0000 7fd0dd7fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:12.578 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.578 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=9,kv=11,logm=59} crc {auth=2365995039,config=1097430493,health=3094289017,kv=3743328590,logm=4236274237}) 2024-09-10T16:32:12.579 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=20,config=2,health=12,kv=13,logm=53} crc {auth=1887038080,config=1097430493,health=2771633972,kv=3059684873,logm=3141094766}) 2024-09-10T16:32:12.579 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.579 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=9,kv=11,logm=59} crc {auth=2365995039,config=1097430493,health=3094289017,kv=3743328590,logm=4236274237}) 2024-09-10T16:32:12.579 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=17,config=2,health=12,kv=13,logm=56} crc {auth=2849504380,config=1097430493,health=2771633972,kv=3059684873,logm=3928680039}) 2024-09-10T16:32:12.579 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.579 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=9,kv=11,logm=59} crc {auth=2365995039,config=1097430493,health=3094289017,kv=3743328590,logm=4236274237}) 2024-09-10T16:32:12.579 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=19,config=2,health=12,kv=13,logm=54} crc {auth=4070390735,config=1097430493,health=3339800077,kv=3059684873,logm=3459709874}) 2024-09-10T16:32:12.579 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.579 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=9,kv=11,logm=59} crc {auth=2365995039,config=1097430493,health=3094289017,kv=3743328590,logm=4236274237}) 2024-09-10T16:32:12.579 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=20,config=2,health=11,kv=13,logm=54} crc {auth=17326385,config=1097430493,health=396891924,kv=3059684873,logm=1279083712}) 2024-09-10T16:32:12.579 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.579 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=9,kv=11,logm=59} crc {auth=2365995039,config=1097430493,health=3094289017,kv=3743328590,logm=4236274237}) 2024-09-10T16:32:12.579 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=20,config=2,health=11,kv=13,logm=54} crc {auth=17326385,config=1097430493,health=3927554584,kv=3059684873,logm=645936754}) 2024-09-10T16:32:12.580 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.580 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=9,kv=11,logm=59} crc {auth=2365995039,config=1097430493,health=3094289017,kv=3743328590,logm=4236274237}) 2024-09-10T16:32:12.580 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=19,config=2,health=11,kv=13,logm=55} crc {auth=1766076937,config=1097430493,health=588522927,kv=3059684873,logm=4005136287}) 2024-09-10T16:32:12.580 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.580 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=9,kv=11,logm=59} crc {auth=2365995039,config=1097430493,health=3094289017,kv=3743328590,logm=4236274237}) 2024-09-10T16:32:12.580 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=19,config=2,health=10,kv=13,logm=56} crc {auth=1373444998,config=1097430493,health=2234400055,kv=3059684873,logm=779180474}) 2024-09-10T16:32:12.580 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.580 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=19,config=2,health=9,kv=11,logm=59} crc {auth=2365995039,config=1097430493,health=3094289017,kv=3743328590,logm=4236274237}) 2024-09-10T16:32:12.580 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.570+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=18,config=2,health=12,kv=13,logm=55} crc {auth=2693774475,config=1097430493,health=2771633972,kv=3059684873,logm=2108198016}) 2024-09-10T16:32:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.574+0000 7fd0e6809640 1 -- 172.21.15.81:0/682308987 >> v1:172.21.15.189:6812/1108603242 conn(0x7fd0c003d640 legacy=0x7fd0c003fb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.574+0000 7fd0e6809640 10 monclient: shutdown 2024-09-10T16:32:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.574+0000 7fd0e6809640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.574+0000 7fd0e6809640 1 -- 172.21.15.81:0/682308987 >> v1:172.21.15.81:6790/0 conn(0x7fd0e00a5b00 legacy=0x7fd0e01d5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.574+0000 7fd0e6809640 1 -- 172.21.15.81:0/682308987 shutdown_connections 2024-09-10T16:32:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.574+0000 7fd0e6809640 1 -- 172.21.15.81:0/682308987 >> 172.21.15.81:0/682308987 conn(0x7fd0e006dc90 msgr2=0x7fd0e00aa870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.574+0000 7fd0e6809640 1 -- 172.21.15.81:0/682308987 shutdown_connections 2024-09-10T16:32:12.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:12.574+0000 7fd0e6809640 1 -- 172.21.15.81:0/682308987 wait complete. 2024-09-10T16:32:12.584 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.584 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848088299}) 2024-09-10T16:32:12.584 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4175119599}) 2024-09-10T16:32:12.584 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.584 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848088299}) 2024-09-10T16:32:12.584 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1570491285}) 2024-09-10T16:32:12.584 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.584 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848088299}) 2024-09-10T16:32:12.584 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3742353911}) 2024-09-10T16:32:12.584 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.584 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848088299}) 2024-09-10T16:32:12.584 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2377637581}) 2024-09-10T16:32:12.585 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.585 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848088299}) 2024-09-10T16:32:12.585 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=667024442}) 2024-09-10T16:32:12.585 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.585 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848088299}) 2024-09-10T16:32:12.585 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3125381287}) 2024-09-10T16:32:12.585 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.585 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848088299}) 2024-09-10T16:32:12.585 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=906526145}) 2024-09-10T16:32:12.585 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.585 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=848088299}) 2024-09-10T16:32:12.585 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.574+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1033335017}) 2024-09-10T16:32:12.588 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.588 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1741212483}) 2024-09-10T16:32:12.588 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1703467283}) 2024-09-10T16:32:12.588 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.588 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1741212483}) 2024-09-10T16:32:12.588 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2447511348}) 2024-09-10T16:32:12.588 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.588 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1741212483}) 2024-09-10T16:32:12.588 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1340297435}) 2024-09-10T16:32:12.588 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.588 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1741212483}) 2024-09-10T16:32:12.589 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1862696719}) 2024-09-10T16:32:12.589 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.589 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1741212483}) 2024-09-10T16:32:12.589 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=337623402}) 2024-09-10T16:32:12.589 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.589 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1741212483}) 2024-09-10T16:32:12.589 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2451391689}) 2024-09-10T16:32:12.589 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.589 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1741212483}) 2024-09-10T16:32:12.589 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3618029611}) 2024-09-10T16:32:12.589 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.589 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1741212483}) 2024-09-10T16:32:12.589 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.578+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1408259063}) 2024-09-10T16:32:12.592 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.592 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3265937028}) 2024-09-10T16:32:12.592 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3996746296}) 2024-09-10T16:32:12.592 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.592 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3265937028}) 2024-09-10T16:32:12.592 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1887781737}) 2024-09-10T16:32:12.592 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.592 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3265937028}) 2024-09-10T16:32:12.592 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1013100831}) 2024-09-10T16:32:12.592 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.592 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3265937028}) 2024-09-10T16:32:12.593 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1416750583}) 2024-09-10T16:32:12.593 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.593 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3265937028}) 2024-09-10T16:32:12.593 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3656622511}) 2024-09-10T16:32:12.593 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.593 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3265937028}) 2024-09-10T16:32:12.593 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1884720208}) 2024-09-10T16:32:12.593 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.593 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3265937028}) 2024-09-10T16:32:12.593 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=458432286}) 2024-09-10T16:32:12.593 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.593 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3265937028}) 2024-09-10T16:32:12.593 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.582+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1573869251}) 2024-09-10T16:32:12.596 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.596 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684404655}) 2024-09-10T16:32:12.596 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1948922024}) 2024-09-10T16:32:12.596 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.596 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684404655}) 2024-09-10T16:32:12.596 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=817413134}) 2024-09-10T16:32:12.596 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.596 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684404655}) 2024-09-10T16:32:12.596 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3385451167}) 2024-09-10T16:32:12.596 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684404655}) 2024-09-10T16:32:12.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=693002825}) 2024-09-10T16:32:12.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684404655}) 2024-09-10T16:32:12.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3382036058}) 2024-09-10T16:32:12.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684404655}) 2024-09-10T16:32:12.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4170365434}) 2024-09-10T16:32:12.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684404655}) 2024-09-10T16:32:12.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=652505962}) 2024-09-10T16:32:12.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.597 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2684404655}) 2024-09-10T16:32:12.598 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.586+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1195623786}) 2024-09-10T16:32:12.599 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-10T16:32:12.603 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.603 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017612567}) 2024-09-10T16:32:12.603 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3291321868}) 2024-09-10T16:32:12.603 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.603 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017612567}) 2024-09-10T16:32:12.603 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2539483248}) 2024-09-10T16:32:12.603 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.603 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017612567}) 2024-09-10T16:32:12.603 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2391690006}) 2024-09-10T16:32:12.603 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.603 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017612567}) 2024-09-10T16:32:12.604 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=484809959}) 2024-09-10T16:32:12.604 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.604 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017612567}) 2024-09-10T16:32:12.604 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2484371689}) 2024-09-10T16:32:12.604 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.604 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017612567}) 2024-09-10T16:32:12.604 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=546089093}) 2024-09-10T16:32:12.604 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.604 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017612567}) 2024-09-10T16:32:12.604 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=813437522}) 2024-09-10T16:32:12.604 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.604 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2017612567}) 2024-09-10T16:32:12.605 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.590+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1900726874}) 2024-09-10T16:32:12.605 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.605 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=220954426}) 2024-09-10T16:32:12.605 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=714322294}) 2024-09-10T16:32:12.605 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.605 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=220954426}) 2024-09-10T16:32:12.605 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4041500657}) 2024-09-10T16:32:12.605 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.605 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=220954426}) 2024-09-10T16:32:12.605 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3182361736}) 2024-09-10T16:32:12.605 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.605 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=220954426}) 2024-09-10T16:32:12.605 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=563722597}) 2024-09-10T16:32:12.606 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.606 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=220954426}) 2024-09-10T16:32:12.606 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1706822603}) 2024-09-10T16:32:12.606 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.606 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=220954426}) 2024-09-10T16:32:12.606 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1015609558}) 2024-09-10T16:32:12.606 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.606 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=220954426}) 2024-09-10T16:32:12.606 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=594040836}) 2024-09-10T16:32:12.606 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.606 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=220954426}) 2024-09-10T16:32:12.606 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.594+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4234051723}) 2024-09-10T16:32:12.609 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.598+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.609 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.598+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=74,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=4} crc {logm=2408570734,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1775155842,mon_config_key=2056983650}) 2024-09-10T16:32:12.609 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.598+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=64,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=14} crc {logm=2525191988,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1775155842,mon_config_key=3094036208}) 2024-09-10T16:32:12.609 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.598+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.609 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.598+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=74,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=4} crc {logm=2408570734,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1775155842,mon_config_key=2056983650}) 2024-09-10T16:32:12.610 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.598+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=9,mon_config_key=8} crc {logm=2769085813,mdsmap=4195066828,mgr=1301684236,mgr_metadata=1162624872,mgrstat=1775155842,mon_config_key=3492313678}) 2024-09-10T16:32:12.610 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.598+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.610 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.598+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=74,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=4} crc {logm=2408570734,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1775155842,mon_config_key=2056983650}) 2024-09-10T16:32:12.610 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=74,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=5} crc {logm=1956794176,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3616328318,mon_config_key=3613608133}) 2024-09-10T16:32:12.610 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.610 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=74,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=4} crc {logm=2408570734,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1775155842,mon_config_key=2056983650}) 2024-09-10T16:32:12.610 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=73,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=7,mon_config_key=8} crc {logm=1431892080,mdsmap=4195066828,mgr=1052353260,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=2420084229,mon_config_key=3492313678}) 2024-09-10T16:32:12.610 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.610 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=74,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=4} crc {logm=2408570734,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1775155842,mon_config_key=2056983650}) 2024-09-10T16:32:12.610 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=70,mdsmap=3,mgr=6,mgr_metadata=1,mgrstat=8,mon_config_key=12} crc {logm=2796105077,mdsmap=4195066828,mgr=3346642988,mgr_metadata=1162624872,mgrstat=3938111591,mon_config_key=584543214}) 2024-09-10T16:32:12.610 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.610 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=74,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=4} crc {logm=2408570734,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1775155842,mon_config_key=2056983650}) 2024-09-10T16:32:12.610 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7} crc {logm=3556323832,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1775155842,mon_config_key=3999733822}) 2024-09-10T16:32:12.611 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.611 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=74,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=4} crc {logm=2408570734,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1775155842,mon_config_key=2056983650}) 2024-09-10T16:32:12.611 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=71,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=7} crc {logm=2991250369,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1775155842,mon_config_key=2999403900}) 2024-09-10T16:32:12.611 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.611 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=74,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=4} crc {logm=2408570734,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1775155842,mon_config_key=2056983650}) 2024-09-10T16:32:12.611 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.602+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=73,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=9,mon_config_key=5} crc {logm=482518610,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1775155842,mon_config_key=3859979509}) 2024-09-10T16:32:12.613 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.613 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=883930612,monmap=65596682,nvmeofgw=598337686,osd_metadata=4180260265,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=3494896111}) 2024-09-10T16:32:12.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {mon_config_key=14,monmap=2,nvmeofgw=3,osd_metadata=4,osd_pg_creating=1,osd_snap=2,osdmap=74} crc {mon_config_key=484922316,monmap=3306189854,nvmeofgw=598337686,osd_metadata=1724382949,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=1934217140}) 2024-09-10T16:32:12.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=883930612,monmap=65596682,nvmeofgw=598337686,osd_metadata=4180260265,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=3494896111}) 2024-09-10T16:32:12.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=1478683655,monmap=65596682,nvmeofgw=1596038039,osd_metadata=3154382413,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=2894622287}) 2024-09-10T16:32:12.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=883930612,monmap=65596682,nvmeofgw=598337686,osd_metadata=4180260265,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=3494896111}) 2024-09-10T16:32:12.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=484922316,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=3223564533}) 2024-09-10T16:32:12.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=883930612,monmap=65596682,nvmeofgw=598337686,osd_metadata=4180260265,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=3494896111}) 2024-09-10T16:32:12.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=1641271985,monmap=65596682,nvmeofgw=598337686,osd_metadata=1515105035,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=4242925798}) 2024-09-10T16:32:12.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=883930612,monmap=65596682,nvmeofgw=598337686,osd_metadata=4180260265,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=3494896111}) 2024-09-10T16:32:12.614 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {mon_config_key=15,monmap=2,nvmeofgw=2,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=1641271985,monmap=3306189854,nvmeofgw=3140514010,osd_metadata=3154382413,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=3638569792}) 2024-09-10T16:32:12.615 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.615 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=883930612,monmap=65596682,nvmeofgw=598337686,osd_metadata=4180260265,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=3494896111}) 2024-09-10T16:32:12.615 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {mon_config_key=14,monmap=2,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=2326203479,monmap=3140514009,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=3078804284}) 2024-09-10T16:32:12.615 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.615 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=883930612,monmap=65596682,nvmeofgw=598337686,osd_metadata=4180260265,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=3494896111}) 2024-09-10T16:32:12.615 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=70} crc {mon_config_key=1641271985,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=1482601233}) 2024-09-10T16:32:12.615 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.615 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {mon_config_key=14,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=72} crc {mon_config_key=883930612,monmap=65596682,nvmeofgw=598337686,osd_metadata=4180260265,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=3494896111}) 2024-09-10T16:32:12.615 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.606+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {mon_config_key=15,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=71} crc {mon_config_key=1641271985,monmap=65596682,nvmeofgw=598337686,osd_metadata=506023827,osd_pg_creating=1940077781,osd_snap=4133920409,osdmap=3792651949}) 2024-09-10T16:32:12.618 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.619 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2089565784}) 2024-09-10T16:32:12.619 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3789149608}) 2024-09-10T16:32:12.619 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.619 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2089565784}) 2024-09-10T16:32:12.619 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=1837743036}) 2024-09-10T16:32:12.619 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.619 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2089565784}) 2024-09-10T16:32:12.619 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=262616704}) 2024-09-10T16:32:12.619 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.619 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2089565784}) 2024-09-10T16:32:12.619 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=1885494346}) 2024-09-10T16:32:12.619 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.620 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2089565784}) 2024-09-10T16:32:12.620 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=2425513536}) 2024-09-10T16:32:12.620 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.620 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2089565784}) 2024-09-10T16:32:12.620 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=3854934512}) 2024-09-10T16:32:12.620 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.620 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2089565784}) 2024-09-10T16:32:12.620 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=2867316249}) 2024-09-10T16:32:12.620 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.620 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=2089565784}) 2024-09-10T16:32:12.620 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=2422352951}) 2024-09-10T16:32:12.620 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.620 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=16} crc {osdmap=21999198}) 2024-09-10T16:32:12.621 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.610+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=16} crc {osdmap=4074576449}) 2024-09-10T16:32:12.621 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.614+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.621 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.614+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=16} crc {osdmap=21999198}) 2024-09-10T16:32:12.621 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.614+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=16} crc {osdmap=4074576449}) 2024-09-10T16:32:12.621 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.614+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.621 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.614+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=16} crc {osdmap=21999198}) 2024-09-10T16:32:12.621 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.614+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=15} crc {osdmap=868620197}) 2024-09-10T16:32:12.621 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.614+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:32:12.621 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.614+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=16} crc {osdmap=21999198}) 2024-09-10T16:32:12.621 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:32:12.614+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=15} crc {osdmap=124090785}) 2024-09-10T16:32:13.600 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-10T16:32:13.600 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T16:32:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 10 monclient: get_monmap_and_config 2024-09-10T16:32:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 10 monclient: build_initial_monmap 2024-09-10T16:32:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 10 monclient: monmap: 2024-09-10T16:32:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:13.731034+0000 2024-09-10T16:32:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:13.731034+0000 2024-09-10T16:32:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:13.731 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:13.732 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:13.732 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:13.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 1 Processor -- start 2024-09-10T16:32:13.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 1 -- start start 2024-09-10T16:32:13.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 10 monclient: init 2024-09-10T16:32:13.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:13.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 10 monclient: _add_conns ranks=[8,7,6,3,1,4,5,0,2] 2024-09-10T16:32:13.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 10 monclient(hunting): picked mon.noname-e con 0x7f42bc09b3c0 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:13.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 10 monclient(hunting): picked mon.noname-i con 0x7f42bc0a2050 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:13.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 10 monclient(hunting): picked mon.noname-d con 0x7f42bc13c3e0 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:13.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc0a2430 con 0x7f42bc13c3e0 2024-09-10T16:32:13.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc0a0dc0 con 0x7f42bc0a2050 2024-09-10T16:32:13.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc0a10a0 con 0x7f42bc09b3c0 2024-09-10T16:32:13.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:13.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c2d1f640 10 monclient(hunting): authenticate will time out at 1101.131316s 2024-09-10T16:32:13.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c0abb640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f42bc09b3c0 0x7f42bc09b7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:42508/0 (socket says 172.21.15.81:42508) 2024-09-10T16:32:13.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42c0abb640 1 -- 172.21.15.81:0/3301874936 learned_addr learned my addr 172.21.15.81:0/3301874936 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42bb7fe640 1 -- 172.21.15.81:0/3301874936 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1528725903 0 0) 0x7f42bc0a10a0 con 0x7f42bc09b3c0 2024-09-10T16:32:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42bb7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42bb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42bb7fe640 10 monclient(hunting): my global_id is 5156 2024-09-10T16:32:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42bb7fe640 1 -- 172.21.15.81:0/3301874936 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42a4003530 con 0x7f42bc09b3c0 2024-09-10T16:32:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42bb7fe640 1 -- 172.21.15.81:0/3301874936 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3065908574 0 0) 0x7f42bc0a2430 con 0x7f42bc13c3e0 2024-09-10T16:32:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42bb7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:13.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42bb7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42bb7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42bb7fe640 10 monclient(hunting): my global_id is 5127 2024-09-10T16:32:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.726+0000 7f42bb7fe640 1 -- 172.21.15.81:0/3301874936 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42bc0a10a0 con 0x7f42bc13c3e0 2024-09-10T16:32:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 1 -- 172.21.15.81:0/3301874936 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 594673017 0 0) 0x7f42bc0a10a0 con 0x7f42bc13c3e0 2024-09-10T16:32:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 1 -- 172.21.15.81:0/3301874936 >> v1:172.21.15.81:6793/0 conn(0x7f42bc09b3c0 legacy=0x7f42bc09b7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 1 -- 172.21.15.81:0/3301874936 >> v1:172.21.15.189:6792/0 conn(0x7f42bc0a2050 legacy=0x7f42bc13acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:32:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 1 monclient: found mon.noname-d 2024-09-10T16:32:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:32:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 1 -- 172.21.15.81:0/3301874936 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42bc09beb0 con 0x7f42bc13c3e0 2024-09-10T16:32:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 10 monclient: _finish_auth 0 2024-09-10T16:32:13.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:32:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 1 -- 172.21.15.81:0/3301874936 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f42b4001b20 con 0x7f42bc13c3e0 2024-09-10T16:32:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:32:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 10 monclient: dump: 2024-09-10T16:32:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:13.739 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:13.740 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 5 monclient: authenticate success, global_id 5127 2024-09-10T16:32:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 1 -- 172.21.15.81:0/3301874936 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42b4001cc0 con 0x7f42bc13c3e0 2024-09-10T16:32:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:13.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 1 -- 172.21.15.81:0/3301874936 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f42b40039a0 con 0x7f42bc13c3e0 2024-09-10T16:32:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 4 set_mon_vals no callback set 2024-09-10T16:32:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:32:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42bb7fe640 10 monclient: dump: 2024-09-10T16:32:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:13.741 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:13.742 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient: shutdown 2024-09-10T16:32:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3301874936 >> v1:172.21.15.81:6792/0 conn(0x7f42bc13c3e0 legacy=0x7f42bc13e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3301874936 shutdown_connections 2024-09-10T16:32:13.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3301874936 >> 172.21.15.81:0/3301874936 conn(0x7f42bc0a4f00 msgr2=0x7f42bc0a52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3301874936 shutdown_connections 2024-09-10T16:32:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3301874936 wait complete. 2024-09-10T16:32:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient: build_initial_monmap 2024-09-10T16:32:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient: monmap: 2024-09-10T16:32:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:13.743 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:13.744 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 1 Processor -- start 2024-09-10T16:32:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 1 -- start start 2024-09-10T16:32:13.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient: init 2024-09-10T16:32:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient: _add_conns ranks=[5,1,0,4,7,2,3,8,6] 2024-09-10T16:32:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient(hunting): picked mon.noname-h con 0x7f42bc09b3c0 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient(hunting): picked mon.noname-f con 0x7f42bc0a2050 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient(hunting): picked mon.noname-a con 0x7f42bc13c3e0 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc0a4910 con 0x7f42bc13c3e0 2024-09-10T16:32:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc094c10 con 0x7f42bc0a2050 2024-09-10T16:32:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42bc0928d0 con 0x7f42bc09b3c0 2024-09-10T16:32:13.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient(hunting): authenticate will time out at 1101.134349s 2024-09-10T16:32:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c12bc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f42bc13c3e0 0x7f42bc1d40f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37904/0 (socket says 172.21.15.81:37904) 2024-09-10T16:32:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c12bc640 1 -- 172.21.15.81:0/3333595086 learned_addr learned my addr 172.21.15.81:0/3333595086 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1425708418 0 0) 0x7f42bc0a4910 con 0x7f42bc13c3e0 2024-09-10T16:32:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient(hunting): my global_id is 5193 2024-09-10T16:32:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f42a8003530 con 0x7f42bc13c3e0 2024-09-10T16:32:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3212059979 0 0) 0x7f42a8003530 con 0x7f42bc13c3e0 2024-09-10T16:32:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f42bc0a4910 con 0x7f42bc13c3e0 2024-09-10T16:32:13.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f42b4001ae0 con 0x7f42bc13c3e0 2024-09-10T16:32:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:32:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient(hunting): dump: 2024-09-10T16:32:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:13.749 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:13.750 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 945401225 0 0) 0x7f42bc0a4910 con 0x7f42bc13c3e0 2024-09-10T16:32:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 >> v1:172.21.15.189:6791/0 conn(0x7f42bc09b3c0 legacy=0x7f42bc13a850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 >> v1:172.21.15.189:6789/0 conn(0x7f42bc0a2050 legacy=0x7f42bc1d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient: _finish_hunting 0 2024-09-10T16:32:13.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 1 monclient: found mon.a 2024-09-10T16:32:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42bc068b60 con 0x7f42bc13c3e0 2024-09-10T16:32:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient: _finish_auth 0 2024-09-10T16:32:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient: _check_auth_tickets 2024-09-10T16:32:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 5 monclient: authenticate success, global_id 5193 2024-09-10T16:32:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient: _renew_subs 2024-09-10T16:32:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3333595086 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f42bc13b7e0 con 0x7f42bc13c3e0 2024-09-10T16:32:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient: _renew_subs 2024-09-10T16:32:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:13.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3333595086 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f42bc094020 con 0x7f42bc13c3e0 2024-09-10T16:32:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f42b4001c80 con 0x7f42bc13c3e0 2024-09-10T16:32:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f42b4004110 con 0x7f42bc13c3e0 2024-09-10T16:32:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42baffd640 4 set_mon_vals no callback set 2024-09-10T16:32:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.730+0000 7f42b97fa640 10 monclient: dump: 2024-09-10T16:32:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:13.752 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:13.753 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.734+0000 7f42c2d1f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:13.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.734+0000 7f42c2d1f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.734+0000 7f42c2d1f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.734+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3333595086 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f429c005090 con 0x7f42bc13c3e0 2024-09-10T16:32:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.734+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f42b4004330 con 0x7f42bc13c3e0 2024-09-10T16:32:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.734+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(119..119 src has 1..119) ==== 3898+0+0 (unknown 365895843 0 0) 0x7f42b404b2a0 con 0x7f42bc13c3e0 2024-09-10T16:32:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.734+0000 7f42c0abb640 10 monclient: get_auth_request con 0x7f42a803ce00 auth_method 0 2024-09-10T16:32:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.738+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f42b4017040 con 0x7f42bc13c3e0 2024-09-10T16:32:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.738+0000 7f42b97fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:13.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.738+0000 7f42b97fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.970+0000 7f42c2d1f640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-10T16:32:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.970+0000 7f42c2d1f640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-10T16:32:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.970+0000 7f42c2d1f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:13.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.970+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3333595086 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f429c005380 con 0x7f42bc13c3e0 2024-09-10T16:32:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.970+0000 7f42b97fa640 1 -- 172.21.15.81:0/3333595086 <== mon.0 v1:172.21.15.81:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 4144922173) 0x7f42b4016940 con 0x7f42bc13c3e0 2024-09-10T16:32:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.970+0000 7f42b97fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-10T16:32:13.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.970+0000 7f42b97fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:13.977 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":14,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","modified":"2024-09-10T16:29:22.909160Z","created":"2024-09-10T16:29:22.909160Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6790","nonce":0}]},"addr":"172.21.15.189:6790/0","public_addr":"172.21.15.189:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6791","nonce":0}]},"addr":"172.21.15.81:6791/0","public_addr":"172.21.15.81:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6791","nonce":0}]},"addr":"172.21.15.189:6791/0","public_addr":"172.21.15.189:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6792","nonce":0}]},"addr":"172.21.15.81:6792/0","public_addr":"172.21.15.81:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6792","nonce":0}]},"addr":"172.21.15.189:6792/0","public_addr":"172.21.15.189:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6793","nonce":0}]},"addr":"172.21.15.81:6793/0","public_addr":"172.21.15.81:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T16:32:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.974+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3333595086 >> v1:172.21.15.189:6812/1108603242 conn(0x7f42a803ce00 legacy=0x7f42a803f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.974+0000 7f42c2d1f640 10 monclient: shutdown 2024-09-10T16:32:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.974+0000 7f42c2d1f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:13.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.974+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3333595086 >> v1:172.21.15.81:6789/0 conn(0x7f42bc13c3e0 legacy=0x7f42bc1d40f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:13.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.974+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3333595086 shutdown_connections 2024-09-10T16:32:13.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.974+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3333595086 >> 172.21.15.81:0/3333595086 conn(0x7f42bc0a4f00 msgr2=0x7f42bc09e4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:13.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.974+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3333595086 shutdown_connections 2024-09-10T16:32:13.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:13.974+0000 7f42c2d1f640 1 -- 172.21.15.81:0/3333595086 wait complete. 2024-09-10T16:32:13.995 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-10T16:32:13.996 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T16:32:13.996 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-10T16:32:13.996 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T16:32:14.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 10 monclient: get_monmap_and_config 2024-09-10T16:32:14.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 10 monclient: build_initial_monmap 2024-09-10T16:32:14.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 10 monclient: monmap: 2024-09-10T16:32:14.114 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:14.114 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.114 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:14.114227+0000 2024-09-10T16:32:14.114 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:14.114227+0000 2024-09-10T16:32:14.115 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:14.115 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.115 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:14.115 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:14.115 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:14.115 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:14.115 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:14.115 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:14.115 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:14.115 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:14.115 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:14.115 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 1 Processor -- start 2024-09-10T16:32:14.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 1 -- start start 2024-09-10T16:32:14.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 10 monclient: init 2024-09-10T16:32:14.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 10 monclient: _add_conns ranks=[6,3,8,1,2,0,4,5,7] 2024-09-10T16:32:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 10 monclient(hunting): picked mon.noname-d con 0x7fa0280a0a90 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 10 monclient(hunting): picked mon.noname-g con 0x7fa0280a35f0 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 10 monclient(hunting): picked mon.noname-e con 0x7fa0280a3a40 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa02809df70 con 0x7fa0280a35f0 2024-09-10T16:32:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa02809fa30 con 0x7fa0280a0a90 2024-09-10T16:32:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa02809fd10 con 0x7fa0280a3a40 2024-09-10T16:32:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 10 monclient(hunting): authenticate will time out at 1101.513672s 2024-09-10T16:32:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa027fff640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fa0280a3a40 0x7fa02813fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:42512/0 (socket says 172.21.15.81:42512) 2024-09-10T16:32:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa027fff640 1 -- 172.21.15.81:0/43031738 learned_addr learned my addr 172.21.15.81:0/43031738 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0277fe640 1 --1- 172.21.15.81:0/43031738 >> v1:172.21.15.81:6792/0 conn(0x7fa0280a0a90 0x7fa0280a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:43566/0 (socket says 172.21.15.81:43566) 2024-09-10T16:32:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 1 -- 172.21.15.81:0/43031738 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1945086804 0 0) 0x7fa02809fd10 con 0x7fa0280a3a40 2024-09-10T16:32:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient(hunting): my global_id is 5165 2024-09-10T16:32:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 1 -- 172.21.15.81:0/43031738 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa014003530 con 0x7fa0280a3a40 2024-09-10T16:32:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 1 -- 172.21.15.81:0/43031738 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2892915256 0 0) 0x7fa02809fa30 con 0x7fa0280a0a90 2024-09-10T16:32:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient(hunting): my global_id is 5136 2024-09-10T16:32:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 1 -- 172.21.15.81:0/43031738 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa02809fd10 con 0x7fa0280a0a90 2024-09-10T16:32:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 1 -- 172.21.15.81:0/43031738 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1823251103 0 0) 0x7fa02809df70 con 0x7fa0280a35f0 2024-09-10T16:32:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient(hunting): my global_id is 134193 2024-09-10T16:32:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 1 -- 172.21.15.81:0/43031738 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa02809fa30 con 0x7fa0280a35f0 2024-09-10T16:32:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 1 -- 172.21.15.81:0/43031738 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3343328466 0 0) 0x7fa014003530 con 0x7fa0280a3a40 2024-09-10T16:32:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 1 -- 172.21.15.81:0/43031738 >> v1:172.21.15.81:6792/0 conn(0x7fa0280a0a90 legacy=0x7fa0280a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 1 -- 172.21.15.81:0/43031738 >> v1:172.21.15.189:6790/0 conn(0x7fa0280a35f0 legacy=0x7fa02813c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient: _finish_hunting 0 2024-09-10T16:32:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 1 monclient: found mon.noname-e 2024-09-10T16:32:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:32:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 1 -- 172.21.15.81:0/43031738 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa02809fff0 con 0x7fa0280a3a40 2024-09-10T16:32:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient: _finish_auth 0 2024-09-10T16:32:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient: _check_auth_tickets 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 1 -- 172.21.15.81:0/43031738 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa020001840 con 0x7fa0280a3a40 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 5 monclient: authenticate success, global_id 5165 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient: dump: 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.126 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.127 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 1 -- 172.21.15.81:0/43031738 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa0200019e0 con 0x7fa0280a3a40 2024-09-10T16:32:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 1 -- 172.21.15.81:0/43031738 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa020004bf0 con 0x7fa0280a3a40 2024-09-10T16:32:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa0267fc640 10 monclient: dump: 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.129 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 4 set_mon_vals no callback set 2024-09-10T16:32:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 10 monclient: shutdown 2024-09-10T16:32:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 1 -- 172.21.15.81:0/43031738 >> v1:172.21.15.81:6793/0 conn(0x7fa0280a3a40 legacy=0x7fa02813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 1 -- 172.21.15.81:0/43031738 shutdown_connections 2024-09-10T16:32:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 1 -- 172.21.15.81:0/43031738 >> 172.21.15.81:0/43031738 conn(0x7fa0280a3fd0 msgr2=0x7fa0280a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 1 -- 172.21.15.81:0/43031738 shutdown_connections 2024-09-10T16:32:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.110+0000 7fa02dbf7640 1 -- 172.21.15.81:0/43031738 wait complete. 2024-09-10T16:32:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 monclient: build_initial_monmap 2024-09-10T16:32:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 monclient: monmap: 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:14.130 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:14.131 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 1 Processor -- start 2024-09-10T16:32:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 1 -- start start 2024-09-10T16:32:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 monclient: init 2024-09-10T16:32:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 monclient: _add_conns ranks=[2,0,7,4,8,6,1,5,3] 2024-09-10T16:32:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 monclient(hunting): picked mon.noname-b con 0x7fa0280a0a90 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 monclient(hunting): picked mon.noname-a con 0x7fa0280a35f0 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 monclient(hunting): picked mon.noname-i con 0x7fa0280a3a40 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0281b4930 con 0x7fa0280a35f0 2024-09-10T16:32:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0281b20c0 con 0x7fa0280a0a90 2024-09-10T16:32:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa0277fe640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fa0280a0a90 0x7fa0281b12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:58530/0 (socket says 172.21.15.81:58530) 2024-09-10T16:32:14.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa0277fe640 1 -- 172.21.15.81:0/3245852980 learned_addr learned my addr 172.21.15.81:0/3245852980 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa0281b3ac0 con 0x7fa0280a3a40 2024-09-10T16:32:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 monclient(hunting): authenticate will time out at 1101.517597s 2024-09-10T16:32:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 354474923 0 0) 0x7fa0281b20c0 con 0x7fa0280a0a90 2024-09-10T16:32:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): my global_id is 5195 2024-09-10T16:32:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa008003530 con 0x7fa0280a0a90 2024-09-10T16:32:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4189697199 0 0) 0x7fa0281b4930 con 0x7fa0280a35f0 2024-09-10T16:32:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): my global_id is 5202 2024-09-10T16:32:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0281b20c0 con 0x7fa0280a35f0 2024-09-10T16:32:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3281907387 0 0) 0x7fa0281b20c0 con 0x7fa0280a35f0 2024-09-10T16:32:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa0281b4930 con 0x7fa0280a35f0 2024-09-10T16:32:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2233273729 0 0) 0x7fa008003530 con 0x7fa0280a0a90 2024-09-10T16:32:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa0281b20c0 con 0x7fa0280a0a90 2024-09-10T16:32:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa0100018c0 con 0x7fa0280a0a90 2024-09-10T16:32:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:32:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): dump: 2024-09-10T16:32:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.133 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.134 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:14.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa018001be0 con 0x7fa0280a35f0 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): dump: 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.135 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.136 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 186201308 0 0) 0x7fa0281b3ac0 con 0x7fa0280a3a40 2024-09-10T16:32:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): my global_id is 5101 2024-09-10T16:32:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa008003530 con 0x7fa0280a3a40 2024-09-10T16:32:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3047215804 0 0) 0x7fa0281b20c0 con 0x7fa0280a0a90 2024-09-10T16:32:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 >> v1:172.21.15.189:6792/0 conn(0x7fa0280a3a40 legacy=0x7fa0281d3be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 >> v1:172.21.15.81:6789/0 conn(0x7fa0280a35f0 legacy=0x7fa0281b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient: _finish_hunting 0 2024-09-10T16:32:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 monclient: found mon.b 2024-09-10T16:32:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa028074560 con 0x7fa0280a0a90 2024-09-10T16:32:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient: _finish_auth 0 2024-09-10T16:32:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient: _check_auth_tickets 2024-09-10T16:32:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 5 monclient: authenticate success, global_id 5195 2024-09-10T16:32:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 monclient: _renew_subs 2024-09-10T16:32:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa0281b4090 con 0x7fa0280a0a90 2024-09-10T16:32:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 monclient: _renew_subs 2024-09-10T16:32:14.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:14.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fa0281b4dc0 con 0x7fa0280a0a90 2024-09-10T16:32:14.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa010001b40 con 0x7fa0280a0a90 2024-09-10T16:32:14.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:14.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa025ffb640 4 set_mon_vals no callback set 2024-09-10T16:32:14.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa010005160 con 0x7fa0280a0a90 2024-09-10T16:32:14.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:14.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient: dump: 2024-09-10T16:32:14.138 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.139 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.140 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fa010005300 con 0x7fa0280a0a90 2024-09-10T16:32:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa02dbf7640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa00c0065d0 con 0x7fa00c002870 2024-09-10T16:32:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(119..119 src has 1..119) ==== 3898+0+0 (unknown 365895843 0 0) 0x7fa01004b1b0 con 0x7fa0280a0a90 2024-09-10T16:32:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 975326536 0 0) 0x7fa00c0065d0 con 0x7fa00c002870 2024-09-10T16:32:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 10 monclient(hunting): my global_id is 5211 2024-09-10T16:32:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.114+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa0281b20c0 con 0x7fa00c002870 2024-09-10T16:32:14.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.118+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2887562168 0 0) 0x7fa0281b20c0 con 0x7fa00c002870 2024-09-10T16:32:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.118+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa00c0065d0 con 0x7fa00c002870 2024-09-10T16:32:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.118+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa018003e00 con 0x7fa00c002870 2024-09-10T16:32:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.118+0000 7fa01ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.118+0000 7fa01ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.118+0000 7fa01ffff640 10 monclient: dump: 2024-09-10T16:32:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.141 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.142 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.118+0000 7fa027fff640 10 monclient: get_auth_request con 0x7fa00803d620 auth_method 0 2024-09-10T16:32:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.118+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1993876602 0 0) 0x7fa00c0065d0 con 0x7fa00c002870 2024-09-10T16:32:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.118+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa00c00a170 con 0x7fa00c002870 2024-09-10T16:32:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.118+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fa018006120 con 0x7fa00c002870 2024-09-10T16:32:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.118+0000 7fa01ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:14.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.118+0000 7fa01ffff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.118+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 >> v1:172.21.15.81:6789/0 conn(0x7fa00c002870 legacy=0x7fa00c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.118+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 >> v1:172.21.15.81:6789/0 conn(0x7fa00c002870 legacy=0x7fa00c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:14.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa02dbf7640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:14.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa02dbf7640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fa00c009e80 con 0x7fa00c009140 2024-09-10T16:32:14.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2903247339 0 0) 0x7fa00c009e80 con 0x7fa00c009140 2024-09-10T16:32:14.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 10 monclient(hunting): my global_id is 5220 2024-09-10T16:32:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa00c0065d0 con 0x7fa00c009140 2024-09-10T16:32:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 288487343 0 0) 0x7fa00c0065d0 con 0x7fa00c009140 2024-09-10T16:32:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa00c009e80 con 0x7fa00c009140 2024-09-10T16:32:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa018004750 con 0x7fa00c009140 2024-09-10T16:32:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 10 monclient: dump: 2024-09-10T16:32:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.145 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.146 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2864037140 0 0) 0x7fa00c009e80 con 0x7fa00c009140 2024-09-10T16:32:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 --> v1:172.21.15.81:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fa00c00c420 con 0x7fa00c009140 2024-09-10T16:32:14.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7713 (unknown 0 0 3261842396) 0x7fa018009130 con 0x7fa00c009140 2024-09-10T16:32:14.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:14.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:14.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 >> v1:172.21.15.81:6789/0 conn(0x7fa00c009140 legacy=0x7fa00c0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa01ffff640 1 -- 172.21.15.81:0/3245852980 >> v1:172.21.15.81:6789/0 conn(0x7fa00c009140 legacy=0x7fa00c0095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:14.147 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-09-10T16:32:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 144071, 2024-09-10T16:32:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:14.148 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-09-10T16:32:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.149 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.150 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:14.151 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.152 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.153 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.154 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:14.155 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:14.156 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:14.157 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.158 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.161 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:14.161 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.161 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.161 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:14.161 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:14.161 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.161 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.161 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.161 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:14.162 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:14.162 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:14.162 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.162 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.162 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:14.162 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:14.162 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.162 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.163 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.163 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:14.163 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:14.163 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:14.163 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.163 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.164 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:14.164 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:14.164 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.164 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.164 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.164 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:14.164 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:14.164 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.164 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.164 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.165 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:14.165 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.165 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.165 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.165 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:14.165 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:14.165 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.165 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.165 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.165 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:14.166 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:14.166 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.166 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.166 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.166 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:14.166 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.166 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.167 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:14.167 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:14.167 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.167 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.167 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.167 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.167 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.168 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:14.168 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:14.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.168 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:14.168 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:14.168 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:14.168 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.168 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.168 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:32:14.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.168 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:14.168 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:14.169 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:14.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.169 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.169 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:14.169 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.169 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:14.169 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:14.169 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:14.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.169 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.169 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:14.169 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa02dbf7640 1 -- 172.21.15.81:0/3245852980 >> v1:172.21.15.189:6812/1108603242 conn(0x7fa00803d620 legacy=0x7fa00803fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa02dbf7640 10 monclient: shutdown 2024-09-10T16:32:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa02dbf7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa02dbf7640 1 -- 172.21.15.81:0/3245852980 >> v1:172.21.15.81:6790/0 conn(0x7fa0280a0a90 legacy=0x7fa0281b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa027fff640 1 -- 172.21.15.81:0/3245852980 reap_dead start 2024-09-10T16:32:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa027fff640 1 -- 172.21.15.81:0/3245852980 reap_dead start 2024-09-10T16:32:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa02dbf7640 1 -- 172.21.15.81:0/3245852980 shutdown_connections 2024-09-10T16:32:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.122+0000 7fa02dbf7640 1 -- 172.21.15.81:0/3245852980 >> 172.21.15.81:0/3245852980 conn(0x7fa0280a3fd0 msgr2=0x7fa0281bdfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.126+0000 7fa02dbf7640 1 -- 172.21.15.81:0/3245852980 shutdown_connections 2024-09-10T16:32:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.126+0000 7fa02dbf7640 1 -- 172.21.15.81:0/3245852980 wait complete. 2024-09-10T16:32:14.172 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:14.172 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-10T16:32:14.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T16:32:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.302+0000 7fd4a0c94640 10 monclient: get_monmap_and_config 2024-09-10T16:32:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.302+0000 7fd4a0c94640 10 monclient: build_initial_monmap 2024-09-10T16:32:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.302+0000 7fd4a0c94640 10 monclient: monmap: 2024-09-10T16:32:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:14.309103+0000 2024-09-10T16:32:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:14.309103+0000 2024-09-10T16:32:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:14.310 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:14.310 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.302+0000 7fd4a0c94640 1 Processor -- start 2024-09-10T16:32:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.302+0000 7fd4a0c94640 1 -- start start 2024-09-10T16:32:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.302+0000 7fd4a0c94640 10 monclient: init 2024-09-10T16:32:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient: _add_conns ranks=[0,4,5,7,6,8,1,3,2] 2024-09-10T16:32:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient(hunting): picked mon.noname-a con 0x7fd49c068960 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:14.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient(hunting): picked mon.noname-c con 0x7fd49c0a0950 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient(hunting): picked mon.noname-h con 0x7fd49c13f5c0 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c0a4200 con 0x7fd49c068960 2024-09-10T16:32:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c0a3c20 con 0x7fd49c0a0950 2024-09-10T16:32:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c0a0ee0 con 0x7fd49c13f5c0 2024-09-10T16:32:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient(hunting): authenticate will time out at 1101.708449s 2024-09-10T16:32:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd493fff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fd49c0a0950 0x7fd49c0a3510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:50178/0 (socket says 172.21.15.81:50178) 2024-09-10T16:32:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd493fff640 1 -- 172.21.15.81:0/4007586815 learned_addr learned my addr 172.21.15.81:0/4007586815 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 1 -- 172.21.15.81:0/4007586815 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3038097494 0 0) 0x7fd49c0a3c20 con 0x7fd49c0a0950 2024-09-10T16:32:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient(hunting): my global_id is 5152 2024-09-10T16:32:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 1 -- 172.21.15.81:0/4007586815 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd488003530 con 0x7fd49c0a0950 2024-09-10T16:32:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 1 -- 172.21.15.81:0/4007586815 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 236312391 0 0) 0x7fd49c0a4200 con 0x7fd49c068960 2024-09-10T16:32:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient(hunting): my global_id is 5229 2024-09-10T16:32:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 1 -- 172.21.15.81:0/4007586815 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49c0a3c20 con 0x7fd49c068960 2024-09-10T16:32:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 1 -- 172.21.15.81:0/4007586815 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2116145230 0 0) 0x7fd488003530 con 0x7fd49c0a0950 2024-09-10T16:32:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 1 -- 172.21.15.81:0/4007586815 >> v1:172.21.15.189:6791/0 conn(0x7fd49c13f5c0 legacy=0x7fd49c1419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 1 -- 172.21.15.81:0/4007586815 >> v1:172.21.15.81:6789/0 conn(0x7fd49c068960 legacy=0x7fd49c0a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient: _finish_hunting 0 2024-09-10T16:32:14.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 1 monclient: found mon.noname-c 2024-09-10T16:32:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:32:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 1 -- 172.21.15.81:0/4007586815 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c0a4630 con 0x7fd49c0a0950 2024-09-10T16:32:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient: _finish_auth 0 2024-09-10T16:32:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient: _check_auth_tickets 2024-09-10T16:32:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 1 -- 172.21.15.81:0/4007586815 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd484001840 con 0x7fd49c0a0950 2024-09-10T16:32:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 5 monclient: authenticate success, global_id 5152 2024-09-10T16:32:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:32:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient: dump: 2024-09-10T16:32:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.320 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.321 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.322 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 1 -- 172.21.15.81:0/4007586815 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd484001a60 con 0x7fd49c0a0950 2024-09-10T16:32:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 4 set_mon_vals no callback set 2024-09-10T16:32:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 1 -- 172.21.15.81:0/4007586815 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd484001d50 con 0x7fd49c0a0950 2024-09-10T16:32:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd499d9b640 10 monclient: dump: 2024-09-10T16:32:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.322 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.323 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient: shutdown 2024-09-10T16:32:14.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 1 -- 172.21.15.81:0/4007586815 >> v1:172.21.15.81:6791/0 conn(0x7fd49c0a0950 legacy=0x7fd49c0a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 1 -- 172.21.15.81:0/4007586815 shutdown_connections 2024-09-10T16:32:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 1 -- 172.21.15.81:0/4007586815 >> 172.21.15.81:0/4007586815 conn(0x7fd49c0a85d0 msgr2=0x7fd49c0a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 1 -- 172.21.15.81:0/4007586815 shutdown_connections 2024-09-10T16:32:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 1 -- 172.21.15.81:0/4007586815 wait complete. 2024-09-10T16:32:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient: build_initial_monmap 2024-09-10T16:32:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient: monmap: 2024-09-10T16:32:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:14.324 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:14.325 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 1 Processor -- start 2024-09-10T16:32:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 1 -- start start 2024-09-10T16:32:14.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient: init 2024-09-10T16:32:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient: _add_conns ranks=[5,0,4,3,8,1,2,7,6] 2024-09-10T16:32:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient(hunting): picked mon.noname-h con 0x7fd49c068960 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient(hunting): picked mon.noname-a con 0x7fd49c0a0950 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient(hunting): picked mon.noname-c con 0x7fd49c13f5c0 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c139a60 con 0x7fd49c0a0950 2024-09-10T16:32:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c13a660 con 0x7fd49c13f5c0 2024-09-10T16:32:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd49c13a940 con 0x7fd49c068960 2024-09-10T16:32:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.306+0000 7fd4a0c94640 10 monclient(hunting): authenticate will time out at 1101.711981s 2024-09-10T16:32:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd493fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd49c0a0950 0x7fd49c072c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37952/0 (socket says 172.21.15.81:37952) 2024-09-10T16:32:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd493fff640 1 -- 172.21.15.81:0/604630209 learned_addr learned my addr 172.21.15.81:0/604630209 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:14.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd49ad9d640 1 --1- 172.21.15.81:0/604630209 >> v1:172.21.15.81:6791/0 conn(0x7fd49c13f5c0 0x7fd49c073330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:50180/0 (socket says 172.21.15.81:50180) 2024-09-10T16:32:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3322226585 0 0) 0x7fd49c139a60 con 0x7fd49c0a0950 2024-09-10T16:32:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): my global_id is 5238 2024-09-10T16:32:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd47c003530 con 0x7fd49c0a0950 2024-09-10T16:32:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3482661602 0 0) 0x7fd49c13a660 con 0x7fd49c13f5c0 2024-09-10T16:32:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): my global_id is 5161 2024-09-10T16:32:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49c139a60 con 0x7fd49c13f5c0 2024-09-10T16:32:14.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2064272768 0 0) 0x7fd47c003530 con 0x7fd49c0a0950 2024-09-10T16:32:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd49c13a660 con 0x7fd49c0a0950 2024-09-10T16:32:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3462430423 0 0) 0x7fd49c13a940 con 0x7fd49c068960 2024-09-10T16:32:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): my global_id is 5000 2024-09-10T16:32:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd47c003530 con 0x7fd49c068960 2024-09-10T16:32:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd484001800 con 0x7fd49c0a0950 2024-09-10T16:32:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:32:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): dump: 2024-09-10T16:32:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.328 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.329 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.330 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 425534398 0 0) 0x7fd49c139a60 con 0x7fd49c13f5c0 2024-09-10T16:32:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd49c13a940 con 0x7fd49c13f5c0 2024-09-10T16:32:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd494001d20 con 0x7fd49c13f5c0 2024-09-10T16:32:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): dump: 2024-09-10T16:32:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.331 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1474194797 0 0) 0x7fd49c13a660 con 0x7fd49c0a0950 2024-09-10T16:32:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 >> v1:172.21.15.189:6791/0 conn(0x7fd49c068960 legacy=0x7fd49c072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 >> v1:172.21.15.81:6791/0 conn(0x7fd49c13f5c0 legacy=0x7fd49c073330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:32:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 monclient: found mon.a 2024-09-10T16:32:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd49c0a63b0 con 0x7fd49c0a0950 2024-09-10T16:32:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient: _finish_auth 0 2024-09-10T16:32:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:32:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd4a0c94640 5 monclient: authenticate success, global_id 5238 2024-09-10T16:32:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd4a0c94640 10 monclient: _renew_subs 2024-09-10T16:32:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd4a0c94640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd4a0c94640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd49c142cb0 con 0x7fd49c0a0950 2024-09-10T16:32:14.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd4a0c94640 10 monclient: _renew_subs 2024-09-10T16:32:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd4a0c94640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd4a0c94640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd49c13a380 con 0x7fd49c0a0950 2024-09-10T16:32:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd484001200 con 0x7fd49c0a0950 2024-09-10T16:32:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd484004fc0 con 0x7fd49c0a0950 2024-09-10T16:32:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd49959a640 4 set_mon_vals no callback set 2024-09-10T16:32:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient: dump: 2024-09-10T16:32:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.333 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.334 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd4a0c94640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd4a0c94640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd4800065d0 con 0x7fd480002870 2024-09-10T16:32:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fd484010ed0 con 0x7fd49c0a0950 2024-09-10T16:32:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(120..120 src has 1..120) ==== 3898+0+0 (unknown 3499360988 0 0) 0x7fd48404b050 con 0x7fd49c0a0950 2024-09-10T16:32:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2211485475 0 0) 0x7fd4800065d0 con 0x7fd480002870 2024-09-10T16:32:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient(hunting): my global_id is 5204 2024-09-10T16:32:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd49c13a660 con 0x7fd480002870 2024-09-10T16:32:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd49ad9d640 10 monclient: get_auth_request con 0x7fd47c03d800 auth_method 0 2024-09-10T16:32:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2852253592 0 0) 0x7fd49c13a660 con 0x7fd480002870 2024-09-10T16:32:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd4800065d0 con 0x7fd480002870 2024-09-10T16:32:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd48c0017f0 con 0x7fd480002870 2024-09-10T16:32:14.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient: dump: 2024-09-10T16:32:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.336 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.337 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 958362281 0 0) 0x7fd4800065d0 con 0x7fd480002870 2024-09-10T16:32:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd48000a170 con 0x7fd480002870 2024-09-10T16:32:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd48c001b20 con 0x7fd480002870 2024-09-10T16:32:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 >> v1:172.21.15.81:6790/0 conn(0x7fd480002870 legacy=0x7fd480004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.310+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 >> v1:172.21.15.81:6790/0 conn(0x7fd480002870 legacy=0x7fd480004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:14.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd4a0c94640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:14.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd4a0c94640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd480009e80 con 0x7fd480009140 2024-09-10T16:32:14.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 396283901 0 0) 0x7fd480009e80 con 0x7fd480009140 2024-09-10T16:32:14.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 10 monclient(hunting): my global_id is 5213 2024-09-10T16:32:14.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd4800065d0 con 0x7fd480009140 2024-09-10T16:32:14.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2387987890 0 0) 0x7fd4800065d0 con 0x7fd480009140 2024-09-10T16:32:14.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd480009e80 con 0x7fd480009140 2024-09-10T16:32:14.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd48c003b30 con 0x7fd480009140 2024-09-10T16:32:14.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:14.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 10 monclient: dump: 2024-09-10T16:32:14.340 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.340 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.340 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.340 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.340 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.340 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.341 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.341 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.341 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.341 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.341 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.341 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.341 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.341 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.341 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.341 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4009270003 0 0) 0x7fd480009e80 con 0x7fd480009140 2024-09-10T16:32:14.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 --> v1:172.21.15.81:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd48000c420 con 0x7fd480009140 2024-09-10T16:32:14.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 2443849692) 0x7fd48c003d90 con 0x7fd480009140 2024-09-10T16:32:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 >> v1:172.21.15.81:6790/0 conn(0x7fd480009140 legacy=0x7fd4800095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd492ffd640 1 -- 172.21.15.81:0/604630209 >> v1:172.21.15.81:6790/0 conn(0x7fd480009140 legacy=0x7fd4800095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:14.342 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:14.342 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:14.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:14.342 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:14.342 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:14.342 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 144287, 2024-09-10T16:32:14.343 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:14.343 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:14.343 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:14.343 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:14.343 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:14.343 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:14.343 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:14.343 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:14.343 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:14.343 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:14.343 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.343 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-09-10T16:32:14.343 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:14.344 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:14.344 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:14.344 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.344 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.344 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.344 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.344 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.344 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.344 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.344 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.344 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.344 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.345 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.345 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.345 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:14.345 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:14.345 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.345 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.345 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.345 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.345 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.345 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.345 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.345 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.345 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.346 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.346 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.346 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.346 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:14.346 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:14.346 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:14.346 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:14.346 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:14.346 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:14.346 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:14.346 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:14.346 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:14.347 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:14.347 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:14.347 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:14.347 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:14.347 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:14.347 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:14.347 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:14.347 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:14.347 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.347 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.347 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.347 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.347 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.348 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.348 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.348 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.348 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.348 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.348 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.348 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.348 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:14.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.348 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:14.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.348 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:14.348 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:14.349 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.349 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.349 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:14.349 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.349 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.349 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.349 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:14.349 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:14.349 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.349 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.350 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.350 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.350 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:14.350 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:14.350 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.350 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.350 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.350 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:14.350 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.350 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.351 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:14.351 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:14.351 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.351 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.351 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.351 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:14.351 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:14.351 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.351 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.351 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.351 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.352 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:14.352 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.352 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.352 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.352 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:14.352 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:14.352 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.352 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.352 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.353 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:14.353 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:14.353 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:14.353 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.353 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:14.353 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:14.354 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.354 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.354 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.354 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:14.354 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:14.354 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:14.354 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.355 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:14.355 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:14.355 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.355 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.355 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.355 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:14.355 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:14.355 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:14.356 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.356 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.356 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:14.356 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:14.356 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.356 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.356 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:14.357 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:14.358 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.358 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.358 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.358 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:14.358 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:14.358 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:14.358 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.359 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:14.359 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:14.359 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.359 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.359 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.359 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:14.359 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:14.359 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.360 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.360 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.360 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:14.360 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.360 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.360 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:14.360 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:14.360 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.360 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.360 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.361 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.361 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:14.361 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:14.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.361 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:14.361 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:14.361 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:14.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.361 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.361 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:14.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:32:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-09-10T16:32:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.362 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:14.363 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd4a0c94640 1 -- 172.21.15.81:0/604630209 >> v1:172.21.15.189:6812/1108603242 conn(0x7fd47c03d800 legacy=0x7fd47c03fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd4a0c94640 10 monclient: shutdown 2024-09-10T16:32:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd4a0c94640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd4a0c94640 1 -- 172.21.15.81:0/604630209 >> v1:172.21.15.81:6789/0 conn(0x7fd49c0a0950 legacy=0x7fd49c072c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd49ad9d640 1 -- 172.21.15.81:0/604630209 reap_dead start 2024-09-10T16:32:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd4a0c94640 1 -- 172.21.15.81:0/604630209 shutdown_connections 2024-09-10T16:32:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd4a0c94640 1 -- 172.21.15.81:0/604630209 >> 172.21.15.81:0/604630209 conn(0x7fd49c0a85d0 msgr2=0x7fd49c0a4e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd4a0c94640 1 -- 172.21.15.81:0/604630209 shutdown_connections 2024-09-10T16:32:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.318+0000 7fd4a0c94640 1 -- 172.21.15.81:0/604630209 wait complete. 2024-09-10T16:32:14.365 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:14.365 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-10T16:32:14.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T16:32:14.366 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29746]: starting. 2024-09-10T16:32:14.366 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29746]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29745 2024-09-10T16:32:14.366 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29746]: created object 0... 2024-09-10T16:32:14.366 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29746]: created object 25... 2024-09-10T16:32:14.366 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29746]: created object 49... 2024-09-10T16:32:14.366 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29746]: finishing. 2024-09-10T16:32:14.366 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29746]: shutting down. 2024-09-10T16:32:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 10 monclient: get_monmap_and_config 2024-09-10T16:32:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 10 monclient: build_initial_monmap 2024-09-10T16:32:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 10 monclient: monmap: 2024-09-10T16:32:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:14.478201+0000 2024-09-10T16:32:14.478 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:14.478201+0000 2024-09-10T16:32:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:14.479 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:14.479 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 1 Processor -- start 2024-09-10T16:32:14.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 1 -- start start 2024-09-10T16:32:14.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 10 monclient: init 2024-09-10T16:32:14.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:14.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 10 monclient: _add_conns ranks=[1,5,7,4,0,3,6,8,2] 2024-09-10T16:32:14.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 10 monclient(hunting): picked mon.noname-f con 0x7f9f44132720 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:14.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 10 monclient(hunting): picked mon.noname-h con 0x7f9f4409caa0 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:14.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 10 monclient(hunting): picked mon.noname-i con 0x7f9f4413f7a0 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:14.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f44133210 con 0x7f9f44132720 2024-09-10T16:32:14.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f4409da00 con 0x7f9f4409caa0 2024-09-10T16:32:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f4409dce0 con 0x7f9f4413f7a0 2024-09-10T16:32:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 10 monclient(hunting): authenticate will time out at 1101.877725s 2024-09-10T16:32:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f41d9b640 1 --1- >> v1:172.21.15.189:6791/0 conn(0x7f9f4409caa0 0x7f9f4413e080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6791/0 says I am v1:172.21.15.81:35364/0 (socket says 172.21.15.81:35364) 2024-09-10T16:32:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f41d9b640 1 -- 172.21.15.81:0/2575013360 learned_addr learned my addr 172.21.15.81:0/2575013360 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4259c640 1 --1- 172.21.15.81:0/2575013360 >> v1:172.21.15.189:6789/0 conn(0x7f9f44132720 0x7f9f44132b00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.81:54956/0 (socket says 172.21.15.81:54956) 2024-09-10T16:32:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f42d9d640 1 --1- 172.21.15.81:0/2575013360 >> v1:172.21.15.189:6792/0 conn(0x7f9f4413f7a0 0x7f9f44141b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6792/0 says I am v1:172.21.15.81:48350/0 (socket says 172.21.15.81:48350) 2024-09-10T16:32:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 1 -- 172.21.15.81:0/2575013360 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3191666399 0 0) 0x7f9f44133210 con 0x7f9f44132720 2024-09-10T16:32:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient(hunting): my global_id is 5221 2024-09-10T16:32:14.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 1 -- 172.21.15.81:0/2575013360 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f30003530 con 0x7f9f44132720 2024-09-10T16:32:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 1 -- 172.21.15.81:0/2575013360 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 296579861 0 0) 0x7f9f4409da00 con 0x7f9f4409caa0 2024-09-10T16:32:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient(hunting): my global_id is 5009 2024-09-10T16:32:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 1 -- 172.21.15.81:0/2575013360 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f44133210 con 0x7f9f4409caa0 2024-09-10T16:32:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 1 -- 172.21.15.81:0/2575013360 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2325331082 0 0) 0x7f9f4409dce0 con 0x7f9f4413f7a0 2024-09-10T16:32:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient(hunting): my global_id is 5110 2024-09-10T16:32:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 1 -- 172.21.15.81:0/2575013360 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f4409da00 con 0x7f9f4413f7a0 2024-09-10T16:32:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 1 -- 172.21.15.81:0/2575013360 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2592593782 0 0) 0x7f9f30003530 con 0x7f9f44132720 2024-09-10T16:32:14.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 1 -- 172.21.15.81:0/2575013360 >> v1:172.21.15.189:6792/0 conn(0x7f9f4413f7a0 legacy=0x7f9f44141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 1 -- 172.21.15.81:0/2575013360 >> v1:172.21.15.189:6791/0 conn(0x7f9f4409caa0 legacy=0x7f9f4413e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient: _finish_hunting 0 2024-09-10T16:32:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 1 monclient: found mon.noname-f 2024-09-10T16:32:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.189:6789/0 2024-09-10T16:32:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 1 -- 172.21.15.81:0/2575013360 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4409dfc0 con 0x7f9f44132720 2024-09-10T16:32:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient: _finish_auth 0 2024-09-10T16:32:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient: _check_auth_tickets 2024-09-10T16:32:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 1 -- 172.21.15.81:0/2575013360 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9f3c001bc0 con 0x7f9f44132720 2024-09-10T16:32:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-10T16:32:14.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient: dump: 2024-09-10T16:32:14.493 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.493 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.493 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.493 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.493 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.493 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.493 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.494 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 5 monclient: authenticate success, global_id 5221 2024-09-10T16:32:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 1 -- 172.21.15.81:0/2575013360 <== mon.1 v1:172.21.15.189:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f3c001d60 con 0x7f9f44132720 2024-09-10T16:32:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:14.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:14.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 4 set_mon_vals no callback set 2024-09-10T16:32:14.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 1 -- 172.21.15.81:0/2575013360 <== mon.1 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9f3c004eb0 con 0x7f9f44132720 2024-09-10T16:32:14.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:32:14.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f4159a640 10 monclient: dump: 2024-09-10T16:32:14.495 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.495 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.495 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.495 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.496 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.496 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.496 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.496 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.496 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.496 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.496 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.496 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.496 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.496 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.496 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.496 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 10 monclient: shutdown 2024-09-10T16:32:14.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:14.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 1 -- 172.21.15.81:0/2575013360 >> v1:172.21.15.189:6789/0 conn(0x7f9f44132720 legacy=0x7f9f44132b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 1 -- 172.21.15.81:0/2575013360 shutdown_connections 2024-09-10T16:32:14.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.474+0000 7f9f488a8640 1 -- 172.21.15.81:0/2575013360 >> 172.21.15.81:0/2575013360 conn(0x7f9f440a8240 msgr2=0x7f9f440a4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:14.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 1 -- 172.21.15.81:0/2575013360 shutdown_connections 2024-09-10T16:32:14.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 1 -- 172.21.15.81:0/2575013360 wait complete. 2024-09-10T16:32:14.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 monclient: build_initial_monmap 2024-09-10T16:32:14.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 monclient: monmap: 2024-09-10T16:32:14.497 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:14.497 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:14.497 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:14.497 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:14.497 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:14.498 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:14.498 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:14.498 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:14.498 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:14.498 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:14.498 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:14.498 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:14.498 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:14.498 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:14.498 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:14.498 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 1 Processor -- start 2024-09-10T16:32:14.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 1 -- start start 2024-09-10T16:32:14.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 monclient: init 2024-09-10T16:32:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 monclient: _add_conns ranks=[6,5,1,7,3,4,8,0,2] 2024-09-10T16:32:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 monclient(hunting): picked mon.noname-d con 0x7f9f4409caa0 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 monclient(hunting): picked mon.noname-h con 0x7f9f44132720 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 monclient(hunting): picked mon.noname-f con 0x7f9f4413f7a0 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f441ce740 con 0x7f9f4413f7a0 2024-09-10T16:32:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f4413bd60 con 0x7f9f44132720 2024-09-10T16:32:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9f4413e940 con 0x7f9f4409caa0 2024-09-10T16:32:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 monclient(hunting): authenticate will time out at 1101.881436s 2024-09-10T16:32:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f4259c640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f9f4409caa0 0x7f9f441cd920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:43578/0 (socket says 172.21.15.81:43578) 2024-09-10T16:32:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f4259c640 1 -- 172.21.15.81:0/585187407 learned_addr learned my addr 172.21.15.81:0/585187407 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:14.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1058995306 0 0) 0x7f9f4413e940 con 0x7f9f4409caa0 2024-09-10T16:32:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): my global_id is 5145 2024-09-10T16:32:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f24003530 con 0x7f9f4409caa0 2024-09-10T16:32:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2225396625 0 0) 0x7f9f24003530 con 0x7f9f4409caa0 2024-09-10T16:32:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f4413e940 con 0x7f9f4409caa0 2024-09-10T16:32:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9f3c004b70 con 0x7f9f4409caa0 2024-09-10T16:32:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:32:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): dump: 2024-09-10T16:32:14.500 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.501 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.502 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577472440 0 0) 0x7f9f4413bd60 con 0x7f9f44132720 2024-09-10T16:32:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): my global_id is 5018 2024-09-10T16:32:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f24003530 con 0x7f9f44132720 2024-09-10T16:32:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254335120 0 0) 0x7f9f441ce740 con 0x7f9f4413f7a0 2024-09-10T16:32:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): my global_id is 5230 2024-09-10T16:32:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f4413bd60 con 0x7f9f4413f7a0 2024-09-10T16:32:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1420805721 0 0) 0x7f9f4413e940 con 0x7f9f4409caa0 2024-09-10T16:32:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 >> v1:172.21.15.189:6791/0 conn(0x7f9f44132720 legacy=0x7f9f441ce030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 >> v1:172.21.15.189:6789/0 conn(0x7f9f4413f7a0 legacy=0x7f9f441d5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient: _finish_hunting 0 2024-09-10T16:32:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 monclient: found mon.d 2024-09-10T16:32:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:32:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f4413b200 con 0x7f9f4409caa0 2024-09-10T16:32:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient: _finish_auth 0 2024-09-10T16:32:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient: _check_auth_tickets 2024-09-10T16:32:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 5 monclient: authenticate success, global_id 5145 2024-09-10T16:32:14.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 monclient: _renew_subs 2024-09-10T16:32:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:32:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9f4413ccc0 con 0x7f9f4409caa0 2024-09-10T16:32:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 monclient: _renew_subs 2024-09-10T16:32:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:32:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f9f4413a770 con 0x7f9f4409caa0 2024-09-10T16:32:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9f3c001580 con 0x7f9f4409caa0 2024-09-10T16:32:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9f3c001d40 con 0x7f9f4409caa0 2024-09-10T16:32:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f40d99640 4 set_mon_vals no callback set 2024-09-10T16:32:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:32:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient: dump: 2024-09-10T16:32:14.504 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.505 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.506 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f488a8640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9f280065d0 con 0x7f9f28002870 2024-09-10T16:32:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f9f3c0112a0 con 0x7f9f4409caa0 2024-09-10T16:32:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(120..120 src has 1..120) ==== 3898+0+0 (unknown 3499360988 0 0) 0x7f9f3c04b2e0 con 0x7f9f4409caa0 2024-09-10T16:32:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1603390727 0 0) 0x7f9f280065d0 con 0x7f9f28002870 2024-09-10T16:32:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient(hunting): my global_id is 5170 2024-09-10T16:32:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f4413e940 con 0x7f9f28002870 2024-09-10T16:32:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f42d9d640 10 monclient: get_auth_request con 0x7f9f2403d210 auth_method 0 2024-09-10T16:32:14.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1346481372 0 0) 0x7f9f4413e940 con 0x7f9f28002870 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f280065d0 con 0x7f9f28002870 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9f2c001980 con 0x7f9f28002870 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.478+0000 7f9f3affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.482+0000 7f9f3affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.482+0000 7f9f3affd640 10 monclient: dump: 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.507 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.508 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.482+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1015683120 0 0) 0x7f9f280065d0 con 0x7f9f28002870 2024-09-10T16:32:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.482+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.81:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9f2800a170 con 0x7f9f28002870 2024-09-10T16:32:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.482+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9f2c001cd0 con 0x7f9f28002870 2024-09-10T16:32:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.482+0000 7f9f3affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.482+0000 7f9f3affd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.482+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 >> v1:172.21.15.81:6791/0 conn(0x7f9f28002870 legacy=0x7f9f28004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.482+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 >> v1:172.21.15.81:6791/0 conn(0x7f9f28002870 legacy=0x7f9f28004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:14.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f488a8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:14.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f488a8640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9f28009e60 con 0x7f9f28009120 2024-09-10T16:32:14.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3571189786 0 0) 0x7f9f28009e60 con 0x7f9f28009120 2024-09-10T16:32:14.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 10 monclient(hunting): my global_id is 5179 2024-09-10T16:32:14.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9f280065d0 con 0x7f9f28009120 2024-09-10T16:32:14.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4177402202 0 0) 0x7f9f280065d0 con 0x7f9f28009120 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9f28009e60 con 0x7f9f28009120 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9f2c004de0 con 0x7f9f28009120 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 10 monclient: dump: 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.511 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.512 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.512 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.512 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.512 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.512 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.512 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3115715121 0 0) 0x7f9f28009e60 con 0x7f9f28009120 2024-09-10T16:32:14.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 --> v1:172.21.15.81:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9f2800c400 con 0x7f9f28009120 2024-09-10T16:32:14.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 930370676) 0x7f9f2c006250 con 0x7f9f28009120 2024-09-10T16:32:14.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:14.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:14.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 >> v1:172.21.15.81:6791/0 conn(0x7f9f28009120 legacy=0x7f9f280095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f3affd640 1 -- 172.21.15.81:0/585187407 >> v1:172.21.15.81:6791/0 conn(0x7f9f28009120 legacy=0x7f9f280095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:14.513 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:14.513 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:14.513 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:14.513 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:14.513 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:14.513 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 144443, 2024-09-10T16:32:14.513 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:14.513 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:14.513 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:14.513 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-09-10T16:32:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.514 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.515 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.515 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.515 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.515 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.515 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.515 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.515 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.515 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.515 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.515 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:14.515 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:14.515 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.515 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.516 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.516 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.516 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.516 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.516 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.516 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.516 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.516 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.516 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.516 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.516 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.516 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:14.516 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:14.517 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:14.517 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:14.517 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:14.517 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:14.517 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:14.517 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:14.517 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:14.517 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:14.517 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:14.517 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:14.517 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:14.517 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:14.517 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:14.517 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.518 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:14.520 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:14.520 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.520 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.520 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.520 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:14.520 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:14.520 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.520 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.520 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:14.521 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.521 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.521 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.521 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:14.521 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:14.521 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.521 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.521 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.521 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.521 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:14.521 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:14.521 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.523 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:14.523 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:14.523 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.523 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:14.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.523 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.523 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.523 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:14.524 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:14.524 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.524 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.524 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.524 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:14.524 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:14.524 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.524 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.524 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:14.525 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.525 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.525 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.525 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:14.525 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:14.525 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.525 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.525 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.526 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:14.526 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:14.526 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.526 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:14.526 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.526 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.526 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:14.527 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:14.527 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.527 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.527 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.527 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:14.527 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:14.527 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:14.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.528 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:14.528 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:14.528 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.528 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.528 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.528 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:14.529 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:14.529 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:14.529 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.529 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:14.529 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:14.529 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.529 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:14.531 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:14.531 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.531 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.531 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.531 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:14.531 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:14.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.531 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:14.531 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:14.531 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:14.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.532 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.532 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:32:14.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.532 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:14.532 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:14.532 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:14.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.532 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.532 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:14.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.532 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:14.532 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:14.532 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:14.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.533 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:14.533 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:14.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f488a8640 1 -- 172.21.15.81:0/585187407 >> v1:172.21.15.189:6812/1108603242 conn(0x7f9f2403d210 legacy=0x7f9f2403f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f488a8640 10 monclient: shutdown 2024-09-10T16:32:14.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f488a8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:14.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f488a8640 1 -- 172.21.15.81:0/585187407 >> v1:172.21.15.81:6792/0 conn(0x7f9f4409caa0 legacy=0x7f9f441cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f42d9d640 1 -- 172.21.15.81:0/585187407 reap_dead start 2024-09-10T16:32:14.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f42d9d640 1 -- 172.21.15.81:0/585187407 reap_dead start 2024-09-10T16:32:14.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f488a8640 1 -- 172.21.15.81:0/585187407 shutdown_connections 2024-09-10T16:32:14.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.486+0000 7f9f488a8640 1 -- 172.21.15.81:0/585187407 >> 172.21.15.81:0/585187407 conn(0x7f9f440a8240 msgr2=0x7f9f440a34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:14.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.490+0000 7f9f488a8640 1 -- 172.21.15.81:0/585187407 shutdown_connections 2024-09-10T16:32:14.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.490+0000 7f9f488a8640 1 -- 172.21.15.81:0/585187407 wait complete. 2024-09-10T16:32:14.535 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:14.535 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-10T16:32:14.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-10T16:32:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient: get_monmap_and_config 2024-09-10T16:32:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient: build_initial_monmap 2024-09-10T16:32:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient: monmap: 2024-09-10T16:32:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:14.658180+0000 2024-09-10T16:32:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:14.658180+0000 2024-09-10T16:32:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:14.659 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 1 Processor -- start 2024-09-10T16:32:14.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 1 -- start start 2024-09-10T16:32:14.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient: init 2024-09-10T16:32:14.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:14.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient: _add_conns ranks=[8,0,7,3,1,5,6,4,2] 2024-09-10T16:32:14.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient(hunting): picked mon.noname-e con 0x7f682409b4c0 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:14.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient(hunting): picked mon.noname-a con 0x7f68240a2620 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient(hunting): picked mon.noname-i con 0x7f682413c320 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68240a15d0 con 0x7f68240a2620 2024-09-10T16:32:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68240a0d30 con 0x7f682413c320 2024-09-10T16:32:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68240a1010 con 0x7f682409b4c0 2024-09-10T16:32:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient(hunting): authenticate will time out at 1102.057530s 2024-09-10T16:32:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682a0eb640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f682409b4c0 0x7f682409b8a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:42526/0 (socket says 172.21.15.81:42526) 2024-09-10T16:32:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682a0eb640 1 -- 172.21.15.81:0/2863318604 learned_addr learned my addr 172.21.15.81:0/2863318604 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 1 -- 172.21.15.81:0/2863318604 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1141372700 0 0) 0x7f68240a1010 con 0x7f682409b4c0 2024-09-10T16:32:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient(hunting): my global_id is 5174 2024-09-10T16:32:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 1 -- 172.21.15.81:0/2863318604 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f680c003530 con 0x7f682409b4c0 2024-09-10T16:32:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 1 -- 172.21.15.81:0/2863318604 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3859663554 0 0) 0x7f68240a15d0 con 0x7f68240a2620 2024-09-10T16:32:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient(hunting): my global_id is 5247 2024-09-10T16:32:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 1 -- 172.21.15.81:0/2863318604 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68240a1010 con 0x7f68240a2620 2024-09-10T16:32:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 1 -- 172.21.15.81:0/2863318604 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 809553053 0 0) 0x7f680c003530 con 0x7f682409b4c0 2024-09-10T16:32:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 1 -- 172.21.15.81:0/2863318604 >> v1:172.21.15.189:6792/0 conn(0x7f682413c320 legacy=0x7f682413e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 1 -- 172.21.15.81:0/2863318604 >> v1:172.21.15.81:6789/0 conn(0x7f68240a2620 legacy=0x7f682413ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient: _finish_hunting 0 2024-09-10T16:32:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 1 monclient: found mon.noname-e 2024-09-10T16:32:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:14.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:32:14.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 1 -- 172.21.15.81:0/2863318604 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68240a12f0 con 0x7f682409b4c0 2024-09-10T16:32:14.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient: _finish_auth 0 2024-09-10T16:32:14.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient: _check_auth_tickets 2024-09-10T16:32:14.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:14.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 1 -- 172.21.15.81:0/2863318604 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6814001bc0 con 0x7f682409b4c0 2024-09-10T16:32:14.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:32:14.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient: dump: 2024-09-10T16:32:14.669 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.669 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.669 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.669 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.669 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.670 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.670 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.670 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.670 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.670 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.670 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.670 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.670 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.670 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.670 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.670 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 5 monclient: authenticate success, global_id 5174 2024-09-10T16:32:14.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:14.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 1 -- 172.21.15.81:0/2863318604 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6814001d60 con 0x7f682409b4c0 2024-09-10T16:32:14.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:14.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:14.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 1 -- 172.21.15.81:0/2863318604 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6814004f70 con 0x7f682409b4c0 2024-09-10T16:32:14.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 4 set_mon_vals no callback set 2024-09-10T16:32:14.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:14.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f68290e9640 10 monclient: dump: 2024-09-10T16:32:14.671 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.671 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.671 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.671 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.672 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.672 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.672 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.672 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.672 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.672 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.672 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.672 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.672 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.672 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.672 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.672 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient: shutdown 2024-09-10T16:32:14.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:14.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 1 -- 172.21.15.81:0/2863318604 >> v1:172.21.15.81:6793/0 conn(0x7f682409b4c0 legacy=0x7f682409b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 1 -- 172.21.15.81:0/2863318604 shutdown_connections 2024-09-10T16:32:14.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 1 -- 172.21.15.81:0/2863318604 >> 172.21.15.81:0/2863318604 conn(0x7f68240a85d0 msgr2=0x7f68240a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:14.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 1 -- 172.21.15.81:0/2863318604 shutdown_connections 2024-09-10T16:32:14.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 1 -- 172.21.15.81:0/2863318604 wait complete. 2024-09-10T16:32:14.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient: build_initial_monmap 2024-09-10T16:32:14.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.654+0000 7f682c34f640 10 monclient: monmap: 2024-09-10T16:32:14.673 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:14.673 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:14.673 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:14.673 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:14.674 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:14.674 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:14.674 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:14.674 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:14.674 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:14.674 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:14.674 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:14.674 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:14.674 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:14.674 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:14.674 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:14.674 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 1 Processor -- start 2024-09-10T16:32:14.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 1 -- start start 2024-09-10T16:32:14.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 10 monclient: init 2024-09-10T16:32:14.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:14.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 10 monclient: _add_conns ranks=[7,5,3,8,1,4,2,0,6] 2024-09-10T16:32:14.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 10 monclient(hunting): picked mon.noname-i con 0x7f682409b4c0 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:14.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 10 monclient(hunting): picked mon.noname-h con 0x7f68240a2620 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:14.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 10 monclient(hunting): picked mon.noname-g con 0x7f682413c320 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:14.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6824072f40 con 0x7f682413c320 2024-09-10T16:32:14.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6824074620 con 0x7f68240a2620 2024-09-10T16:32:14.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6824074cf0 con 0x7f682409b4c0 2024-09-10T16:32:14.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:14.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 10 monclient(hunting): authenticate will time out at 1102.060562s 2024-09-10T16:32:14.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682a0eb640 1 --1- >> v1:172.21.15.189:6792/0 conn(0x7f682409b4c0 0x7f6824072120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6792/0 says I am v1:172.21.15.81:48366/0 (socket says 172.21.15.81:48366) 2024-09-10T16:32:14.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682a0eb640 1 -- 172.21.15.81:0/2170664047 learned_addr learned my addr 172.21.15.81:0/2170664047 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:14.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3122117624 0 0) 0x7f6824074cf0 con 0x7f682409b4c0 2024-09-10T16:32:14.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): my global_id is 5128 2024-09-10T16:32:14.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6810003530 con 0x7f682409b4c0 2024-09-10T16:32:14.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 203822466 0 0) 0x7f6824074620 con 0x7f68240a2620 2024-09-10T16:32:14.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): my global_id is 5027 2024-09-10T16:32:14.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6824074cf0 con 0x7f68240a2620 2024-09-10T16:32:14.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3278225475 0 0) 0x7f6824072f40 con 0x7f682413c320 2024-09-10T16:32:14.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): my global_id is 134202 2024-09-10T16:32:14.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6824074620 con 0x7f682413c320 2024-09-10T16:32:14.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1778778414 0 0) 0x7f6810003530 con 0x7f682409b4c0 2024-09-10T16:32:14.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6824072f40 con 0x7f682409b4c0 2024-09-10T16:32:14.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3429217020 0 0) 0x7f6824074cf0 con 0x7f68240a2620 2024-09-10T16:32:14.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6810003530 con 0x7f68240a2620 2024-09-10T16:32:14.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6814004b70 con 0x7f682409b4c0 2024-09-10T16:32:14.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:14.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): got monmap 1 from mon.noname-i (according to old e1) 2024-09-10T16:32:14.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): dump: 2024-09-10T16:32:14.678 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.678 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.678 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.678 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.678 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.678 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.678 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.678 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.678 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.678 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.679 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.679 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.679 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.679 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.679 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.679 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:14.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f68180013f0 con 0x7f68240a2620 2024-09-10T16:32:14.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:14.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-10T16:32:14.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): dump: 2024-09-10T16:32:14.679 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.679 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.680 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.681 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1050996398 0 0) 0x7f6824074620 con 0x7f682413c320 2024-09-10T16:32:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6824074cf0 con 0x7f682413c320 2024-09-10T16:32:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f681c001900 con 0x7f682413c320 2024-09-10T16:32:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-10T16:32:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): dump: 2024-09-10T16:32:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.681 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.682 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.682 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.682 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.682 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.682 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.682 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.682 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.682 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.682 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.682 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3926373890 0 0) 0x7f6824072f40 con 0x7f682409b4c0 2024-09-10T16:32:14.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 >> v1:172.21.15.189:6791/0 conn(0x7f68240a2620 legacy=0x7f6824072830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 >> v1:172.21.15.189:6790/0 conn(0x7f682413c320 legacy=0x7f68241d5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:32:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 monclient: found mon.i 2024-09-10T16:32:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:32:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.189:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6824074fd0 con 0x7f682409b4c0 2024-09-10T16:32:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient: _finish_auth 0 2024-09-10T16:32:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:32:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 5 monclient: authenticate success, global_id 5128 2024-09-10T16:32:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 10 monclient: _renew_subs 2024-09-10T16:32:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:32:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.189:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f6824073270 con 0x7f682409b4c0 2024-09-10T16:32:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 10 monclient: _renew_subs 2024-09-10T16:32:14.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 10 monclient: _send_mon_message to mon.i at v1:172.21.15.189:6792/0 2024-09-10T16:32:14.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.189:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f68241361e0 con 0x7f682409b4c0 2024-09-10T16:32:14.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.7 v1:172.21.15.189:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f68140014c0 con 0x7f682409b4c0 2024-09-10T16:32:14.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:14.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.7 v1:172.21.15.189:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6814001c40 con 0x7f682409b4c0 2024-09-10T16:32:14.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:32:14.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f68288e8640 4 set_mon_vals no callback set 2024-09-10T16:32:14.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient: dump: 2024-09-10T16:32:14.684 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.684 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.684 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.684 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.684 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.685 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.685 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.685 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.685 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.685 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.685 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.685 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.688 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f682c34f640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f68040065d0 con 0x7f6804002870 2024-09-10T16:32:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 940397990 0 0) 0x7f68040065d0 con 0x7f6804002870 2024-09-10T16:32:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient(hunting): my global_id is 5154 2024-09-10T16:32:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6824072f40 con 0x7f6804002870 2024-09-10T16:32:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3505012792 0 0) 0x7f6824072f40 con 0x7f6804002870 2024-09-10T16:32:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68040065d0 con 0x7f6804002870 2024-09-10T16:32:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6818003940 con 0x7f6804002870 2024-09-10T16:32:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:32:14.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 10 monclient: dump: 2024-09-10T16:32:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.690 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.691 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 858151498 0 0) 0x7f68040065d0 con 0x7f6804002870 2024-09-10T16:32:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.658+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.81:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f680400a170 con 0x7f6804002870 2024-09-10T16:32:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.662+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.7 v1:172.21.15.189:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f68140112e0 con 0x7f682409b4c0 2024-09-10T16:32:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.662+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.7 v1:172.21.15.189:6792/0 8 ==== osd_map(120..120 src has 1..120) ==== 3898+0+0 (unknown 3499360988 0 0) 0x7f681404b1a0 con 0x7f682409b4c0 2024-09-10T16:32:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.662+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6818006480 con 0x7f6804002870 2024-09-10T16:32:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.662+0000 7f6822ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.662+0000 7f6822ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.662+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 >> v1:172.21.15.81:6792/0 conn(0x7f6804002870 legacy=0x7f6804004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.662+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 >> v1:172.21.15.81:6792/0 conn(0x7f6804002870 legacy=0x7f6804004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:14.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.662+0000 7f682a8ec640 10 monclient: get_auth_request con 0x7f681003db80 auth_method 0 2024-09-10T16:32:14.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f682c34f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:14.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f682c34f640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6804009eb0 con 0x7f6804009170 2024-09-10T16:32:14.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 688893924 0 0) 0x7f6804009eb0 con 0x7f6804009170 2024-09-10T16:32:14.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 10 monclient(hunting): my global_id is 5163 2024-09-10T16:32:14.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68040065d0 con 0x7f6804009170 2024-09-10T16:32:14.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4093666680 0 0) 0x7f68040065d0 con 0x7f6804009170 2024-09-10T16:32:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6804009eb0 con 0x7f6804009170 2024-09-10T16:32:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6818004700 con 0x7f6804009170 2024-09-10T16:32:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:32:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 10 monclient: dump: 2024-09-10T16:32:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.694 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.695 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.695 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.695 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.695 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.695 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.695 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.695 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 807332282 0 0) 0x7f6804009eb0 con 0x7f6804009170 2024-09-10T16:32:14.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 --> v1:172.21.15.81:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f680400c450 con 0x7f6804009170 2024-09-10T16:32:14.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 4216347306) 0x7f6818005c10 con 0x7f6804009170 2024-09-10T16:32:14.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:14.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:14.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 >> v1:172.21.15.81:6792/0 conn(0x7f6804009170 legacy=0x7f6804009600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f6822ffd640 1 -- 172.21.15.81:0/2170664047 >> v1:172.21.15.81:6792/0 conn(0x7f6804009170 legacy=0x7f6804009600 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:14.696 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 144627, 2024-09-10T16:32:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:14.696 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.697 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-09-10T16:32:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.698 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.699 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:14.700 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.701 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.702 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.702 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.702 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.702 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.702 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.702 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.702 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.702 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:14.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.703 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:14.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.703 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:14.703 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:14.703 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.703 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.703 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.703 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:14.703 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.703 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.704 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.704 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:14.704 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:14.704 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.704 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.704 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.704 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.704 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:14.704 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:14.704 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.704 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.705 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.705 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:14.705 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.705 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.705 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.705 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:14.705 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:14.705 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.705 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.706 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.706 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:14.706 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:14.706 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.706 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.706 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.706 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.706 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:14.706 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.706 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.706 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.707 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:14.707 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:14.707 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.707 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.707 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.707 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:14.707 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:14.707 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.707 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.708 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:14.708 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.708 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.708 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.708 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:14.708 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:14.708 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.708 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.708 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.709 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:14.709 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:14.709 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.709 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.709 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:14.709 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.709 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:14.710 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:14.710 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.710 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.710 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.710 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:14.710 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:14.710 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.710 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.710 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:14.710 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.711 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.711 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.711 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:14.711 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:14.711 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.711 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.711 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.711 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:14.711 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:14.711 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.712 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.712 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:14.712 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.712 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.712 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:14.712 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:14.712 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.712 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.712 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.713 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:14.713 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:14.713 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.713 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.713 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:14.713 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.713 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.714 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:14.714 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:14.714 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.714 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.714 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.714 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:14.714 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:14.714 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.714 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.715 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:14.715 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.715 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.715 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:14.715 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:14.715 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.715 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.715 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.715 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.715 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:14.716 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:14.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.716 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:14.716 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:14.716 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:14.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.716 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.716 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:32:14.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.717 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:14.717 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:14.717 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:14.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.717 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.717 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:14.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.717 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:14.717 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:14.717 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:32:14.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.717 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.718 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:14.718 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:14.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f682c34f640 1 -- 172.21.15.81:0/2170664047 >> v1:172.21.15.189:6812/1108603242 conn(0x7f681003db80 legacy=0x7f6810040040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f682c34f640 10 monclient: shutdown 2024-09-10T16:32:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f682c34f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f682c34f640 1 -- 172.21.15.81:0/2170664047 >> v1:172.21.15.189:6792/0 conn(0x7f682409b4c0 legacy=0x7f6824072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f682a8ec640 1 -- 172.21.15.81:0/2170664047 reap_dead start 2024-09-10T16:32:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f682a8ec640 1 -- 172.21.15.81:0/2170664047 reap_dead start 2024-09-10T16:32:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f682c34f640 1 -- 172.21.15.81:0/2170664047 shutdown_connections 2024-09-10T16:32:14.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.666+0000 7f682c34f640 1 -- 172.21.15.81:0/2170664047 >> 172.21.15.81:0/2170664047 conn(0x7f68240a85d0 msgr2=0x7f68240a7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:14.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.670+0000 7f682c34f640 1 -- 172.21.15.81:0/2170664047 shutdown_connections 2024-09-10T16:32:14.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.670+0000 7f682c34f640 1 -- 172.21.15.81:0/2170664047 wait complete. 2024-09-10T16:32:14.721 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:14.721 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-10T16:32:14.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-10T16:32:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 10 monclient: get_monmap_and_config 2024-09-10T16:32:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 10 monclient: build_initial_monmap 2024-09-10T16:32:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 10 monclient: monmap: 2024-09-10T16:32:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:14.842302+0000 2024-09-10T16:32:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:14.842302+0000 2024-09-10T16:32:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:14.843 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 1 Processor -- start 2024-09-10T16:32:14.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 1 -- start start 2024-09-10T16:32:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 10 monclient: init 2024-09-10T16:32:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 10 monclient: _add_conns ranks=[8,7,0,6,5,1,2,4,3] 2024-09-10T16:32:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 10 monclient(hunting): picked mon.noname-e con 0x7f589809ca10 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 10 monclient(hunting): picked mon.noname-i con 0x7f58980a56e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 10 monclient(hunting): picked mon.noname-a con 0x7f58980a5b00 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58981362b0 con 0x7f58980a5b00 2024-09-10T16:32:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58980a80b0 con 0x7f58980a56e0 2024-09-10T16:32:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f589809de70 con 0x7f589809ca10 2024-09-10T16:32:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 10 monclient(hunting): authenticate will time out at 1102.242015s 2024-09-10T16:32:14.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589cd4e640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f589809ca10 0x7f5898135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:42528/0 (socket says 172.21.15.81:42528) 2024-09-10T16:32:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589cd4e640 1 -- 172.21.15.81:0/887569068 learned_addr learned my addr 172.21.15.81:0/887569068 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 1 -- 172.21.15.81:0/887569068 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3886912805 0 0) 0x7f589809de70 con 0x7f589809ca10 2024-09-10T16:32:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient(hunting): my global_id is 5183 2024-09-10T16:32:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 1 -- 172.21.15.81:0/887569068 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5878003530 con 0x7f589809ca10 2024-09-10T16:32:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 1 -- 172.21.15.81:0/887569068 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2413487976 0 0) 0x7f58981362b0 con 0x7f58980a5b00 2024-09-10T16:32:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient(hunting): my global_id is 5256 2024-09-10T16:32:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 1 -- 172.21.15.81:0/887569068 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f589809de70 con 0x7f58980a5b00 2024-09-10T16:32:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 1 -- 172.21.15.81:0/887569068 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2863579066 0 0) 0x7f5878003530 con 0x7f589809ca10 2024-09-10T16:32:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 1 -- 172.21.15.81:0/887569068 >> v1:172.21.15.189:6792/0 conn(0x7f58980a56e0 legacy=0x7f589813df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 1 -- 172.21.15.81:0/887569068 >> v1:172.21.15.81:6789/0 conn(0x7f58980a5b00 legacy=0x7f5898141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient: _finish_hunting 0 2024-09-10T16:32:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 1 monclient: found mon.noname-e 2024-09-10T16:32:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:32:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 1 -- 172.21.15.81:0/887569068 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f589809e150 con 0x7f589809ca10 2024-09-10T16:32:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient: _finish_auth 0 2024-09-10T16:32:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient: _check_auth_tickets 2024-09-10T16:32:14.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 1 -- 172.21.15.81:0/887569068 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5890001bc0 con 0x7f589809ca10 2024-09-10T16:32:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 5 monclient: authenticate success, global_id 5183 2024-09-10T16:32:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:32:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient: dump: 2024-09-10T16:32:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.854 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.855 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 1 -- 172.21.15.81:0/887569068 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5890001de0 con 0x7f589809ca10 2024-09-10T16:32:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:14.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 1 -- 172.21.15.81:0/887569068 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5890004f70 con 0x7f589809ca10 2024-09-10T16:32:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 4 set_mon_vals no callback set 2024-09-10T16:32:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f58977fe640 10 monclient: dump: 2024-09-10T16:32:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.856 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 10 monclient: shutdown 2024-09-10T16:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 1 -- 172.21.15.81:0/887569068 >> v1:172.21.15.81:6793/0 conn(0x7f589809ca10 legacy=0x7f5898135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 1 -- 172.21.15.81:0/887569068 shutdown_connections 2024-09-10T16:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 1 -- 172.21.15.81:0/887569068 >> 172.21.15.81:0/887569068 conn(0x7f589806dc90 msgr2=0x7f58980ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:14.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 1 -- 172.21.15.81:0/887569068 shutdown_connections 2024-09-10T16:32:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 1 -- 172.21.15.81:0/887569068 wait complete. 2024-09-10T16:32:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.838+0000 7f589efb2640 10 monclient: build_initial_monmap 2024-09-10T16:32:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 10 monclient: monmap: 2024-09-10T16:32:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:14.858 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:14.859 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 1 Processor -- start 2024-09-10T16:32:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 1 -- start start 2024-09-10T16:32:14.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 10 monclient: init 2024-09-10T16:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 10 monclient: _add_conns ranks=[2,5,4,6,7,0,3,8,1] 2024-09-10T16:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 10 monclient(hunting): picked mon.noname-b con 0x7f589809ca10 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 10 monclient(hunting): picked mon.noname-h con 0x7f58980a56e0 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 10 monclient(hunting): picked mon.noname-c con 0x7f58980a5b00 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58981cadb0 con 0x7f589809ca10 2024-09-10T16:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5898135210 con 0x7f58980a5b00 2024-09-10T16:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f58981321a0 con 0x7f58980a56e0 2024-09-10T16:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 10 monclient(hunting): authenticate will time out at 1102.244963s 2024-09-10T16:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589cd4e640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f589809ca10 0x7f58981c9f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:58560/0 (socket says 172.21.15.81:58560) 2024-09-10T16:32:14.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589cd4e640 1 -- 172.21.15.81:0/1805776132 learned_addr learned my addr 172.21.15.81:0/1805776132 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1646791765 0 0) 0x7f58981cadb0 con 0x7f589809ca10 2024-09-10T16:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): my global_id is 5222 2024-09-10T16:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f587c003560 con 0x7f589809ca10 2024-09-10T16:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2622400735 0 0) 0x7f5898135210 con 0x7f58980a5b00 2024-09-10T16:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): my global_id is 5188 2024-09-10T16:32:14.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58981cadb0 con 0x7f58980a5b00 2024-09-10T16:32:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3871039141 0 0) 0x7f587c003560 con 0x7f589809ca10 2024-09-10T16:32:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5898135210 con 0x7f589809ca10 2024-09-10T16:32:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5890004eb0 con 0x7f589809ca10 2024-09-10T16:32:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:32:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): dump: 2024-09-10T16:32:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.862 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.863 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.863 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.863 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.863 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.863 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.863 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.863 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.863 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.863 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:14.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2580345330 0 0) 0x7f58981cadb0 con 0x7f58980a5b00 2024-09-10T16:32:14.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f587c003560 con 0x7f58980a5b00 2024-09-10T16:32:14.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5888001870 con 0x7f58980a5b00 2024-09-10T16:32:14.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:14.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:14.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): dump: 2024-09-10T16:32:14.864 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.864 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.864 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.864 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.864 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.864 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.864 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.864 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.864 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.864 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.865 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.865 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.865 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.865 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.865 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.865 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2598674161 0 0) 0x7f58981321a0 con 0x7f58980a56e0 2024-09-10T16:32:14.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): my global_id is 5036 2024-09-10T16:32:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58981cadb0 con 0x7f58980a56e0 2024-09-10T16:32:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1845607529 0 0) 0x7f5898135210 con 0x7f589809ca10 2024-09-10T16:32:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 >> v1:172.21.15.189:6791/0 conn(0x7f58980a56e0 legacy=0x7f58981ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 >> v1:172.21.15.81:6791/0 conn(0x7f58980a5b00 legacy=0x7f58981d5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient: _finish_hunting 0 2024-09-10T16:32:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 monclient: found mon.b 2024-09-10T16:32:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5898131ec0 con 0x7f589809ca10 2024-09-10T16:32:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient: _finish_auth 0 2024-09-10T16:32:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient: _check_auth_tickets 2024-09-10T16:32:14.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:14.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 5 monclient: authenticate success, global_id 5222 2024-09-10T16:32:14.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 10 monclient: _renew_subs 2024-09-10T16:32:14.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:14.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5898130b30 con 0x7f589809ca10 2024-09-10T16:32:14.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 10 monclient: _renew_subs 2024-09-10T16:32:14.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:14.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5898132b00 con 0x7f589809ca10 2024-09-10T16:32:14.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5890001ba0 con 0x7f589809ca10 2024-09-10T16:32:14.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:14.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f58900015a0 con 0x7f589809ca10 2024-09-10T16:32:14.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f5896ffd640 4 set_mon_vals no callback set 2024-09-10T16:32:14.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:14.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient: dump: 2024-09-10T16:32:14.868 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.868 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.868 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.868 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.868 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.868 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.868 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.868 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.868 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.868 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.869 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.869 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.869 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.869 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.869 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.869 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:14.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589efb2640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f58700065d0 con 0x7f5870002870 2024-09-10T16:32:14.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2734309101 0 0) 0x7f58700065d0 con 0x7f5870002870 2024-09-10T16:32:14.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient(hunting): my global_id is 5192 2024-09-10T16:32:14.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5898135210 con 0x7f5870002870 2024-09-10T16:32:14.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f58900112e0 con 0x7f589809ca10 2024-09-10T16:32:14.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(120..120 src has 1..120) ==== 3898+0+0 (unknown 3499360988 0 0) 0x7f589004b170 con 0x7f589809ca10 2024-09-10T16:32:14.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 710433101 0 0) 0x7f5898135210 con 0x7f5870002870 2024-09-10T16:32:14.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f58700065d0 con 0x7f5870002870 2024-09-10T16:32:14.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5880001800 con 0x7f5870002870 2024-09-10T16:32:14.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:14.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient: dump: 2024-09-10T16:32:14.870 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.870 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.871 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.871 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.871 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.871 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.871 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.871 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.871 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.871 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.871 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.871 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.871 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.871 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.871 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.871 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1440261697 0 0) 0x7f58700065d0 con 0x7f5870002870 2024-09-10T16:32:14.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f587000a170 con 0x7f5870002870 2024-09-10T16:32:14.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f589d54f640 10 monclient: get_auth_request con 0x7f587c03d770 auth_method 0 2024-09-10T16:32:14.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5880001b70 con 0x7f5870002870 2024-09-10T16:32:14.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:14.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:14.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 >> v1:172.21.15.81:6793/0 conn(0x7f5870002870 legacy=0x7f5870004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.842+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 >> v1:172.21.15.81:6793/0 conn(0x7f5870002870 legacy=0x7f5870004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:14.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f589efb2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:14.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f589efb2640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5870009e80 con 0x7f5870009140 2024-09-10T16:32:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3840136389 0 0) 0x7f5870009e80 con 0x7f5870009140 2024-09-10T16:32:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 10 monclient(hunting): _negotiate 2024-09-10T16:32:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 10 monclient(hunting): my global_id is 5201 2024-09-10T16:32:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f58700065d0 con 0x7f5870009140 2024-09-10T16:32:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 973732753 0 0) 0x7f58700065d0 con 0x7f5870009140 2024-09-10T16:32:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5870009e80 con 0x7f5870009140 2024-09-10T16:32:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5880003b30 con 0x7f5870009140 2024-09-10T16:32:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 10 monclient: dump: 2024-09-10T16:32:14.874 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:14.875 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:14.875 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.875 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:14.875 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:14.875 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:14.875 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:14.875 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:14.875 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:14.875 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:14.875 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:14.875 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:14.875 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:14.876 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:14.876 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:14.876 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:14.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2394264128 0 0) 0x7f5870009e80 con 0x7f5870009140 2024-09-10T16:32:14.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 --> v1:172.21.15.81:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f587000c400 con 0x7f5870009140 2024-09-10T16:32:14.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 3779525367) 0x7f5880005000 con 0x7f5870009140 2024-09-10T16:32:14.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:14.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:14.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 >> v1:172.21.15.81:6793/0 conn(0x7f5870009140 legacy=0x7f58700095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f58957fa640 1 -- 172.21.15.81:0/1805776132 >> v1:172.21.15.81:6793/0 conn(0x7f5870009140 legacy=0x7f58700095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:14.877 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 144811, 2024-09-10T16:32:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:14.877 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-09-10T16:32:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:14.878 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.879 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.880 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:14.881 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:14.882 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.883 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.884 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:14.885 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:14.885 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.885 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.885 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.885 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:14.885 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:14.885 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.885 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.885 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:14.886 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.887 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.887 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.887 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:14.887 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.887 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.887 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:14.887 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:14.887 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.887 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.887 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.888 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:14.888 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:14.888 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.888 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.888 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:14.888 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.888 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.889 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:14.889 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:14.889 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.889 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.889 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.889 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:14.889 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:14.889 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.889 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.890 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:14.890 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.890 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.890 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:14.890 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:14.890 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.890 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.890 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.891 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:14.891 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:14.891 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.891 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.891 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.891 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:14.891 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.891 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.891 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:14.892 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:14.892 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.892 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.892 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.892 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.892 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:14.892 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:14.892 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.892 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.893 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:14.893 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.893 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.893 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:14.893 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:14.893 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.893 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.893 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.893 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:14.894 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:14.894 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.894 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.894 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:14.894 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.894 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.894 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:14.894 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:14.894 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.895 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.895 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.895 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:14.895 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:14.895 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:14.895 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:14.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:14.895 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:14.895 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:14.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.896 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:14.896 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:14.896 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:14.896 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:14.896 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:14.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.896 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.897 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:14.897 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:14.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.897 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:14.897 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:14.897 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:14.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.897 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:14.897 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:14.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:14.897 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:14.897 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:14.897 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:32:14.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:14.898 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:14.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:14.898 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:14.898 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f589efb2640 1 -- 172.21.15.81:0/1805776132 >> v1:172.21.15.189:6812/1108603242 conn(0x7f587c03d770 legacy=0x7f587c03fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f589efb2640 10 monclient: shutdown 2024-09-10T16:32:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f589efb2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f589efb2640 1 -- 172.21.15.81:0/1805776132 >> v1:172.21.15.81:6790/0 conn(0x7f589809ca10 legacy=0x7f58981c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f589d54f640 1 -- 172.21.15.81:0/1805776132 reap_dead start 2024-09-10T16:32:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f589d54f640 1 -- 172.21.15.81:0/1805776132 reap_dead start 2024-09-10T16:32:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f589efb2640 1 -- 172.21.15.81:0/1805776132 shutdown_connections 2024-09-10T16:32:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f589efb2640 1 -- 172.21.15.81:0/1805776132 >> 172.21.15.81:0/1805776132 conn(0x7f589806dc90 msgr2=0x7f58980a82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f589efb2640 1 -- 172.21.15.81:0/1805776132 shutdown_connections 2024-09-10T16:32:14.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:14.850+0000 7f589efb2640 1 -- 172.21.15.81:0/1805776132 wait complete. 2024-09-10T16:32:14.900 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:14.900 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-10T16:32:14.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-10T16:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.014+0000 7fd856115640 10 monclient: get_monmap_and_config 2024-09-10T16:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.014+0000 7fd856115640 10 monclient: build_initial_monmap 2024-09-10T16:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.014+0000 7fd856115640 10 monclient: monmap: 2024-09-10T16:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:15.021962+0000 2024-09-10T16:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:15.021962+0000 2024-09-10T16:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:15.032 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:15.033 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:15.033 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:15.033 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:15.033 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:15.033 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:15.033 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:15.033 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:15.033 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 1 Processor -- start 2024-09-10T16:32:15.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 1 -- start start 2024-09-10T16:32:15.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 10 monclient: init 2024-09-10T16:32:15.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:15.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 10 monclient: _add_conns ranks=[8,1,4,7,6,2,5,0,3] 2024-09-10T16:32:15.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 10 monclient(hunting): picked mon.noname-e con 0x7fd85009ca10 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:15.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 10 monclient(hunting): picked mon.noname-f con 0x7fd8500a56e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:15.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 10 monclient(hunting): picked mon.noname-c con 0x7fd8500a5b00 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:15.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8501362b0 con 0x7fd8500a56e0 2024-09-10T16:32:15.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8500a80b0 con 0x7fd8500a5b00 2024-09-10T16:32:15.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd85009de70 con 0x7fd85009ca10 2024-09-10T16:32:15.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:15.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 10 monclient(hunting): authenticate will time out at 1102.421707s 2024-09-10T16:32:15.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84f7fe640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fd85009ca10 0x7fd850135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:42554/0 (socket says 172.21.15.81:42554) 2024-09-10T16:32:15.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84f7fe640 1 -- 172.21.15.81:0/2828714661 learned_addr learned my addr 172.21.15.81:0/2828714661 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:15.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 1 -- 172.21.15.81:0/2828714661 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 484035761 0 0) 0x7fd8500a80b0 con 0x7fd8500a5b00 2024-09-10T16:32:15.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient(hunting): my global_id is 5197 2024-09-10T16:32:15.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 1 -- 172.21.15.81:0/2828714661 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd838003530 con 0x7fd8500a5b00 2024-09-10T16:32:15.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 1 -- 172.21.15.81:0/2828714661 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1856838528 0 0) 0x7fd85009de70 con 0x7fd85009ca10 2024-09-10T16:32:15.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient(hunting): my global_id is 5210 2024-09-10T16:32:15.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 1 -- 172.21.15.81:0/2828714661 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8500a80b0 con 0x7fd85009ca10 2024-09-10T16:32:15.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 1 -- 172.21.15.81:0/2828714661 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 315384242 0 0) 0x7fd8500a80b0 con 0x7fd85009ca10 2024-09-10T16:32:15.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 1 -- 172.21.15.81:0/2828714661 >> v1:172.21.15.81:6791/0 conn(0x7fd8500a5b00 legacy=0x7fd850141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 1 -- 172.21.15.81:0/2828714661 >> v1:172.21.15.189:6789/0 conn(0x7fd8500a56e0 legacy=0x7fd85013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:32:15.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 1 monclient: found mon.noname-e 2024-09-10T16:32:15.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:15.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:32:15.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 1 -- 172.21.15.81:0/2828714661 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85009e150 con 0x7fd85009ca10 2024-09-10T16:32:15.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient: _finish_auth 0 2024-09-10T16:32:15.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:32:15.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:15.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 1 -- 172.21.15.81:0/2828714661 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd840001820 con 0x7fd85009ca10 2024-09-10T16:32:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 5 monclient: authenticate success, global_id 5210 2024-09-10T16:32:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:32:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient: dump: 2024-09-10T16:32:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 1 -- 172.21.15.81:0/2828714661 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd840001a40 con 0x7fd85009ca10 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 1 -- 172.21.15.81:0/2828714661 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd840004bf0 con 0x7fd85009ca10 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 4 set_mon_vals no callback set 2024-09-10T16:32:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd84e7fc640 10 monclient: dump: 2024-09-10T16:32:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.039 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.040 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.040 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.040 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.040 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 10 monclient: shutdown 2024-09-10T16:32:15.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:15.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 1 -- 172.21.15.81:0/2828714661 >> v1:172.21.15.81:6793/0 conn(0x7fd85009ca10 legacy=0x7fd850135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 1 -- 172.21.15.81:0/2828714661 shutdown_connections 2024-09-10T16:32:15.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 1 -- 172.21.15.81:0/2828714661 >> 172.21.15.81:0/2828714661 conn(0x7fd85006dc90 msgr2=0x7fd8500ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:15.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 1 -- 172.21.15.81:0/2828714661 shutdown_connections 2024-09-10T16:32:15.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 1 -- 172.21.15.81:0/2828714661 wait complete. 2024-09-10T16:32:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 10 monclient: build_initial_monmap 2024-09-10T16:32:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.018+0000 7fd856115640 10 monclient: monmap: 2024-09-10T16:32:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:15.041 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:15.042 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:15.042 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:15.042 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:15.042 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:15.042 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:15.042 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:15.042 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:15.042 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:15.042 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 1 Processor -- start 2024-09-10T16:32:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 1 -- start start 2024-09-10T16:32:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 10 monclient: init 2024-09-10T16:32:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 10 monclient: _add_conns ranks=[0,2,7,8,5,4,1,3,6] 2024-09-10T16:32:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 10 monclient(hunting): picked mon.noname-a con 0x7fd85009ca10 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 10 monclient(hunting): picked mon.noname-b con 0x7fd8500a56e0 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 10 monclient(hunting): picked mon.noname-i con 0x7fd8500a5b00 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8500a0680 con 0x7fd85009ca10 2024-09-10T16:32:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8501352d0 con 0x7fd8500a56e0 2024-09-10T16:32:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd8500aa5d0 con 0x7fd8500a5b00 2024-09-10T16:32:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 10 monclient(hunting): authenticate will time out at 1102.424925s 2024-09-10T16:32:15.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd84effd640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fd8500a56e0 0x7fd8501d27c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:58574/0 (socket says 172.21.15.81:58574) 2024-09-10T16:32:15.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd84effd640 1 -- 172.21.15.81:0/3293127387 learned_addr learned my addr 172.21.15.81:0/3293127387 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:15.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd84f7fe640 1 --1- 172.21.15.81:0/3293127387 >> v1:172.21.15.81:6789/0 conn(0x7fd85009ca10 0x7fd8500a4be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37984/0 (socket says 172.21.15.81:37984) 2024-09-10T16:32:15.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2666916150 0 0) 0x7fd8500a0680 con 0x7fd85009ca10 2024-09-10T16:32:15.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): my global_id is 5265 2024-09-10T16:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd83c003560 con 0x7fd85009ca10 2024-09-10T16:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3559930454 0 0) 0x7fd8501352d0 con 0x7fd8500a56e0 2024-09-10T16:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): my global_id is 5231 2024-09-10T16:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8500a0680 con 0x7fd8500a56e0 2024-09-10T16:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 964903240 0 0) 0x7fd83c003560 con 0x7fd85009ca10 2024-09-10T16:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8501352d0 con 0x7fd85009ca10 2024-09-10T16:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd840004b30 con 0x7fd85009ca10 2024-09-10T16:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:32:15.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): dump: 2024-09-10T16:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.046 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.047 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2214847810 0 0) 0x7fd8500aa5d0 con 0x7fd8500a5b00 2024-09-10T16:32:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): my global_id is 5146 2024-09-10T16:32:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd83c003560 con 0x7fd8500a5b00 2024-09-10T16:32:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2243313884 0 0) 0x7fd8500a0680 con 0x7fd8500a56e0 2024-09-10T16:32:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8500aa5d0 con 0x7fd8500a56e0 2024-09-10T16:32:15.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd844001b20 con 0x7fd8500a56e0 2024-09-10T16:32:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): dump: 2024-09-10T16:32:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.049 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3721753495 0 0) 0x7fd8501352d0 con 0x7fd85009ca10 2024-09-10T16:32:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 >> v1:172.21.15.189:6792/0 conn(0x7fd8500a5b00 legacy=0x7fd8501d5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 >> v1:172.21.15.81:6790/0 conn(0x7fd8500a56e0 legacy=0x7fd8501d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient: _finish_hunting 0 2024-09-10T16:32:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 monclient: found mon.a 2024-09-10T16:32:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8500aa080 con 0x7fd85009ca10 2024-09-10T16:32:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient: _finish_auth 0 2024-09-10T16:32:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient: _check_auth_tickets 2024-09-10T16:32:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 5 monclient: authenticate success, global_id 5265 2024-09-10T16:32:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 10 monclient: _renew_subs 2024-09-10T16:32:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd8500a03a0 con 0x7fd85009ca10 2024-09-10T16:32:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 10 monclient: _renew_subs 2024-09-10T16:32:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd8500a52f0 con 0x7fd85009ca10 2024-09-10T16:32:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd8400010f0 con 0x7fd85009ca10 2024-09-10T16:32:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd840001920 con 0x7fd85009ca10 2024-09-10T16:32:15.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd84dffb640 4 set_mon_vals no callback set 2024-09-10T16:32:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient: dump: 2024-09-10T16:32:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.052 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd856115640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd8300065d0 con 0x7fd830002870 2024-09-10T16:32:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fd840010ee0 con 0x7fd85009ca10 2024-09-10T16:32:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(120..120 src has 1..120) ==== 3898+0+0 (unknown 3499360988 0 0) 0x7fd84004aea0 con 0x7fd85009ca10 2024-09-10T16:32:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd84ffff640 10 monclient: get_auth_request con 0x7fd83c03d790 auth_method 0 2024-09-10T16:32:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1446613821 0 0) 0x7fd8300065d0 con 0x7fd830002870 2024-09-10T16:32:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 10 monclient(hunting): my global_id is 5248 2024-09-10T16:32:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.022+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8501352d0 con 0x7fd830002870 2024-09-10T16:32:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.026+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2591858477 0 0) 0x7fd8501352d0 con 0x7fd830002870 2024-09-10T16:32:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.026+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd8300065d0 con 0x7fd830002870 2024-09-10T16:32:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.026+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd844003f40 con 0x7fd830002870 2024-09-10T16:32:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.026+0000 7fd837fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.026+0000 7fd837fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:32:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.026+0000 7fd837fff640 10 monclient: dump: 2024-09-10T16:32:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.054 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.026+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2355705571 0 0) 0x7fd8300065d0 con 0x7fd830002870 2024-09-10T16:32:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.026+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.189:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd83000a170 con 0x7fd830002870 2024-09-10T16:32:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.026+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd8440041b0 con 0x7fd830002870 2024-09-10T16:32:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.026+0000 7fd837fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.026+0000 7fd837fff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.026+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 >> v1:172.21.15.189:6789/0 conn(0x7fd830002870 legacy=0x7fd830004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.026+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 >> v1:172.21.15.189:6789/0 conn(0x7fd830002870 legacy=0x7fd830004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.030+0000 7fd856115640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.030+0000 7fd856115640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd830009e60 con 0x7fd830009120 2024-09-10T16:32:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3762555636 0 0) 0x7fd830009e60 con 0x7fd830009120 2024-09-10T16:32:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 10 monclient(hunting): my global_id is 5257 2024-09-10T16:32:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8300065d0 con 0x7fd830009120 2024-09-10T16:32:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1207816366 0 0) 0x7fd8300065d0 con 0x7fd830009120 2024-09-10T16:32:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd830009e60 con 0x7fd830009120 2024-09-10T16:32:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd844005b10 con 0x7fd830009120 2024-09-10T16:32:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:32:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 10 monclient: dump: 2024-09-10T16:32:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.058 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.059 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2458870321 0 0) 0x7fd830009e60 con 0x7fd830009120 2024-09-10T16:32:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 --> v1:172.21.15.189:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd83000c400 con 0x7fd830009120 2024-09-10T16:32:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 4073075970) 0x7fd844006f80 con 0x7fd830009120 2024-09-10T16:32:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 >> v1:172.21.15.189:6789/0 conn(0x7fd830009120 legacy=0x7fd8300095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd837fff640 1 -- 172.21.15.81:0/3293127387 >> v1:172.21.15.189:6789/0 conn(0x7fd830009120 legacy=0x7fd8300095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:15.059 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:15.059 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:15.060 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:15.060 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:15.060 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:15.060 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 144955, 2024-09-10T16:32:15.060 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:15.060 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:15.060 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:15.060 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:15.060 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:15.060 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:15.060 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:15.060 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:15.061 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:15.061 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:15.061 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.061 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-09-10T16:32:15.061 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:15.061 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:15.061 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:15.061 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:15.061 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:15.061 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:15.062 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:15.062 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:15.062 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:15.062 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:15.062 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:15.062 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:15.062 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:15.062 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:15.062 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.062 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:15.062 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:15.062 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:15.062 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:15.062 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:15.063 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:15.063 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:15.063 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:15.063 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:15.063 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:15.063 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:15.063 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:15.063 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:15.063 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.063 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:15.063 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:15.063 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:15.064 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:15.064 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:15.064 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:15.064 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:15.064 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:15.064 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:15.064 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:15.064 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:15.064 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:15.064 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:15.064 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:15.064 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:15.064 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:15.064 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:15.065 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:15.065 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:15.065 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:15.065 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:15.065 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:15.065 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:15.065 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:15.065 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:15.065 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:15.065 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:15.065 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:15.065 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.065 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:15.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.066 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:15.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.066 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:15.066 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:15.066 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.066 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.066 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:15.066 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.067 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:15.067 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:15.067 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.067 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.067 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.067 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:15.067 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:15.067 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.067 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.068 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:15.068 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.068 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.068 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:15.068 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:15.068 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.068 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.068 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.068 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:15.068 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:15.069 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.069 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.069 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:15.069 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.069 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.069 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:15.069 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:15.069 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.069 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.069 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.070 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:15.070 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:15.070 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.070 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.070 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:15.070 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.070 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.070 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:15.071 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:15.071 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.071 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.071 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.071 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:15.071 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:15.071 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.071 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.071 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:15.071 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.072 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.072 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:15.072 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:15.072 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.072 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.072 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.072 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:15.072 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:15.072 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.073 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.073 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:15.073 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.073 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.073 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:15.073 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:15.073 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.073 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.073 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:15.074 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.075 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.075 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.075 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:15.075 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:15.075 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.075 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.075 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:15.075 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.075 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.076 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:15.076 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:15.076 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.076 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.076 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.076 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:15.076 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:15.076 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.076 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.077 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:15.078 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:15.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.078 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:15.078 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:15.078 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:15.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.078 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.078 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:15.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.078 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:15.078 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:15.078 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:32:15.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.078 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.079 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:15.079 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:15.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd856115640 1 -- 172.21.15.81:0/3293127387 >> v1:172.21.15.189:6812/1108603242 conn(0x7fd83c03d790 legacy=0x7fd83c03fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd856115640 10 monclient: shutdown 2024-09-10T16:32:15.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd856115640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:15.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd856115640 1 -- 172.21.15.81:0/3293127387 >> v1:172.21.15.81:6789/0 conn(0x7fd85009ca10 legacy=0x7fd8500a4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd84ffff640 1 -- 172.21.15.81:0/3293127387 reap_dead start 2024-09-10T16:32:15.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd84ffff640 1 -- 172.21.15.81:0/3293127387 reap_dead start 2024-09-10T16:32:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd856115640 1 -- 172.21.15.81:0/3293127387 shutdown_connections 2024-09-10T16:32:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd856115640 1 -- 172.21.15.81:0/3293127387 >> 172.21.15.81:0/3293127387 conn(0x7fd85006dc90 msgr2=0x7fd8500aa7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd856115640 1 -- 172.21.15.81:0/3293127387 shutdown_connections 2024-09-10T16:32:15.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.034+0000 7fd856115640 1 -- 172.21.15.81:0/3293127387 wait complete. 2024-09-10T16:32:15.081 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:15.081 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-10T16:32:15.081 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-10T16:32:15.116 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29747]: starting. 2024-09-10T16:32:15.116 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29747]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29745 2024-09-10T16:32:15.116 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29747]: shutting down. 2024-09-10T16:32:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient: get_monmap_and_config 2024-09-10T16:32:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient: build_initial_monmap 2024-09-10T16:32:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient: monmap: 2024-09-10T16:32:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:15.202152+0000 2024-09-10T16:32:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:15.202152+0000 2024-09-10T16:32:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.202 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:15.203 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:15.203 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 1 Processor -- start 2024-09-10T16:32:15.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 1 -- start start 2024-09-10T16:32:15.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient: init 2024-09-10T16:32:15.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:15.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient: _add_conns ranks=[7,3,6,8,0,2,4,1,5] 2024-09-10T16:32:15.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient(hunting): picked mon.noname-i con 0x7fb100068960 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:15.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient(hunting): picked mon.noname-g con 0x7fb1000a0950 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient(hunting): picked mon.noname-d con 0x7fb10013f5c0 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1000a4200 con 0x7fb1000a0950 2024-09-10T16:32:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1000a3c20 con 0x7fb10013f5c0 2024-09-10T16:32:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1000a0ee0 con 0x7fb100068960 2024-09-10T16:32:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient(hunting): authenticate will time out at 1102.601390s 2024-09-10T16:32:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0ff7fe640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fb10013f5c0 0x7fb1001419b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:43596/0 (socket says 172.21.15.81:43596) 2024-09-10T16:32:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0ff7fe640 1 -- 172.21.15.81:0/2208725227 learned_addr learned my addr 172.21.15.81:0/2208725227 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 1 -- 172.21.15.81:0/2208725227 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3015433428 0 0) 0x7fb1000a3c20 con 0x7fb10013f5c0 2024-09-10T16:32:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient(hunting): my global_id is 5190 2024-09-10T16:32:15.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 1 -- 172.21.15.81:0/2208725227 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0e8003530 con 0x7fb10013f5c0 2024-09-10T16:32:15.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 1 -- 172.21.15.81:0/2208725227 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1873698246 0 0) 0x7fb1000a4200 con 0x7fb1000a0950 2024-09-10T16:32:15.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient(hunting): my global_id is 134238 2024-09-10T16:32:15.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 1 -- 172.21.15.81:0/2208725227 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1000a3c20 con 0x7fb1000a0950 2024-09-10T16:32:15.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 1 -- 172.21.15.81:0/2208725227 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2237118687 0 0) 0x7fb1000a0ee0 con 0x7fb100068960 2024-09-10T16:32:15.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient(hunting): my global_id is 5191 2024-09-10T16:32:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 1 -- 172.21.15.81:0/2208725227 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1000a4200 con 0x7fb100068960 2024-09-10T16:32:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 1 -- 172.21.15.81:0/2208725227 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2676568391 0 0) 0x7fb0e8003530 con 0x7fb10013f5c0 2024-09-10T16:32:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 1 -- 172.21.15.81:0/2208725227 >> v1:172.21.15.189:6792/0 conn(0x7fb100068960 legacy=0x7fb1000a2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 1 -- 172.21.15.81:0/2208725227 >> v1:172.21.15.189:6790/0 conn(0x7fb1000a0950 legacy=0x7fb1000a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient: _finish_hunting 0 2024-09-10T16:32:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 1 monclient: found mon.noname-d 2024-09-10T16:32:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:32:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 1 -- 172.21.15.81:0/2208725227 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1000a4630 con 0x7fb10013f5c0 2024-09-10T16:32:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient: _finish_auth 0 2024-09-10T16:32:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient: _check_auth_tickets 2024-09-10T16:32:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:15.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 1 -- 172.21.15.81:0/2208725227 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb0f8001bc0 con 0x7fb10013f5c0 2024-09-10T16:32:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:32:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient: dump: 2024-09-10T16:32:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.215 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.216 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.216 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.216 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.216 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.216 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 5 monclient: authenticate success, global_id 5190 2024-09-10T16:32:15.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:15.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 1 -- 172.21.15.81:0/2208725227 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0f8001d60 con 0x7fb10013f5c0 2024-09-10T16:32:15.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:15.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 1 -- 172.21.15.81:0/2208725227 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb0f8004f70 con 0x7fb10013f5c0 2024-09-10T16:32:15.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:32:15.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb0fdffb640 10 monclient: dump: 2024-09-10T16:32:15.217 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.217 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.217 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.217 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.217 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.217 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.217 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.217 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.217 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.217 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.217 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.217 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.217 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.218 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.218 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.218 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:15.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 4 set_mon_vals no callback set 2024-09-10T16:32:15.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient: shutdown 2024-09-10T16:32:15.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:15.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 1 -- 172.21.15.81:0/2208725227 >> v1:172.21.15.81:6792/0 conn(0x7fb10013f5c0 legacy=0x7fb1001419b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 1 -- 172.21.15.81:0/2208725227 shutdown_connections 2024-09-10T16:32:15.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 1 -- 172.21.15.81:0/2208725227 >> 172.21.15.81:0/2208725227 conn(0x7fb1000a85d0 msgr2=0x7fb1000a89e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:15.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 1 -- 172.21.15.81:0/2208725227 shutdown_connections 2024-09-10T16:32:15.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 1 -- 172.21.15.81:0/2208725227 wait complete. 2024-09-10T16:32:15.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient: build_initial_monmap 2024-09-10T16:32:15.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.198+0000 7fb105678640 10 monclient: monmap: 2024-09-10T16:32:15.219 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:15.219 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:15.219 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:15.219 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:15.219 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:15.219 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:15.219 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:15.219 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:15.219 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:15.219 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:15.219 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:15.220 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:15.220 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:15.220 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:15.220 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:15.220 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 1 Processor -- start 2024-09-10T16:32:15.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 1 -- start start 2024-09-10T16:32:15.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 10 monclient: init 2024-09-10T16:32:15.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:15.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 10 monclient: _add_conns ranks=[1,4,0,7,6,8,2,3,5] 2024-09-10T16:32:15.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 10 monclient(hunting): picked mon.noname-f con 0x7fb100068960 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:15.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 10 monclient(hunting): picked mon.noname-c con 0x7fb1000a0950 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:15.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 10 monclient(hunting): picked mon.noname-a con 0x7fb10013f5c0 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:15.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb100094e10 con 0x7fb10013f5c0 2024-09-10T16:32:15.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb10009f5b0 con 0x7fb100068960 2024-09-10T16:32:15.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb1000a67d0 con 0x7fb1000a0950 2024-09-10T16:32:15.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:15.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 10 monclient(hunting): authenticate will time out at 1102.604644s 2024-09-10T16:32:15.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0ff7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fb10013f5c0 0x7fb1001d6720 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37992/0 (socket says 172.21.15.81:37992) 2024-09-10T16:32:15.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0fe7fc640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fb1000a0950 0x7fb1001d2ff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:50220/0 (socket says 172.21.15.81:50220) 2024-09-10T16:32:15.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0ff7fe640 1 -- 172.21.15.81:0/2692946583 learned_addr learned my addr 172.21.15.81:0/2692946583 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:15.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2477686177 0 0) 0x7fb1000a4630 con 0x7fb10013f5c0 2024-09-10T16:32:15.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): my global_id is 5283 2024-09-10T16:32:15.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0ec003530 con 0x7fb10013f5c0 2024-09-10T16:32:15.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2084715986 0 0) 0x7fb1000a67d0 con 0x7fb1000a0950 2024-09-10T16:32:15.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): my global_id is 5233 2024-09-10T16:32:15.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1000a4630 con 0x7fb1000a0950 2024-09-10T16:32:15.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2643304007 0 0) 0x7fb10009f5b0 con 0x7fb100068960 2024-09-10T16:32:15.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): my global_id is 5284 2024-09-10T16:32:15.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb1000a67d0 con 0x7fb100068960 2024-09-10T16:32:15.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 712513997 0 0) 0x7fb0ec003530 con 0x7fb10013f5c0 2024-09-10T16:32:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb10009f5b0 con 0x7fb10013f5c0 2024-09-10T16:32:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb0f8001b80 con 0x7fb10013f5c0 2024-09-10T16:32:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:32:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): dump: 2024-09-10T16:32:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.223 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.224 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2740011097 0 0) 0x7fb1000a4630 con 0x7fb1000a0950 2024-09-10T16:32:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0ec003530 con 0x7fb1000a0950 2024-09-10T16:32:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb0f4001b20 con 0x7fb1000a0950 2024-09-10T16:32:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:15.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): dump: 2024-09-10T16:32:15.225 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.225 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.225 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.225 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.225 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.225 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.225 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.225 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.225 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.225 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.225 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.225 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.225 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.226 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.226 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.226 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3997762927 0 0) 0x7fb1000a67d0 con 0x7fb100068960 2024-09-10T16:32:15.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb1000a4630 con 0x7fb100068960 2024-09-10T16:32:15.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1550858504 0 0) 0x7fb10009f5b0 con 0x7fb10013f5c0 2024-09-10T16:32:15.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 >> v1:172.21.15.81:6791/0 conn(0x7fb1000a0950 legacy=0x7fb1001d2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 >> v1:172.21.15.189:6789/0 conn(0x7fb100068960 legacy=0x7fb10013e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient: _finish_hunting 0 2024-09-10T16:32:15.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 monclient: found mon.a 2024-09-10T16:32:15.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:15.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:15.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb100093b80 con 0x7fb10013f5c0 2024-09-10T16:32:15.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient: _finish_auth 0 2024-09-10T16:32:15.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient: _check_auth_tickets 2024-09-10T16:32:15.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:15.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 5 monclient: authenticate success, global_id 5283 2024-09-10T16:32:15.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 10 monclient: _renew_subs 2024-09-10T16:32:15.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:15.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fb100094150 con 0x7fb10013f5c0 2024-09-10T16:32:15.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 10 monclient: _renew_subs 2024-09-10T16:32:15.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:15.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fb100093450 con 0x7fb10013f5c0 2024-09-10T16:32:15.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fb0f8001d20 con 0x7fb10013f5c0 2024-09-10T16:32:15.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:15.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb0f8001500 con 0x7fb10013f5c0 2024-09-10T16:32:15.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0fd7fa640 4 set_mon_vals no callback set 2024-09-10T16:32:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient: dump: 2024-09-10T16:32:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.228 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.229 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.229 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.229 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.229 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:15.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb105678640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb0e00065d0 con 0x7fb0e0002870 2024-09-10T16:32:15.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fb0f80112e0 con 0x7fb10013f5c0 2024-09-10T16:32:15.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(121..121 src has 1..121) ==== 3506+0+0 (unknown 2609669404 0 0) 0x7fb0f804aef0 con 0x7fb10013f5c0 2024-09-10T16:32:15.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3929332024 0 0) 0x7fb0e00065d0 con 0x7fb0e0002870 2024-09-10T16:32:15.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient(hunting): my global_id is 134247 2024-09-10T16:32:15.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb10009f5b0 con 0x7fb0e0002870 2024-09-10T16:32:15.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0fe7fc640 10 monclient: get_auth_request con 0x7fb0ec03d830 auth_method 0 2024-09-10T16:32:15.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 337414708 0 0) 0x7fb10009f5b0 con 0x7fb0e0002870 2024-09-10T16:32:15.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0e00065d0 con 0x7fb0e0002870 2024-09-10T16:32:15.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb0f0003940 con 0x7fb0e0002870 2024-09-10T16:32:15.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:32:15.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 10 monclient: dump: 2024-09-10T16:32:15.230 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.230 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.230 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.230 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.230 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.230 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.230 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.231 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.231 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.231 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.231 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.231 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.231 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.231 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.231 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.231 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 790240418 0 0) 0x7fb0e00065d0 con 0x7fb0e0002870 2024-09-10T16:32:15.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.202+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.189:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb0e000a170 con 0x7fb0e0002870 2024-09-10T16:32:15.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.206+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.3 v1:172.21.15.189:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fb0f0003a70 con 0x7fb0e0002870 2024-09-10T16:32:15.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.206+0000 7fb0e77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:15.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.206+0000 7fb0e77fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:15.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.206+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 >> v1:172.21.15.189:6790/0 conn(0x7fb0e0002870 legacy=0x7fb0e0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.206+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 >> v1:172.21.15.189:6790/0 conn(0x7fb0e0002870 legacy=0x7fb0e0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:15.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb105678640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:15.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb105678640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fb0e0009e80 con 0x7fb0e0009140 2024-09-10T16:32:15.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2366711378 0 0) 0x7fb0e0009e80 con 0x7fb0e0009140 2024-09-10T16:32:15.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb0e77fe640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb0e77fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb0e77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb0e77fe640 10 monclient(hunting): my global_id is 134256 2024-09-10T16:32:15.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0e00065d0 con 0x7fb0e0009140 2024-09-10T16:32:15.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 629396438 0 0) 0x7fb0e00065d0 con 0x7fb0e0009140 2024-09-10T16:32:15.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fb0e0009e80 con 0x7fb0e0009140 2024-09-10T16:32:15.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fb0f00042e0 con 0x7fb0e0009140 2024-09-10T16:32:15.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb0e77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb0e77fe640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:32:15.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb0e77fe640 10 monclient: dump: 2024-09-10T16:32:15.234 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.234 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.234 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.234 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.234 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.234 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.235 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.235 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.235 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.235 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.235 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.235 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.235 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.235 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.235 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.235 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3197195595 0 0) 0x7fb0e0009e80 con 0x7fb0e0009140 2024-09-10T16:32:15.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.210+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 --> v1:172.21.15.189:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fb0e000c400 con 0x7fb0e0009140 2024-09-10T16:32:15.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 <== mon.3 v1:172.21.15.189:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7542 (unknown 0 0 1086523610) 0x7fb0f00065a0 con 0x7fb0e0009140 2024-09-10T16:32:15.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb0e77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:15.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb0e77fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:15.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 >> v1:172.21.15.189:6790/0 conn(0x7fb0e0009140 legacy=0x7fb0e00095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb0e77fe640 1 -- 172.21.15.81:0/2692946583 >> v1:172.21.15.189:6790/0 conn(0x7fb0e0009140 legacy=0x7fb0e00095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:15.236 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:15.236 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:15.236 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:15.236 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:15.236 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:15.236 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 4935, 2024-09-10T16:32:15.236 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:15.237 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:15.237 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:15.237 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:15.237 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:15.237 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:15.237 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:15.237 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:15.237 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:15.237 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:15.237 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.237 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-09-10T16:32:15.237 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:15.237 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.238 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:15.239 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:15.239 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:15.239 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:15.239 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:15.239 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:15.239 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:15.239 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:15.239 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:15.239 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:15.239 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:15.239 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:15.239 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:15.239 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.240 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:15.240 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:15.240 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:15.240 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:15.240 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:15.240 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:15.240 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:15.240 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:15.240 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:15.240 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:15.240 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:15.240 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:15.240 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:15.240 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:15.241 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:15.242 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.242 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:15.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.242 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:15.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.242 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:15.242 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:15.242 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.242 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.242 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:15.242 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.243 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.243 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:15.243 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:15.243 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.243 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.243 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.243 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.243 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.243 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:15.243 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:15.243 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.244 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:15.244 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.244 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.244 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.244 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:15.244 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:15.244 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.244 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.244 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.245 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:15.245 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:15.245 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.245 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:15.245 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.245 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.245 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.245 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:15.246 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.247 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.248 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:15.248 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.248 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.248 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.248 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:15.248 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:15.248 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.248 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.248 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.248 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.249 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:15.249 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:15.249 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.249 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.249 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.249 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:15.249 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.249 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.249 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.249 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.249 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:15.249 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:15.249 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.250 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.250 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.250 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:15.250 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:15.250 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.250 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.250 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.250 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.250 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:15.250 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.250 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.250 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.251 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:15.251 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:15.251 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.251 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.251 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.251 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:15.251 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:15.251 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.251 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.251 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.252 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:15.252 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.252 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.252 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.252 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:15.252 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:15.252 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.252 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.252 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.252 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.252 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:15.252 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:15.253 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.253 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.253 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:15.253 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.253 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.253 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.253 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:15.253 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:15.253 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.253 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.253 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.254 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.254 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.254 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:15.254 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:15.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.254 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:15.254 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:15.254 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:15.254 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.254 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.254 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:15.254 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.254 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:15.255 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:15.255 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:15.255 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.255 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.255 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:15.255 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:15.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb105678640 1 -- 172.21.15.81:0/2692946583 >> v1:172.21.15.189:6812/1108603242 conn(0x7fb0ec03d830 legacy=0x7fb0ec03fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb105678640 10 monclient: shutdown 2024-09-10T16:32:15.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb105678640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:15.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb105678640 1 -- 172.21.15.81:0/2692946583 >> v1:172.21.15.81:6789/0 conn(0x7fb10013f5c0 legacy=0x7fb1001d6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb0ff7fe640 1 -- 172.21.15.81:0/2692946583 reap_dead start 2024-09-10T16:32:15.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb0ff7fe640 1 -- 172.21.15.81:0/2692946583 reap_dead start 2024-09-10T16:32:15.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb105678640 1 -- 172.21.15.81:0/2692946583 shutdown_connections 2024-09-10T16:32:15.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb105678640 1 -- 172.21.15.81:0/2692946583 >> 172.21.15.81:0/2692946583 conn(0x7fb1000a85d0 msgr2=0x7fb1000a6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:15.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb105678640 1 -- 172.21.15.81:0/2692946583 shutdown_connections 2024-09-10T16:32:15.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.214+0000 7fb105678640 1 -- 172.21.15.81:0/2692946583 wait complete. 2024-09-10T16:32:15.257 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:15.257 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-10T16:32:15.257 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-10T16:32:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.362+0000 7f706aa30640 10 monclient: get_monmap_and_config 2024-09-10T16:32:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.362+0000 7f706aa30640 10 monclient: build_initial_monmap 2024-09-10T16:32:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.362+0000 7f706aa30640 10 monclient: monmap: 2024-09-10T16:32:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:15.369 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:15.369288+0000 2024-09-10T16:32:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:15.369288+0000 2024-09-10T16:32:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:15.370 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:15.371 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.362+0000 7f706aa30640 1 Processor -- start 2024-09-10T16:32:15.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.362+0000 7f706aa30640 1 -- start start 2024-09-10T16:32:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.362+0000 7f706aa30640 10 monclient: init 2024-09-10T16:32:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient: _add_conns ranks=[4,2,5,6,8,0,1,7,3] 2024-09-10T16:32:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient(hunting): picked mon.noname-c con 0x7f70640a59f0 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient(hunting): picked mon.noname-b con 0x7f70640a4520 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient(hunting): picked mon.noname-h con 0x7f70640a4950 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7064068dc0 con 0x7f70640a4520 2024-09-10T16:32:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70640a0e10 con 0x7f70640a59f0 2024-09-10T16:32:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f706409fd40 con 0x7f70640a4950 2024-09-10T16:32:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient(hunting): authenticate will time out at 1102.768579s 2024-09-10T16:32:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7063fff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f70640a59f0 0x7f70640a3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:50228/0 (socket says 172.21.15.81:50228) 2024-09-10T16:32:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7063fff640 1 -- 172.21.15.81:0/1471722888 learned_addr learned my addr 172.21.15.81:0/1471722888 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 1 -- 172.21.15.81:0/1471722888 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3226832377 0 0) 0x7f7064068dc0 con 0x7f70640a4520 2024-09-10T16:32:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient(hunting): my global_id is 5258 2024-09-10T16:32:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 1 -- 172.21.15.81:0/1471722888 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7050003530 con 0x7f70640a4520 2024-09-10T16:32:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 1 -- 172.21.15.81:0/1471722888 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1684220649 0 0) 0x7f70640a0e10 con 0x7f70640a59f0 2024-09-10T16:32:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient(hunting): my global_id is 5242 2024-09-10T16:32:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 1 -- 172.21.15.81:0/1471722888 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7064068dc0 con 0x7f70640a59f0 2024-09-10T16:32:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 1 -- 172.21.15.81:0/1471722888 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3146885463 0 0) 0x7f7050003530 con 0x7f70640a4520 2024-09-10T16:32:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 1 -- 172.21.15.81:0/1471722888 >> v1:172.21.15.189:6791/0 conn(0x7f70640a4950 legacy=0x7f7064141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 1 -- 172.21.15.81:0/1471722888 >> v1:172.21.15.81:6791/0 conn(0x7f70640a59f0 legacy=0x7f70640a3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:32:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 1 monclient: found mon.noname-b 2024-09-10T16:32:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:32:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 1 -- 172.21.15.81:0/1471722888 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70640a0ae0 con 0x7f70640a4520 2024-09-10T16:32:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient: _finish_auth 0 2024-09-10T16:32:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:32:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 1 -- 172.21.15.81:0/1471722888 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f704c001860 con 0x7f70640a4520 2024-09-10T16:32:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:32:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient: dump: 2024-09-10T16:32:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.382 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 5 monclient: authenticate success, global_id 5258 2024-09-10T16:32:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 1 -- 172.21.15.81:0/1471722888 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f704c001a00 con 0x7f70640a4520 2024-09-10T16:32:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 4 set_mon_vals no callback set 2024-09-10T16:32:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 1 -- 172.21.15.81:0/1471722888 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f704c003940 con 0x7f70640a4520 2024-09-10T16:32:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7062ffd640 10 monclient: dump: 2024-09-10T16:32:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.383 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient: shutdown 2024-09-10T16:32:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 1 -- 172.21.15.81:0/1471722888 >> v1:172.21.15.81:6790/0 conn(0x7f70640a4520 legacy=0x7f706413e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 1 -- 172.21.15.81:0/1471722888 shutdown_connections 2024-09-10T16:32:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 1 -- 172.21.15.81:0/1471722888 >> 172.21.15.81:0/1471722888 conn(0x7f70640a4f00 msgr2=0x7f70640a52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 1 -- 172.21.15.81:0/1471722888 shutdown_connections 2024-09-10T16:32:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 1 -- 172.21.15.81:0/1471722888 wait complete. 2024-09-10T16:32:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient: build_initial_monmap 2024-09-10T16:32:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient: monmap: 2024-09-10T16:32:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:15.385 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 1 Processor -- start 2024-09-10T16:32:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 1 -- start start 2024-09-10T16:32:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient: init 2024-09-10T16:32:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient: _add_conns ranks=[7,0,3,2,5,6,1,4,8] 2024-09-10T16:32:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient(hunting): picked mon.noname-i con 0x7f70640a4520 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient(hunting): picked mon.noname-a con 0x7f70640a4950 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient(hunting): picked mon.noname-g con 0x7f70640a59f0 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7064095cb0 con 0x7f70640a4950 2024-09-10T16:32:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7064097770 con 0x7f70640a59f0 2024-09-10T16:32:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70641c2020 con 0x7f70640a4520 2024-09-10T16:32:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f706aa30640 10 monclient(hunting): authenticate will time out at 1102.771565s 2024-09-10T16:32:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f70637fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f70640a4950 0x7f70641d28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:38002/0 (socket says 172.21.15.81:38002) 2024-09-10T16:32:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f70637fe640 1 -- 172.21.15.81:0/313909738 learned_addr learned my addr 172.21.15.81:0/313909738 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1918221191 0 0) 0x7f7064095cb0 con 0x7f70640a4950 2024-09-10T16:32:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7060ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7060ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7060ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7060ff9640 10 monclient(hunting): my global_id is 5292 2024-09-10T16:32:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.366+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7044003530 con 0x7f70640a4950 2024-09-10T16:32:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1471014501 0 0) 0x7f7044003530 con 0x7f70640a4950 2024-09-10T16:32:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7064095cb0 con 0x7f70640a4950 2024-09-10T16:32:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f704c003600 con 0x7f70640a4950 2024-09-10T16:32:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:32:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): dump: 2024-09-10T16:32:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.388 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.388 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1842649023 0 0) 0x7f70641c2020 con 0x7f70640a4520 2024-09-10T16:32:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): my global_id is 5200 2024-09-10T16:32:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7044003530 con 0x7f70640a4520 2024-09-10T16:32:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1730863995 0 0) 0x7f7064097770 con 0x7f70640a59f0 2024-09-10T16:32:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): my global_id is 134265 2024-09-10T16:32:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70641c2020 con 0x7f70640a59f0 2024-09-10T16:32:15.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3833124513 0 0) 0x7f7064095cb0 con 0x7f70640a4950 2024-09-10T16:32:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 >> v1:172.21.15.189:6792/0 conn(0x7f70640a4520 legacy=0x7f70641c1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 >> v1:172.21.15.189:6790/0 conn(0x7f70640a59f0 legacy=0x7f70641d5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:32:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 monclient: found mon.a 2024-09-10T16:32:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7064098a40 con 0x7f70640a4950 2024-09-10T16:32:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient: _finish_auth 0 2024-09-10T16:32:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:32:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f706aa30640 5 monclient: authenticate success, global_id 5292 2024-09-10T16:32:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f706aa30640 10 monclient: _renew_subs 2024-09-10T16:32:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f706aa30640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f706aa30640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7064096810 con 0x7f70640a4950 2024-09-10T16:32:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f706aa30640 10 monclient: _renew_subs 2024-09-10T16:32:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f706aa30640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f706aa30640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f7064095530 con 0x7f70640a4950 2024-09-10T16:32:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f704c001220 con 0x7f70640a4950 2024-09-10T16:32:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f704c003e90 con 0x7f70640a4950 2024-09-10T16:32:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f70627fc640 4 set_mon_vals no callback set 2024-09-10T16:32:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient: dump: 2024-09-10T16:32:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.392 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f706aa30640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:15.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f706aa30640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f70480065d0 con 0x7f7048002870 2024-09-10T16:32:15.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f704c004030 con 0x7f70640a4950 2024-09-10T16:32:15.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(121..121 src has 1..121) ==== 3506+0+0 (unknown 2609669404 0 0) 0x7f704c04add0 con 0x7f70640a4950 2024-09-10T16:32:15.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7068fcd640 10 monclient: get_auth_request con 0x7f704403d230 auth_method 0 2024-09-10T16:32:15.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3515883911 0 0) 0x7f70480065d0 con 0x7f7048002870 2024-09-10T16:32:15.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient(hunting): my global_id is 5054 2024-09-10T16:32:15.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7064095cb0 con 0x7f7048002870 2024-09-10T16:32:15.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1687047380 0 0) 0x7f7064095cb0 con 0x7f7048002870 2024-09-10T16:32:15.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f70480065d0 con 0x7f7048002870 2024-09-10T16:32:15.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7054001830 con 0x7f7048002870 2024-09-10T16:32:15.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:32:15.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient: dump: 2024-09-10T16:32:15.394 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.394 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.394 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.394 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.394 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.394 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.394 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.394 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.394 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.394 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.394 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.394 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.395 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3434864010 0 0) 0x7f70480065d0 con 0x7f7048002870 2024-09-10T16:32:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.189:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f704800a170 con 0x7f7048002870 2024-09-10T16:32:15.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f7054001b20 con 0x7f7048002870 2024-09-10T16:32:15.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:15.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:15.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 >> v1:172.21.15.189:6791/0 conn(0x7f7048002870 legacy=0x7f7048004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.370+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 >> v1:172.21.15.189:6791/0 conn(0x7f7048002870 legacy=0x7f7048004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:15.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f706aa30640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:15.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f706aa30640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f7048009e80 con 0x7f7048009140 2024-09-10T16:32:15.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2429614853 0 0) 0x7f7048009e80 con 0x7f7048009140 2024-09-10T16:32:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f7060ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f7060ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f7060ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f7060ff9640 10 monclient(hunting): my global_id is 5063 2024-09-10T16:32:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70480065d0 con 0x7f7048009140 2024-09-10T16:32:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1299707231 0 0) 0x7f70480065d0 con 0x7f7048009140 2024-09-10T16:32:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7048009e80 con 0x7f7048009140 2024-09-10T16:32:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f70540050a0 con 0x7f7048009140 2024-09-10T16:32:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f7060ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f7060ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:32:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f7060ff9640 10 monclient: dump: 2024-09-10T16:32:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.398 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.399 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.399 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.399 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.399 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.399 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.399 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.399 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.399 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.399 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.399 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.399 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.399 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.399 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.399 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1962599353 0 0) 0x7f7048009e80 con 0x7f7048009140 2024-09-10T16:32:15.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.378+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 --> v1:172.21.15.189:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f704800c400 con 0x7f7048009140 2024-09-10T16:32:15.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 2972241491) 0x7f7054007340 con 0x7f7048009140 2024-09-10T16:32:15.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f7060ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:15.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f7060ff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:15.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 >> v1:172.21.15.189:6791/0 conn(0x7f7048009140 legacy=0x7f70480095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f7060ff9640 1 -- 172.21.15.81:0/313909738 >> v1:172.21.15.189:6791/0 conn(0x7f7048009140 legacy=0x7f70480095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:15.400 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:15.401 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:15.401 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:15.401 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:15.401 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:15.401 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 145307, 2024-09-10T16:32:15.401 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:15.401 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:15.401 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:15.402 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:15.402 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:15.402 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:15.402 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:15.402 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:15.402 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:15.402 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:15.402 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.402 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 5, 2024-09-10T16:32:15.402 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:15.402 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:15.402 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:15.402 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:15.402 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:15.403 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:15.403 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:15.403 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:15.403 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:15.403 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:15.403 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:15.403 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:15.403 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:15.403 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:15.403 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.403 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:15.403 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:15.403 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:15.404 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:15.404 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:15.404 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:15.404 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:15.404 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:15.404 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:15.404 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:15.404 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:15.404 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:15.404 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:15.404 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.404 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:15.404 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:15.405 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:15.405 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:15.405 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:15.405 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:15.405 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:15.405 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:15.405 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:15.405 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:15.405 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:15.405 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:15.405 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:15.405 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:15.405 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:15.405 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:15.406 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:15.406 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:15.406 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:15.406 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:15.406 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:15.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:15.406 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:15.406 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:15.406 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:15.406 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:15.406 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:15.406 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:15.406 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.406 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.407 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.408 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:15.408 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:15.408 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.408 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.408 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.408 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:15.408 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:15.408 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.408 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.408 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.409 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:15.409 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.409 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.409 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:15.409 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:15.409 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.409 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.409 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.409 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:15.410 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.411 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:15.412 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:15.412 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.412 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.412 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.412 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:15.412 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:15.412 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:15.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.413 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:15.413 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:15.413 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.413 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.413 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.414 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:15.414 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:15.414 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:15.414 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.414 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:15.414 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:15.415 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.415 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.415 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.415 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:15.415 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:15.415 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:15.415 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.416 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:15.416 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:15.416 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.416 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.416 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.416 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:15.416 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:15.416 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.417 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:15.417 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.417 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.417 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:15.417 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:15.417 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.417 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.417 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.418 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:15.418 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:15.418 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:15.418 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.418 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:15.418 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.419 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.420 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:32:15.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.420 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:15.420 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:15.420 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:15.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.420 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.420 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:15.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.420 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:15.420 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:15.420 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:15.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.421 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:15.421 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:15.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f706aa30640 1 -- 172.21.15.81:0/313909738 >> v1:172.21.15.189:6812/1108603242 conn(0x7f704403d230 legacy=0x7f704403f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f706aa30640 10 monclient: shutdown 2024-09-10T16:32:15.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f706aa30640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:15.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f706aa30640 1 -- 172.21.15.81:0/313909738 >> v1:172.21.15.81:6789/0 conn(0x7f70640a4950 legacy=0x7f70641d28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f7068fcd640 1 -- 172.21.15.81:0/313909738 reap_dead start 2024-09-10T16:32:15.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f7068fcd640 1 -- 172.21.15.81:0/313909738 reap_dead start 2024-09-10T16:32:15.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f706aa30640 1 -- 172.21.15.81:0/313909738 shutdown_connections 2024-09-10T16:32:15.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f706aa30640 1 -- 172.21.15.81:0/313909738 >> 172.21.15.81:0/313909738 conn(0x7f70640a4f00 msgr2=0x7f70640a6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:15.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f706aa30640 1 -- 172.21.15.81:0/313909738 shutdown_connections 2024-09-10T16:32:15.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.382+0000 7f706aa30640 1 -- 172.21.15.81:0/313909738 wait complete. 2024-09-10T16:32:15.423 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:15.423 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-10T16:32:15.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-10T16:32:15.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 10 monclient: get_monmap_and_config 2024-09-10T16:32:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 10 monclient: build_initial_monmap 2024-09-10T16:32:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 10 monclient: monmap: 2024-09-10T16:32:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:15.534705+0000 2024-09-10T16:32:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:15.534705+0000 2024-09-10T16:32:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:15.535 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:15.536 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:15.536 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 1 Processor -- start 2024-09-10T16:32:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 1 -- start start 2024-09-10T16:32:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 10 monclient: init 2024-09-10T16:32:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 10 monclient: _add_conns ranks=[4,3,8,0,6,1,5,7,2] 2024-09-10T16:32:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 10 monclient(hunting): picked mon.noname-c con 0x7f313809d440 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 10 monclient(hunting): picked mon.noname-g con 0x7f31380a39e0 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 10 monclient(hunting): picked mon.noname-e con 0x7f31380a0900 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31380a37a0 con 0x7f31380a39e0 2024-09-10T16:32:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3138074d30 con 0x7f313809d440 2024-09-10T16:32:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f313809d820 con 0x7f31380a0900 2024-09-10T16:32:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 10 monclient(hunting): authenticate will time out at 1102.934067s 2024-09-10T16:32:15.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313cdb9640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f31380a0900 0x7f313813e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:42556/0 (socket says 172.21.15.81:42556) 2024-09-10T16:32:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3137fff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f313809d440 0x7f313809fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:50244/0 (socket says 172.21.15.81:50244) 2024-09-10T16:32:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313cdb9640 1 -- 172.21.15.81:0/3155142945 learned_addr learned my addr 172.21.15.81:0/3155142945 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 1 -- 172.21.15.81:0/3155142945 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2764090 0 0) 0x7f3138074d30 con 0x7f313809d440 2024-09-10T16:32:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient(hunting): my global_id is 5251 2024-09-10T16:32:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 1 -- 172.21.15.81:0/3155142945 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3120003530 con 0x7f313809d440 2024-09-10T16:32:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 1 -- 172.21.15.81:0/3155142945 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 971397908 0 0) 0x7f313809d820 con 0x7f31380a0900 2024-09-10T16:32:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient(hunting): my global_id is 5228 2024-09-10T16:32:15.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 1 -- 172.21.15.81:0/3155142945 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3138074d30 con 0x7f31380a0900 2024-09-10T16:32:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 1 -- 172.21.15.81:0/3155142945 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3643324719 0 0) 0x7f3120003530 con 0x7f313809d440 2024-09-10T16:32:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 1 -- 172.21.15.81:0/3155142945 >> v1:172.21.15.81:6793/0 conn(0x7f31380a0900 legacy=0x7f313813e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 1 -- 172.21.15.81:0/3155142945 >> v1:172.21.15.189:6790/0 conn(0x7f31380a39e0 legacy=0x7f31380a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:32:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 1 monclient: found mon.noname-c 2024-09-10T16:32:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:32:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 1 -- 172.21.15.81:0/3155142945 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f313809e1c0 con 0x7f313809d440 2024-09-10T16:32:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient: _finish_auth 0 2024-09-10T16:32:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:32:15.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 5 monclient: authenticate success, global_id 5251 2024-09-10T16:32:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 1 -- 172.21.15.81:0/3155142945 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3128001840 con 0x7f313809d440 2024-09-10T16:32:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:32:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient: dump: 2024-09-10T16:32:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.545 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.546 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 1 -- 172.21.15.81:0/3155142945 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f31280019e0 con 0x7f313809d440 2024-09-10T16:32:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 4 set_mon_vals no callback set 2024-09-10T16:32:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 1 -- 172.21.15.81:0/3155142945 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3128004b30 con 0x7f313809d440 2024-09-10T16:32:15.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:32:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f3136ffd640 10 monclient: dump: 2024-09-10T16:32:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.547 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.548 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 10 monclient: shutdown 2024-09-10T16:32:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 1 -- 172.21.15.81:0/3155142945 >> v1:172.21.15.81:6791/0 conn(0x7f313809d440 legacy=0x7f313809fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 1 -- 172.21.15.81:0/3155142945 shutdown_connections 2024-09-10T16:32:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 1 -- 172.21.15.81:0/3155142945 >> 172.21.15.81:0/3155142945 conn(0x7f31380a3fd0 msgr2=0x7f31380a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 1 -- 172.21.15.81:0/3155142945 shutdown_connections 2024-09-10T16:32:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.530+0000 7f313e81c640 1 -- 172.21.15.81:0/3155142945 wait complete. 2024-09-10T16:32:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 monclient: build_initial_monmap 2024-09-10T16:32:15.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 monclient: monmap: 2024-09-10T16:32:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:15.549 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:15.550 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 1 Processor -- start 2024-09-10T16:32:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 1 -- start start 2024-09-10T16:32:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 monclient: init 2024-09-10T16:32:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 monclient: _add_conns ranks=[3,1,2,0,5,7,8,4,6] 2024-09-10T16:32:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 monclient(hunting): picked mon.noname-g con 0x7f313809d440 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 monclient(hunting): picked mon.noname-f con 0x7f31380a0900 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 monclient(hunting): picked mon.noname-b con 0x7f31380a39e0 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3138074770 con 0x7f31380a0900 2024-09-10T16:32:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f313809cad0 con 0x7f31380a39e0 2024-09-10T16:32:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f31381b6050 con 0x7f313809d440 2024-09-10T16:32:15.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:15.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 monclient(hunting): authenticate will time out at 1102.937075s 2024-09-10T16:32:15.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313cdb9640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f31380a39e0 0x7f31381d6340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:58594/0 (socket says 172.21.15.81:58594) 2024-09-10T16:32:15.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313cdb9640 1 -- 172.21.15.81:0/2183776900 learned_addr learned my addr 172.21.15.81:0/2183776900 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:15.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181504678 0 0) 0x7f313809cad0 con 0x7f31380a39e0 2024-09-10T16:32:15.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient(hunting): my global_id is 5267 2024-09-10T16:32:15.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3124003530 con 0x7f31380a39e0 2024-09-10T16:32:15.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 249336802 0 0) 0x7f3124003530 con 0x7f31380a39e0 2024-09-10T16:32:15.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f313809cad0 con 0x7f31380a39e0 2024-09-10T16:32:15.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3130001900 con 0x7f31380a39e0 2024-09-10T16:32:15.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:32:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient(hunting): dump: 2024-09-10T16:32:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.552 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.553 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4019391485 0 0) 0x7f313809cad0 con 0x7f31380a39e0 2024-09-10T16:32:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 >> v1:172.21.15.189:6790/0 conn(0x7f313809d440 legacy=0x7f31381cda20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 >> v1:172.21.15.189:6789/0 conn(0x7f31380a0900 legacy=0x7f31381d2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:32:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 monclient: found mon.b 2024-09-10T16:32:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31381b58c0 con 0x7f31380a39e0 2024-09-10T16:32:15.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient: _finish_auth 0 2024-09-10T16:32:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:32:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 5 monclient: authenticate success, global_id 5267 2024-09-10T16:32:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 monclient: _renew_subs 2024-09-10T16:32:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 1 -- 172.21.15.81:0/2183776900 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3138073c10 con 0x7f31380a39e0 2024-09-10T16:32:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 monclient: _renew_subs 2024-09-10T16:32:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:32:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 1 -- 172.21.15.81:0/2183776900 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f31380731f0 con 0x7f31380a39e0 2024-09-10T16:32:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3130004e20 con 0x7f31380a39e0 2024-09-10T16:32:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3130001c60 con 0x7f31380a39e0 2024-09-10T16:32:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f31367fc640 4 set_mon_vals no callback set 2024-09-10T16:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient: dump: 2024-09-10T16:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.555 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.556 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f313e81c640 1 -- 172.21.15.81:0/2183776900 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f31180065d0 con 0x7f3118002870 2024-09-10T16:32:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f3130011080 con 0x7f31380a39e0 2024-09-10T16:32:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(121..121 src has 1..121) ==== 3506+0+0 (unknown 2609669404 0 0) 0x7f313004b080 con 0x7f31380a39e0 2024-09-10T16:32:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3202126648 0 0) 0x7f31180065d0 con 0x7f3118002870 2024-09-10T16:32:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient(hunting): my global_id is 5209 2024-09-10T16:32:15.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f313809cad0 con 0x7f3118002870 2024-09-10T16:32:15.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f31377fe640 10 monclient: get_auth_request con 0x7f312403ced0 auth_method 0 2024-09-10T16:32:15.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1925218140 0 0) 0x7f313809cad0 con 0x7f3118002870 2024-09-10T16:32:15.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f31180065d0 con 0x7f3118002870 2024-09-10T16:32:15.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3128001800 con 0x7f3118002870 2024-09-10T16:32:15.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:32:15.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.534+0000 7f3134ff9640 10 monclient: dump: 2024-09-10T16:32:15.557 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.557 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.557 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.557 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.557 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.557 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.557 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.558 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.558 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.558 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.558 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.558 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.558 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.558 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.558 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.558 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.538+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2143365676 0 0) 0x7f31180065d0 con 0x7f3118002870 2024-09-10T16:32:15.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.538+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 --> v1:172.21.15.189:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f311800a170 con 0x7f3118002870 2024-09-10T16:32:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.538+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.7 v1:172.21.15.189:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3128004ab0 con 0x7f3118002870 2024-09-10T16:32:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.538+0000 7f3134ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.538+0000 7f3134ff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.538+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 >> v1:172.21.15.189:6792/0 conn(0x7f3118002870 legacy=0x7f3118004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.538+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 >> v1:172.21.15.189:6792/0 conn(0x7f3118002870 legacy=0x7f3118004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.542+0000 7f313e81c640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.542+0000 7f313e81c640 1 -- 172.21.15.81:0/2183776900 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3118009e60 con 0x7f3118009120 2024-09-10T16:32:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.542+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1650182804 0 0) 0x7f3118009e60 con 0x7f3118009120 2024-09-10T16:32:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.542+0000 7f3134ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.542+0000 7f3134ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.542+0000 7f3134ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:15.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.542+0000 7f3134ff9640 10 monclient(hunting): my global_id is 5218 2024-09-10T16:32:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.542+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f31180065d0 con 0x7f3118009120 2024-09-10T16:32:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2365410019 0 0) 0x7f31180065d0 con 0x7f3118009120 2024-09-10T16:32:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3118009e60 con 0x7f3118009120 2024-09-10T16:32:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3128001cd0 con 0x7f3118009120 2024-09-10T16:32:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f3134ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f3134ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:32:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f3134ff9640 10 monclient: dump: 2024-09-10T16:32:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:15.561 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:15.562 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2215933119 0 0) 0x7f3118009e60 con 0x7f3118009120 2024-09-10T16:32:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 --> v1:172.21.15.189:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f311800c400 con 0x7f3118009120 2024-09-10T16:32:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 <== mon.7 v1:172.21.15.189:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 67431920) 0x7f3128005340 con 0x7f3118009120 2024-09-10T16:32:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f3134ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:15.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f3134ff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 >> v1:172.21.15.189:6792/0 conn(0x7f3118009120 legacy=0x7f31180095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f3134ff9640 1 -- 172.21.15.81:0/2183776900 >> v1:172.21.15.189:6792/0 conn(0x7f3118009120 legacy=0x7f31180095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:15.563 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:15.563 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:15.563 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:15.563 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:15.563 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 14, 2024-09-10T16:32:15.563 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 145479, 2024-09-10T16:32:15.563 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:15.563 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:15.564 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:15.564 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:32:15.564 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:15.564 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:32:15.564 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:15.564 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:32:15.564 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:32:15.564 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:15.564 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.564 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 5, 2024-09-10T16:32:15.564 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:15.564 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:15.564 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:15.565 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:15.565 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:15.565 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:15.565 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:15.565 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:15.565 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:15.565 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:15.565 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:15.565 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:15.565 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:15.565 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:15.565 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.565 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:15.565 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:15.566 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:15.566 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:15.566 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:15.566 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:15.566 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:15.566 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:15.566 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:15.566 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:15.566 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:15.566 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:15.566 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:15.566 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.566 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:15.567 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:15.567 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:15.567 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:15.567 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:15.567 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:15.567 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:15.567 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:15.567 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:15.567 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:15.567 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:15.567 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:15.567 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:15.567 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:15.568 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:15.568 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:15.568 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:15.568 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:15.568 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:15.568 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:15.568 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:15.568 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:15.568 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:15.568 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:15.568 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:15.568 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:15.568 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:15.568 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:15.569 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.569 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:15.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.569 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:15.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.569 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:15.569 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:15.569 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.569 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.569 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.569 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:15.569 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:15.570 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.571 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.571 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.571 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:15.571 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.571 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.571 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.571 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:15.571 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:15.571 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.571 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.571 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.572 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:15.572 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:15.572 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.572 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.572 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.572 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:15.572 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.572 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.572 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.572 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:15.572 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:15.573 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.573 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.573 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.573 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:15.573 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:15.573 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.573 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.573 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.573 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:15.573 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.573 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.574 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.574 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:15.574 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:15.574 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.574 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.574 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.574 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.574 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:15.574 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:15.574 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.574 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.575 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:15.575 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.575 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.575 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.575 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:15.575 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:15.575 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.575 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.575 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.575 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.576 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:15.576 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:15.576 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.576 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:15.576 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.576 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.576 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.576 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:15.576 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:15.576 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.577 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.577 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.577 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:15.577 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:15.577 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.577 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.577 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.577 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:15.577 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.577 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.577 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.578 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:15.578 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:15.578 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.578 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.578 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.578 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:15.578 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:15.578 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.578 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.578 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:15.579 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:15.580 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:15.580 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:15.580 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:15.580 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:15.580 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:15.580 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.580 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.580 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:15.580 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:15.580 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:15.580 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:15.581 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:15.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.581 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.581 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.581 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:15.581 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:15.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.581 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:15.581 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:15.581 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:15.581 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.581 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.581 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:32:15.581 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.582 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:15.582 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:15.582 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:32:15.582 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.582 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:15.582 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:15.582 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:15.582 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:15.582 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:15.582 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:32:15.582 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:15.582 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:15.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:15.582 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:15.583 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f313e81c640 1 -- 172.21.15.81:0/2183776900 >> v1:172.21.15.189:6812/1108603242 conn(0x7f312403ced0 legacy=0x7f312403f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f313e81c640 10 monclient: shutdown 2024-09-10T16:32:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f313e81c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f313e81c640 1 -- 172.21.15.81:0/2183776900 >> v1:172.21.15.81:6790/0 conn(0x7f31380a39e0 legacy=0x7f31381d6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f313cdb9640 1 -- 172.21.15.81:0/2183776900 reap_dead start 2024-09-10T16:32:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f313cdb9640 1 -- 172.21.15.81:0/2183776900 reap_dead start 2024-09-10T16:32:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f313e81c640 1 -- 172.21.15.81:0/2183776900 shutdown_connections 2024-09-10T16:32:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f313e81c640 1 -- 172.21.15.81:0/2183776900 >> 172.21.15.81:0/2183776900 conn(0x7f31380a3fd0 msgr2=0x7f313809a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f313e81c640 1 -- 172.21.15.81:0/2183776900 shutdown_connections 2024-09-10T16:32:15.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:15.546+0000 7f313e81c640 1 -- 172.21.15.81:0/2183776900 wait complete. 2024-09-10T16:32:15.585 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:32:15.585 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['c', 'd', 'b', 'i'] 2024-09-10T16:32:15.585 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: ['g'] 2024-09-10T16:32:15.585 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.c 2024-09-10T16:32:15.585 INFO:tasks.mon_thrash.mon_thrasher:killing mon.c 2024-09-10T16:32:15.585 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T16:32:15.586 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:32:15.597 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T16:32:15.597 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.d 2024-09-10T16:32:15.597 INFO:tasks.mon_thrash.mon_thrasher:killing mon.d 2024-09-10T16:32:15.597 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-09-10T16:32:15.597 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:32:15.650 INFO:tasks.ceph.mon.d:Stopped 2024-09-10T16:32:15.650 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.b 2024-09-10T16:32:15.650 INFO:tasks.mon_thrash.mon_thrasher:killing mon.b 2024-09-10T16:32:15.650 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T16:32:15.650 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:32:15.709 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T16:32:15.709 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i 2024-09-10T16:32:15.710 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2024-09-10T16:32:15.710 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-09-10T16:32:15.710 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:32:15.728 INFO:tasks.ceph.mon.i:Stopped 2024-09-10T16:32:15.728 INFO:tasks.mon_thrash:Sending STOP to mon g 2024-09-10T16:32:15.728 INFO:tasks.ceph.mon.g:Sent signal 19 2024-09-10T16:32:15.728 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-10T16:32:30.729 INFO:tasks.mon_thrash:Sending CONT to mon g 2024-09-10T16:32:30.730 INFO:tasks.ceph.mon.g:Sent signal 18 2024-09-10T16:32:30.730 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 5 2024-09-10T16:32:30.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T16:32:30.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 10 monclient: get_monmap_and_config 2024-09-10T16:32:30.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 10 monclient: build_initial_monmap 2024-09-10T16:32:30.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 10 monclient: monmap: 2024-09-10T16:32:30.860 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:30.860 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:30.860 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:30.859495+0000 2024-09-10T16:32:30.860 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:30.859495+0000 2024-09-10T16:32:30.860 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:30.860 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:30.860 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:30.860 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:30.860 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:30.860 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:30.861 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:30.861 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:30.861 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:30.861 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:30.861 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:30.861 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:30.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 1 Processor -- start 2024-09-10T16:32:30.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 1 -- start start 2024-09-10T16:32:30.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 10 monclient: init 2024-09-10T16:32:30.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:30.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 10 monclient: _add_conns ranks=[1,6,0,3,5,2,8,7,4] 2024-09-10T16:32:30.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 10 monclient(hunting): picked mon.noname-f con 0x7fa81409e7e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:30.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 10 monclient(hunting): picked mon.noname-d con 0x7fa81409ebc0 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:30.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 10 monclient(hunting): picked mon.noname-a con 0x7fa81409efa0 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:30.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa814068960 con 0x7fa81409efa0 2024-09-10T16:32:30.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa814068e40 con 0x7fa81409e7e0 2024-09-10T16:32:30.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8140a5c50 con 0x7fa81409ebc0 2024-09-10T16:32:30.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:30.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa81b413640 10 monclient(hunting): authenticate will time out at 1118.259013s 2024-09-10T16:32:30.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa8189ae640 1 -- >> v1:172.21.15.81:6792/0 conn(0x7fa81409ebc0 legacy=0x7fa81413bd10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6792/0 2024-09-10T16:32:30.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa8199b0640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa81409efa0 0x7fa81413f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55984/0 (socket says 172.21.15.81:55984) 2024-09-10T16:32:30.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:30.854+0000 7fa8199b0640 1 -- 172.21.15.81:0/3762815107 learned_addr learned my addr 172.21.15.81:0/3762815107 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:31.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:31.058+0000 7fa8189ae640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6792/0 conn(0x7fa81409ebc0 legacy=0x7fa81413bd10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6792/0 2024-09-10T16:32:31.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:31.462+0000 7fa8189ae640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6792/0 conn(0x7fa81409ebc0 legacy=0x7fa81413bd10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6792/0 2024-09-10T16:32:32.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:32.266+0000 7fa8189ae640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6792/0 conn(0x7fa81409ebc0 legacy=0x7fa81413bd10 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6792/0 2024-09-10T16:32:33.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 10 monclient(hunting): tick 2024-09-10T16:32:33.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 10 monclient(hunting): _check_auth_tickets 2024-09-10T16:32:33.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 1 monclient(hunting): continuing hunt 2024-09-10T16:32:33.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 10 monclient(hunting): _reopen_session rank -1 2024-09-10T16:32:33.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6792/0 conn(0x7fa81409ebc0 legacy=0x7fa81413bd10 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:32:33.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.189:6789/0 conn(0x7fa81409e7e0 legacy=0x7fa8140a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:33.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6789/0 conn(0x7fa81409efa0 legacy=0x7fa81413f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:33.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 10 monclient: _add_conns ranks=[5,2,3,8,4,7] 2024-09-10T16:32:33.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 10 monclient(hunting): picked mon.noname-h con 0x7fa8000037d0 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:33.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 10 monclient(hunting): picked mon.noname-b con 0x7fa800007460 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:33.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 10 monclient(hunting): picked mon.noname-g con 0x7fa80000b1f0 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:33.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8140a5e20 con 0x7fa800007460 2024-09-10T16:32:33.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8140a5c50 con 0x7fa80000b1f0 2024-09-10T16:32:33.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa800011020 con 0x7fa8000037d0 2024-09-10T16:32:33.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa812ffd640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:33.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:33.858+0000 7fa8189ae640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6790/0 conn(0x7fa800007460 legacy=0x7fa800009920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6790/0 2024-09-10T16:32:34.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:34.062+0000 7fa8189ae640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6790/0 conn(0x7fa800007460 legacy=0x7fa800009920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6790/0 2024-09-10T16:32:34.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:34.466+0000 7fa8189ae640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6790/0 conn(0x7fa800007460 legacy=0x7fa800009920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6790/0 2024-09-10T16:32:35.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:35.270+0000 7fa8189ae640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6790/0 conn(0x7fa800007460 legacy=0x7fa800009920 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6790/0 2024-09-10T16:32:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 10 monclient(hunting): tick 2024-09-10T16:32:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 10 monclient(hunting): _check_auth_tickets 2024-09-10T16:32:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 1 monclient(hunting): continuing hunt 2024-09-10T16:32:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 10 monclient(hunting): _reopen_session rank -1 2024-09-10T16:32:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.189:6791/0 conn(0x7fa8000037d0 legacy=0x7fa800005c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.189:6790/0 conn(0x7fa80000b1f0 legacy=0x7fa80000d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6790/0 conn(0x7fa800007460 legacy=0x7fa800009920 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:32:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa8199b0640 1 -- 172.21.15.81:0/3762815107 reap_dead start 2024-09-10T16:32:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 10 monclient: _add_conns ranks=[8,4,7] 2024-09-10T16:32:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa8199b0640 1 -- 172.21.15.81:0/3762815107 reap_dead start 2024-09-10T16:32:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 10 monclient(hunting): picked mon.noname-e con 0x7fa8000100b0 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 10 monclient(hunting): picked mon.noname-c con 0x7fa80000de60 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 10 monclient(hunting): picked mon.noname-i con 0x7fa80000e240 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa800012320 con 0x7fa80000de60 2024-09-10T16:32:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8140a5e20 con 0x7fa80000e240 2024-09-10T16:32:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa80000e780 con 0x7fa8000100b0 2024-09-10T16:32:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa812ffd640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa8199b0640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.189:6792/0 conn(0x7fa80000e240 legacy=0x7fa80000d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:32:36.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:36.858+0000 7fa8189ae640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6791/0 conn(0x7fa80000de60 legacy=0x7fa800005c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:37.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:37.062+0000 7fa8189ae640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6791/0 conn(0x7fa80000de60 legacy=0x7fa800005c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:37.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:37.062+0000 7fa8199b0640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.189:6792/0 conn(0x7fa80000e240 legacy=0x7fa80000d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:32:37.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:37.466+0000 7fa8189ae640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6791/0 conn(0x7fa80000de60 legacy=0x7fa800005c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:37.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:37.466+0000 7fa8199b0640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.189:6792/0 conn(0x7fa80000e240 legacy=0x7fa80000d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:32:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:38.270+0000 7fa8189ae640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6791/0 conn(0x7fa80000de60 legacy=0x7fa800005c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:38.270+0000 7fa8199b0640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.189:6792/0 conn(0x7fa80000e240 legacy=0x7fa80000d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:32:39.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 10 monclient(hunting): tick 2024-09-10T16:32:39.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 10 monclient(hunting): _check_auth_tickets 2024-09-10T16:32:39.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 1 monclient(hunting): continuing hunt 2024-09-10T16:32:39.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 10 monclient(hunting): _reopen_session rank -1 2024-09-10T16:32:39.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6793/0 conn(0x7fa8000100b0 legacy=0x7fa8000104f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:39.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.189:6792/0 conn(0x7fa80000e240 legacy=0x7fa80000d6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:32:39.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6791/0 conn(0x7fa80000de60 legacy=0x7fa800005c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:32:39.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 10 monclient: _add_conns ranks=[7,8,4,3,5,0,2,1,6] 2024-09-10T16:32:39.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 10 monclient(hunting): picked mon.noname-i con 0x7fa80000e240 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:39.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 10 monclient(hunting): picked mon.noname-e con 0x7fa8000100b0 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:39.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 10 monclient(hunting): picked mon.noname-c con 0x7fa80000de60 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:39.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa80000e9f0 con 0x7fa80000de60 2024-09-10T16:32:39.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa800012320 con 0x7fa80000e240 2024-09-10T16:32:39.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8140a5e20 con 0x7fa8000100b0 2024-09-10T16:32:39.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa812ffd640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:39.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa8199b0640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6791/0 conn(0x7fa80000de60 legacy=0x7fa800005c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:39.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:39.858+0000 7fa8191af640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.189:6792/0 conn(0x7fa80000e240 legacy=0x7fa80000d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:32:40.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:40.062+0000 7fa8199b0640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6791/0 conn(0x7fa80000de60 legacy=0x7fa800005c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:40.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:40.062+0000 7fa8191af640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.189:6792/0 conn(0x7fa80000e240 legacy=0x7fa80000d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:32:40.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:40.066+0000 7fa8189ae640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6793/0 conn(0x7fa8000100b0 legacy=0x7fa800010490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-09-10T16:32:40.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:40.066+0000 7fa8189ae640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6793/0 conn(0x7fa8000100b0 legacy=0x7fa800010490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T16:32:40.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:40.066+0000 7fa8189ae640 1 --1- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6793/0 conn(0x7fa8000100b0 0x7fa800010490 :-1 s=OPENED pgs=217 cs=1 l=1).handle_message read tag failed 2024-09-10T16:32:40.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:40.066+0000 7fa8189ae640 1 --1- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6793/0 conn(0x7fa8000100b0 0x7fa800010490 :-1 s=OPENED pgs=217 cs=1 l=1).fault on lossy channel, failing 2024-09-10T16:32:40.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:40.066+0000 7fa813fff640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.81:6793/0 2024-09-10T16:32:40.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:40.466+0000 7fa8191af640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.189:6792/0 conn(0x7fa80000e240 legacy=0x7fa80000d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:32:40.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:40.466+0000 7fa8199b0640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6791/0 conn(0x7fa80000de60 legacy=0x7fa800005c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:41.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:41.270+0000 7fa8191af640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.189:6792/0 conn(0x7fa80000e240 legacy=0x7fa80000d6b0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:32:41.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:41.270+0000 7fa8199b0640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6791/0 conn(0x7fa80000de60 legacy=0x7fa800005c20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:41.563 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:41.563 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29780]: starting. 2024-09-10T16:32:41.563 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29780]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29745 2024-09-10T16:32:41.563 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29780]: created object 0... 2024-09-10T16:32:41.563 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29780]: created object 25... 2024-09-10T16:32:41.564 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29780]: created object 49... 2024-09-10T16:32:41.564 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29780]: finishing. 2024-09-10T16:32:41.564 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29780]: shutting down. 2024-09-10T16:32:41.593 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:41.593 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29782]: starting. 2024-09-10T16:32:41.594 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29782]: listing objects. 2024-09-10T16:32:41.594 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29782]: listed object 0... 2024-09-10T16:32:41.594 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29782]: listed object 25... 2024-09-10T16:32:41.594 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29782]: saw 50 objects 2024-09-10T16:32:41.594 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29782]: shutting down. 2024-09-10T16:32:42.401 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:42.401 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29781]: starting. 2024-09-10T16:32:42.401 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29781]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29745 2024-09-10T16:32:42.402 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29781]: shutting down. 2024-09-10T16:32:42.404 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:42.405 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:42.405 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:32:42.407 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:32:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 10 monclient(hunting): tick 2024-09-10T16:32:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 10 monclient(hunting): _check_auth_tickets 2024-09-10T16:32:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 1 monclient(hunting): continuing hunt 2024-09-10T16:32:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 10 monclient(hunting): _reopen_session rank -1 2024-09-10T16:32:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6793/0 conn(0x7fa8000100b0 legacy=0x7fa800010490 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.189:6792/0 conn(0x7fa80000e240 legacy=0x7fa80000d6b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:32:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6791/0 conn(0x7fa80000de60 legacy=0x7fa800005c20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:32:42.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 10 monclient: _add_conns ranks=[0,3,6,2,5,1] 2024-09-10T16:32:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 10 monclient(hunting): picked mon.noname-a con 0x7fa800009a70 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 10 monclient(hunting): picked mon.noname-g con 0x7fa800011900 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 10 monclient(hunting): picked mon.noname-d con 0x7fa800011d10 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa800009880 con 0x7fa800009a70 2024-09-10T16:32:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa80000e9f0 con 0x7fa800011900 2024-09-10T16:32:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa800012320 con 0x7fa800011d10 2024-09-10T16:32:42.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa812ffd640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa8199b0640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6792/0 conn(0x7fa800011d10 legacy=0x7fa80001adb0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6792/0 2024-09-10T16:32:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 1 -- 172.21.15.81:0/3762815107 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2009983927 0 0) 0x7fa800009880 con 0x7fa800009a70 2024-09-10T16:32:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient(hunting): my global_id is 5301 2024-09-10T16:32:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa7fc003530 con 0x7fa800009a70 2024-09-10T16:32:42.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 1 -- 172.21.15.81:0/3762815107 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2751506433 0 0) 0x7fa80000e9f0 con 0x7fa800011900 2024-09-10T16:32:42.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient(hunting): _negotiate 2024-09-10T16:32:42.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:42.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:42.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient(hunting): my global_id is 134301 2024-09-10T16:32:42.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa800009880 con 0x7fa800011900 2024-09-10T16:32:42.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 1 -- 172.21.15.81:0/3762815107 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2644944026 0 0) 0x7fa7fc003530 con 0x7fa800009a70 2024-09-10T16:32:42.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6792/0 conn(0x7fa800011d10 legacy=0x7fa80001adb0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:32:42.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.189:6790/0 conn(0x7fa800011900 legacy=0x7fa800017680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:42.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient: _finish_hunting 0 2024-09-10T16:32:42.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 1 monclient: found mon.noname-a 2024-09-10T16:32:42.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa8199b0640 1 -- 172.21.15.81:0/3762815107 reap_dead start 2024-09-10T16:32:42.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:42.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:32:42.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 1 -- 172.21.15.81:0/3762815107 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa80001f500 con 0x7fa800009a70 2024-09-10T16:32:42.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient: _finish_auth 0 2024-09-10T16:32:42.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient: _check_auth_tickets 2024-09-10T16:32:42.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:42.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 1 -- 172.21.15.81:0/3762815107 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa808001780 con 0x7fa800009a70 2024-09-10T16:32:42.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa81b413640 5 monclient: authenticate success, global_id 5301 2024-09-10T16:32:42.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa81b413640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:32:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient: dump: 2024-09-10T16:32:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:42.880 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:42.881 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa81b413640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:42.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 1 -- 172.21.15.81:0/3762815107 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa808001920 con 0x7fa800009a70 2024-09-10T16:32:42.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:42.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 1 -- 172.21.15.81:0/3762815107 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa808003940 con 0x7fa800009a70 2024-09-10T16:32:42.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:42.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:42.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa813fff640 10 monclient: dump: 2024-09-10T16:32:42.882 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:42.884 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:42.885 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:42.885 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:42.885 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:42.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa81b413640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:42.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa81b413640 4 set_mon_vals no callback set 2024-09-10T16:32:42.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa81b413640 10 monclient: shutdown 2024-09-10T16:32:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa81b413640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa81b413640 1 -- 172.21.15.81:0/3762815107 >> v1:172.21.15.81:6789/0 conn(0x7fa800009a70 legacy=0x7fa8000111f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa81b413640 1 -- 172.21.15.81:0/3762815107 shutdown_connections 2024-09-10T16:32:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa81b413640 1 -- 172.21.15.81:0/3762815107 >> 172.21.15.81:0/3762815107 conn(0x7fa8140a4f00 msgr2=0x7fa8140a52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.861+0000 7fa81b413640 1 -- 172.21.15.81:0/3762815107 shutdown_connections 2024-09-10T16:32:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 1 -- 172.21.15.81:0/3762815107 wait complete. 2024-09-10T16:32:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 10 monclient: build_initial_monmap 2024-09-10T16:32:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 10 monclient: monmap: 2024-09-10T16:32:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:42.888 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:42.888 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:42.888 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:42.888 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:42.888 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:42.890 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 1 Processor -- start 2024-09-10T16:32:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 1 -- start start 2024-09-10T16:32:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 10 monclient: init 2024-09-10T16:32:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 10 monclient: _add_conns ranks=[0,8,1,6,4,7,2,3,5] 2024-09-10T16:32:42.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 10 monclient(hunting): picked mon.noname-a con 0x7fa800009a70 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:42.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 10 monclient(hunting): picked mon.noname-e con 0x7fa8140a0010 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:42.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 10 monclient(hunting): picked mon.noname-f con 0x7fa8140a0410 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:42.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa814132910 con 0x7fa800009a70 2024-09-10T16:32:42.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8140a1620 con 0x7fa8140a0410 2024-09-10T16:32:42.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8140a0f60 con 0x7fa8140a0010 2024-09-10T16:32:42.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:42.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 10 monclient(hunting): authenticate will time out at 1130.266467s 2024-09-10T16:32:42.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa8189ae640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fa8140a0010 0x7fa8141d2ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:33846/0 (socket says 172.21.15.81:33846) 2024-09-10T16:32:42.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa8189ae640 1 -- 172.21.15.81:0/3809341322 learned_addr learned my addr 172.21.15.81:0/3809341322 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:42.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1794263764 0 0) 0x7fa814132910 con 0x7fa800009a70 2024-09-10T16:32:42.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:32:42.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:42.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:42.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): my global_id is 5310 2024-09-10T16:32:42.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa800012320 con 0x7fa800009a70 2024-09-10T16:32:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687854019 0 0) 0x7fa8140a0f60 con 0x7fa8140a0010 2024-09-10T16:32:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:32:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): my global_id is 5246 2024-09-10T16:32:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa814132910 con 0x7fa8140a0010 2024-09-10T16:32:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 220410149 0 0) 0x7fa800012320 con 0x7fa800009a70 2024-09-10T16:32:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8140a0f60 con 0x7fa800009a70 2024-09-10T16:32:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa808003600 con 0x7fa800009a70 2024-09-10T16:32:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:32:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): dump: 2024-09-10T16:32:42.893 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:42.894 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:42.895 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1298742894 0 0) 0x7fa8140a1620 con 0x7fa8140a0410 2024-09-10T16:32:42.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:32:42.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:42.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:42.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): my global_id is 5320 2024-09-10T16:32:42.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa800012320 con 0x7fa8140a0410 2024-09-10T16:32:42.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 529082679 0 0) 0x7fa814132910 con 0x7fa8140a0010 2024-09-10T16:32:42.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa8140a1620 con 0x7fa8140a0010 2024-09-10T16:32:42.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa804004900 con 0x7fa8140a0010 2024-09-10T16:32:42.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:42.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:42.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient(hunting): dump: 2024-09-10T16:32:42.897 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:42.898 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:42.898 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:42.898 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:42.900 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2304547537 0 0) 0x7fa8140a0f60 con 0x7fa800009a70 2024-09-10T16:32:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 >> v1:172.21.15.81:6793/0 conn(0x7fa8140a0010 legacy=0x7fa8141d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 >> v1:172.21.15.189:6789/0 conn(0x7fa8140a0410 legacy=0x7fa8141d62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:32:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 monclient: found mon.a 2024-09-10T16:32:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8141bb4e0 con 0x7fa800009a70 2024-09-10T16:32:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient: _finish_auth 0 2024-09-10T16:32:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:32:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 5 monclient: authenticate success, global_id 5310 2024-09-10T16:32:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 10 monclient: _renew_subs 2024-09-10T16:32:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 1 -- 172.21.15.81:0/3809341322 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa8140a67e0 con 0x7fa800009a70 2024-09-10T16:32:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa808003a90 con 0x7fa800009a70 2024-09-10T16:32:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 10 monclient: _renew_subs 2024-09-10T16:32:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa81b413640 1 -- 172.21.15.81:0/3809341322 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fa814132630 con 0x7fa800009a70 2024-09-10T16:32:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa808003f80 con 0x7fa800009a70 2024-09-10T16:32:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa811ffb640 10 monclient: dump: 2024-09-10T16:32:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:42.903 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:42.903 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:42.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.865+0000 7fa8137fe640 4 set_mon_vals no callback set 2024-09-10T16:32:42.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.869+0000 7fa81b413640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:42.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.869+0000 7fa81b413640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:42.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.869+0000 7fa81b413640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:42.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.869+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fa808004120 con 0x7fa800009a70 2024-09-10T16:32:42.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.869+0000 7fa81b413640 1 -- 172.21.15.81:0/3809341322 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa814132c50 con 0x7fa800009a70 2024-09-10T16:32:42.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.869+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(124..124 src has 1..124) ==== 3506+0+0 (unknown 69385130 0 0) 0x7fa80804ab00 con 0x7fa800009a70 2024-09-10T16:32:42.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.869+0000 7fa8189ae640 10 monclient: get_auth_request con 0x7fa800040aa0 auth_method 0 2024-09-10T16:32:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.873+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7fa808016a80 con 0x7fa800009a70 2024-09-10T16:32:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.873+0000 7fa811ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:42.873+0000 7fa811ffb640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:43.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.109+0000 7fa81b413640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-10T16:32:43.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.109+0000 7fa81b413640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-10T16:32:43.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.109+0000 7fa81b413640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:32:43.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.109+0000 7fa81b413640 1 -- 172.21.15.81:0/3809341322 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fa814132c50 con 0x7fa800009a70 2024-09-10T16:32:43.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.109+0000 7fa811ffb640 1 -- 172.21.15.81:0/3809341322 <== mon.0 v1:172.21.15.81:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2705 (unknown 254746657 0 920823154) 0x7fa808016380 con 0x7fa800009a70 2024-09-10T16:32:43.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.109+0000 7fa811ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-10T16:32:43.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.109+0000 7fa811ffb640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:43.114 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":28,"quorum":[0,1,3,5,8],"quorum_names":["a","f","g","h","e"],"quorum_leader_name":"e","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","modified":"2024-09-10T16:29:22.909160Z","created":"2024-09-10T16:29:22.909160Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6790","nonce":0}]},"addr":"172.21.15.189:6790/0","public_addr":"172.21.15.189:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6791","nonce":0}]},"addr":"172.21.15.81:6791/0","public_addr":"172.21.15.81:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6791","nonce":0}]},"addr":"172.21.15.189:6791/0","public_addr":"172.21.15.189:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6792","nonce":0}]},"addr":"172.21.15.81:6792/0","public_addr":"172.21.15.81:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6792","nonce":0}]},"addr":"172.21.15.189:6792/0","public_addr":"172.21.15.189:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6793","nonce":0}]},"addr":"172.21.15.81:6793/0","public_addr":"172.21.15.81:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T16:32:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.113+0000 7fa81b413640 1 -- 172.21.15.81:0/3809341322 >> v1:172.21.15.189:6812/1108603242 conn(0x7fa800040aa0 legacy=0x7fa800042f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.113+0000 7fa81b413640 10 monclient: shutdown 2024-09-10T16:32:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.113+0000 7fa81b413640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.113+0000 7fa81b413640 1 -- 172.21.15.81:0/3809341322 >> v1:172.21.15.81:6789/0 conn(0x7fa800009a70 legacy=0x7fa81409f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.113+0000 7fa81b413640 1 -- 172.21.15.81:0/3809341322 shutdown_connections 2024-09-10T16:32:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.113+0000 7fa81b413640 1 -- 172.21.15.81:0/3809341322 >> 172.21.15.81:0/3809341322 conn(0x7fa8140a4f00 msgr2=0x7fa81409b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.113+0000 7fa81b413640 1 -- 172.21.15.81:0/3809341322 shutdown_connections 2024-09-10T16:32:43.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.113+0000 7fa81b413640 1 -- 172.21.15.81:0/3809341322 wait complete. 2024-09-10T16:32:43.136 INFO:tasks.mon_thrash.ceph_manager:quorum is size 5 2024-09-10T16:32:43.136 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon a 2024-09-10T16:32:43.136 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T16:32:43.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 10 monclient: get_monmap_and_config 2024-09-10T16:32:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 10 monclient: build_initial_monmap 2024-09-10T16:32:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 10 monclient: monmap: 2024-09-10T16:32:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:43.258400+0000 2024-09-10T16:32:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:43.258400+0000 2024-09-10T16:32:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:43.259 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:43.260 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:43.260 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 1 Processor -- start 2024-09-10T16:32:43.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 1 -- start start 2024-09-10T16:32:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 10 monclient: init 2024-09-10T16:32:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 10 monclient: _add_conns ranks=[5,2,4,8,1,0,6,7,3] 2024-09-10T16:32:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 10 monclient(hunting): picked mon.noname-h con 0x7fcb9809ca10 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 10 monclient(hunting): picked mon.noname-b con 0x7fcb980a56e0 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:43.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 10 monclient(hunting): picked mon.noname-c con 0x7fcb980a5b00 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb981362b0 con 0x7fcb980a56e0 2024-09-10T16:32:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb980a80b0 con 0x7fcb980a5b00 2024-09-10T16:32:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb9809de70 con 0x7fcb9809ca10 2024-09-10T16:32:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 10 monclient(hunting): authenticate will time out at 1130.657836s 2024-09-10T16:32:43.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb96d9d640 1 -- >> v1:172.21.15.81:6791/0 conn(0x7fcb980a5b00 legacy=0x7fcb98141650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb95d9b640 1 -- >> v1:172.21.15.81:6790/0 conn(0x7fcb980a56e0 legacy=0x7fcb9813df20 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6790/0 2024-09-10T16:32:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9659c640 1 --1- >> v1:172.21.15.189:6791/0 conn(0x7fcb9809ca10 0x7fcb98135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6791/0 says I am v1:172.21.15.81:56588/0 (socket says 172.21.15.81:56588) 2024-09-10T16:32:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9659c640 1 -- 172.21.15.81:0/3134851815 learned_addr learned my addr 172.21.15.81:0/3134851815 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 1 -- 172.21.15.81:0/3134851815 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3308202071 0 0) 0x7fcb9809de70 con 0x7fcb9809ca10 2024-09-10T16:32:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient(hunting): my global_id is 5081 2024-09-10T16:32:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 1 -- 172.21.15.81:0/3134851815 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb80003530 con 0x7fcb9809ca10 2024-09-10T16:32:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 1 -- 172.21.15.81:0/3134851815 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3925851572 0 0) 0x7fcb80003530 con 0x7fcb9809ca10 2024-09-10T16:32:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 1 -- 172.21.15.81:0/3134851815 >> v1:172.21.15.81:6791/0 conn(0x7fcb980a5b00 legacy=0x7fcb98141650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:32:43.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 1 -- 172.21.15.81:0/3134851815 >> v1:172.21.15.81:6790/0 conn(0x7fcb980a56e0 legacy=0x7fcb9813df20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:32:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient: _finish_hunting 0 2024-09-10T16:32:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 1 monclient: found mon.noname-h 2024-09-10T16:32:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.189:6791/0 2024-09-10T16:32:43.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 1 -- 172.21.15.81:0/3134851815 --> v1:172.21.15.189:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9809e150 con 0x7fcb9809ca10 2024-09-10T16:32:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient: _finish_auth 0 2024-09-10T16:32:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient: _check_auth_tickets 2024-09-10T16:32:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 1 -- 172.21.15.81:0/3134851815 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcb88001840 con 0x7fcb9809ca10 2024-09-10T16:32:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-10T16:32:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient: dump: 2024-09-10T16:32:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.277 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.278 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.278 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.278 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.278 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.279 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.280 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.280 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 5 monclient: authenticate success, global_id 5081 2024-09-10T16:32:43.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:43.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 1 -- 172.21.15.81:0/3134851815 <== mon.5 v1:172.21.15.189:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcb88001a60 con 0x7fcb9809ca10 2024-09-10T16:32:43.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:43.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:43.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 4 set_mon_vals no callback set 2024-09-10T16:32:43.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 1 -- 172.21.15.81:0/3134851815 <== mon.5 v1:172.21.15.189:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcb88004bf0 con 0x7fcb9809ca10 2024-09-10T16:32:43.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:32:43.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9559a640 10 monclient: dump: 2024-09-10T16:32:43.282 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.282 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.282 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.282 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.282 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.282 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.283 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.283 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.283 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.283 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.283 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.283 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.284 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.284 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.284 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.284 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 10 monclient: shutdown 2024-09-10T16:32:43.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:43.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 1 -- 172.21.15.81:0/3134851815 >> v1:172.21.15.189:6791/0 conn(0x7fcb9809ca10 legacy=0x7fcb98135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 1 -- 172.21.15.81:0/3134851815 shutdown_connections 2024-09-10T16:32:43.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 1 -- 172.21.15.81:0/3134851815 >> 172.21.15.81:0/3134851815 conn(0x7fcb9806dc90 msgr2=0x7fcb980ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:43.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.257+0000 7fcb9caac640 1 -- 172.21.15.81:0/3134851815 shutdown_connections 2024-09-10T16:32:43.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 1 -- 172.21.15.81:0/3134851815 wait complete. 2024-09-10T16:32:43.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 monclient: build_initial_monmap 2024-09-10T16:32:43.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 monclient: monmap: 2024-09-10T16:32:43.286 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:43.286 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:43.286 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:43.286 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:43.286 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:43.287 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:43.287 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:43.287 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:43.287 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:43.287 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:43.288 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:43.288 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:43.288 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:43.288 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:43.288 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:43.289 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 1 Processor -- start 2024-09-10T16:32:43.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 1 -- start start 2024-09-10T16:32:43.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 monclient: init 2024-09-10T16:32:43.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:43.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 monclient: _add_conns ranks=[5,4,6,1,7,0,8,3,2] 2024-09-10T16:32:43.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 monclient(hunting): picked mon.noname-h con 0x7fcb9809ca10 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:43.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 monclient(hunting): picked mon.noname-c con 0x7fcb980a56e0 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:43.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 monclient(hunting): picked mon.noname-d con 0x7fcb980a5b00 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:43.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb980aa3a0 con 0x7fcb980a56e0 2024-09-10T16:32:43.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb980a9ee0 con 0x7fcb9809ca10 2024-09-10T16:32:43.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb9812eca0 con 0x7fcb980a5b00 2024-09-10T16:32:43.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:43.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 monclient(hunting): authenticate will time out at 1130.661471s 2024-09-10T16:32:43.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb95d9b640 1 -- >> v1:172.21.15.81:6791/0 conn(0x7fcb980a56e0 legacy=0x7fcb981d26e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:43.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb96d9d640 1 -- >> v1:172.21.15.81:6792/0 conn(0x7fcb980a5b00 legacy=0x7fcb981d5e10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6792/0 2024-09-10T16:32:43.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9659c640 1 --1- >> v1:172.21.15.189:6791/0 conn(0x7fcb9809ca10 0x7fcb981420a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6791/0 says I am v1:172.21.15.81:56592/0 (socket says 172.21.15.81:56592) 2024-09-10T16:32:43.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9659c640 1 -- 172.21.15.81:0/2471123342 learned_addr learned my addr 172.21.15.81:0/2471123342 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:43.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1690300906 0 0) 0x7fcb9809e150 con 0x7fcb9809ca10 2024-09-10T16:32:43.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient(hunting): my global_id is 5090 2024-09-10T16:32:43.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb78003530 con 0x7fcb9809ca10 2024-09-10T16:32:43.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 569779119 0 0) 0x7fcb78003530 con 0x7fcb9809ca10 2024-09-10T16:32:43.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcb9809e150 con 0x7fcb9809ca10 2024-09-10T16:32:43.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcb88004b30 con 0x7fcb9809ca10 2024-09-10T16:32:43.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:43.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-10T16:32:43.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient(hunting): dump: 2024-09-10T16:32:43.295 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.295 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.295 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.295 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.297 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:43.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3075261191 0 0) 0x7fcb9809e150 con 0x7fcb9809ca10 2024-09-10T16:32:43.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 >> v1:172.21.15.81:6792/0 conn(0x7fcb980a5b00 legacy=0x7fcb981d5e10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:32:43.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 >> v1:172.21.15.81:6791/0 conn(0x7fcb980a56e0 legacy=0x7fcb981d26e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:32:43.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:32:43.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 1 monclient: found mon.h 2024-09-10T16:32:43.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:43.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.189:6791/0 2024-09-10T16:32:43.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 --> v1:172.21.15.189:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb9812ef80 con 0x7fcb9809ca10 2024-09-10T16:32:43.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient: _finish_auth 0 2024-09-10T16:32:43.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:32:43.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:43.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 5 monclient: authenticate success, global_id 5090 2024-09-10T16:32:43.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 monclient: _renew_subs 2024-09-10T16:32:43.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.189:6791/0 2024-09-10T16:32:43.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 1 -- 172.21.15.81:0/2471123342 --> v1:172.21.15.189:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcb98135030 con 0x7fcb9809ca10 2024-09-10T16:32:43.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 monclient: _renew_subs 2024-09-10T16:32:43.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.189:6791/0 2024-09-10T16:32:43.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 1 -- 172.21.15.81:0/2471123342 --> v1:172.21.15.189:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fcb9812cc80 con 0x7fcb9809ca10 2024-09-10T16:32:43.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.5 v1:172.21.15.189:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcb88001a60 con 0x7fcb9809ca10 2024-09-10T16:32:43.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:43.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.5 v1:172.21.15.189:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcb880051f0 con 0x7fcb9809ca10 2024-09-10T16:32:43.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb94d99640 4 set_mon_vals no callback set 2024-09-10T16:32:43.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:32:43.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb86ffd640 10 monclient: dump: 2024-09-10T16:32:43.302 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.302 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.303 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.303 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.303 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.303 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.303 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.303 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.305 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.261+0000 7fcb9caac640 1 -- 172.21.15.81:0/2471123342 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcb7c0065d0 con 0x7fcb7c002870 2024-09-10T16:32:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3213540241 0 0) 0x7fcb7c0065d0 con 0x7fcb7c002870 2024-09-10T16:32:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 10 monclient(hunting): my global_id is 5319 2024-09-10T16:32:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb9809e150 con 0x7fcb7c002870 2024-09-10T16:32:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2240158392 0 0) 0x7fcb9809e150 con 0x7fcb7c002870 2024-09-10T16:32:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcb7c0065d0 con 0x7fcb7c002870 2024-09-10T16:32:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcb8c004100 con 0x7fcb7c002870 2024-09-10T16:32:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 10 monclient: dump: 2024-09-10T16:32:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.310 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.5 v1:172.21.15.189:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fcb88011100 con 0x7fcb9809ca10 2024-09-10T16:32:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1934331187 0 0) 0x7fcb7c0065d0 con 0x7fcb7c002870 2024-09-10T16:32:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 --> v1:172.21.15.81:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcb7c00a170 con 0x7fcb7c002870 2024-09-10T16:32:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.5 v1:172.21.15.189:6791/0 8 ==== osd_map(124..124 src has 1..124) ==== 3506+0+0 (unknown 69385130 0 0) 0x7fcb8804af40 con 0x7fcb9809ca10 2024-09-10T16:32:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb96d9d640 10 monclient: get_auth_request con 0x7fcb7803d4e0 auth_method 0 2024-09-10T16:32:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fcb8c006440 con 0x7fcb7c002870 2024-09-10T16:32:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 >> v1:172.21.15.81:6789/0 conn(0x7fcb7c002870 legacy=0x7fcb7c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.265+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 >> v1:172.21.15.81:6789/0 conn(0x7fcb7c002870 legacy=0x7fcb7c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb9caac640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb9caac640 1 -- 172.21.15.81:0/2471123342 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcb7c009e90 con 0x7fcb7c009150 2024-09-10T16:32:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3453078973 0 0) 0x7fcb7c009e90 con 0x7fcb7c009150 2024-09-10T16:32:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb86ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb86ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb86ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb86ffd640 10 monclient(hunting): my global_id is 5328 2024-09-10T16:32:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcb7c0065d0 con 0x7fcb7c009150 2024-09-10T16:32:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 611017518 0 0) 0x7fcb7c0065d0 con 0x7fcb7c009150 2024-09-10T16:32:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcb7c009e90 con 0x7fcb7c009150 2024-09-10T16:32:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcb8c005ca0 con 0x7fcb7c009150 2024-09-10T16:32:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb86ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb86ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb86ffd640 10 monclient: dump: 2024-09-10T16:32:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.318 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1563254486 0 0) 0x7fcb7c009e90 con 0x7fcb7c009150 2024-09-10T16:32:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.269+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 --> v1:172.21.15.81:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcb7c00c400 con 0x7fcb7c009150 2024-09-10T16:32:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7667 (unknown 0 0 1259720646) 0x7fcb8c005f80 con 0x7fcb7c009150 2024-09-10T16:32:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb86ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb86ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 >> v1:172.21.15.81:6789/0 conn(0x7fcb7c009150 legacy=0x7fcb7c0095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb86ffd640 1 -- 172.21.15.81:0/2471123342 >> v1:172.21.15.81:6789/0 conn(0x7fcb7c009150 legacy=0x7fcb7c0095e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:43.319 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 28, 2024-09-10T16:32:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 173222, 2024-09-10T16:32:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-09-10T16:32:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:32:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:32:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:43.351 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:43.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb9caac640 1 -- 172.21.15.81:0/2471123342 >> v1:172.21.15.189:6812/1108603242 conn(0x7fcb7803d4e0 legacy=0x7fcb7803f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb9caac640 10 monclient: shutdown 2024-09-10T16:32:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb9caac640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb9caac640 1 -- 172.21.15.81:0/2471123342 >> v1:172.21.15.189:6791/0 conn(0x7fcb9809ca10 legacy=0x7fcb981420a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb96d9d640 1 -- 172.21.15.81:0/2471123342 reap_dead start 2024-09-10T16:32:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb96d9d640 1 -- 172.21.15.81:0/2471123342 reap_dead start 2024-09-10T16:32:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb9caac640 1 -- 172.21.15.81:0/2471123342 shutdown_connections 2024-09-10T16:32:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb9caac640 1 -- 172.21.15.81:0/2471123342 >> 172.21.15.81:0/2471123342 conn(0x7fcb9806dc90 msgr2=0x7fcb980a82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb9caac640 1 -- 172.21.15.81:0/2471123342 shutdown_connections 2024-09-10T16:32:43.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.273+0000 7fcb9caac640 1 -- 172.21.15.81:0/2471123342 wait complete. 2024-09-10T16:32:43.353 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-10T16:32:43.354 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon e 2024-09-10T16:32:43.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-10T16:32:43.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.481+0000 7f87b8745640 10 monclient: get_monmap_and_config 2024-09-10T16:32:43.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.481+0000 7f87b8745640 10 monclient: build_initial_monmap 2024-09-10T16:32:43.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.481+0000 7f87b8745640 10 monclient: monmap: 2024-09-10T16:32:43.485 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:43.485 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.485 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:43.484873+0000 2024-09-10T16:32:43.485 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:43.484873+0000 2024-09-10T16:32:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:43.486 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:43.486 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 1 Processor -- start 2024-09-10T16:32:43.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 1 -- start start 2024-09-10T16:32:43.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 10 monclient: init 2024-09-10T16:32:43.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:43.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 10 monclient: _add_conns ranks=[8,0,5,6,1,7,2,3,4] 2024-09-10T16:32:43.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 10 monclient(hunting): picked mon.noname-e con 0x7f87b00a5510 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:43.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 10 monclient(hunting): picked mon.noname-a con 0x7f87b0135bf0 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:43.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 10 monclient(hunting): picked mon.noname-h con 0x7f87b0136060 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:43.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b009d7e0 con 0x7f87b0135bf0 2024-09-10T16:32:43.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b009dac0 con 0x7f87b0136060 2024-09-10T16:32:43.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b009dda0 con 0x7f87b00a5510 2024-09-10T16:32:43.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:43.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 10 monclient(hunting): authenticate will time out at 1130.885190s 2024-09-10T16:32:43.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b5ce0640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f87b0135bf0 0x7f87b013de30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:34794/0 (socket says 172.21.15.81:34794) 2024-09-10T16:32:43.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b64e1640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f87b00a5510 0x7f87b00a58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:33852/0 (socket says 172.21.15.81:33852) 2024-09-10T16:32:43.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b5ce0640 1 -- 172.21.15.81:0/3723151859 learned_addr learned my addr 172.21.15.81:0/3723151859 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:43.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 1 -- 172.21.15.81:0/3723151859 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3794189311 0 0) 0x7f87b009dda0 con 0x7f87b00a5510 2024-09-10T16:32:43.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient(hunting): my global_id is 5255 2024-09-10T16:32:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 1 -- 172.21.15.81:0/3723151859 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f879c003530 con 0x7f87b00a5510 2024-09-10T16:32:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 1 -- 172.21.15.81:0/3723151859 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1961398716 0 0) 0x7f87b009d7e0 con 0x7f87b0135bf0 2024-09-10T16:32:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient(hunting): my global_id is 5337 2024-09-10T16:32:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 1 -- 172.21.15.81:0/3723151859 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87b009dda0 con 0x7f87b0135bf0 2024-09-10T16:32:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 1 -- 172.21.15.81:0/3723151859 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 728447072 0 0) 0x7f87b009dda0 con 0x7f87b0135bf0 2024-09-10T16:32:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 1 -- 172.21.15.81:0/3723151859 >> v1:172.21.15.81:6793/0 conn(0x7f87b00a5510 legacy=0x7f87b00a58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 1 -- 172.21.15.81:0/3723151859 >> v1:172.21.15.189:6791/0 conn(0x7f87b0136060 legacy=0x7f87b0141560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient: _finish_hunting 0 2024-09-10T16:32:43.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 1 monclient: found mon.noname-a 2024-09-10T16:32:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:32:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 1 -- 172.21.15.81:0/3723151859 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b009cca0 con 0x7f87b0135bf0 2024-09-10T16:32:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient: _finish_auth 0 2024-09-10T16:32:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient: _check_auth_tickets 2024-09-10T16:32:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 1 -- 172.21.15.81:0/3723151859 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f87a0001820 con 0x7f87b0135bf0 2024-09-10T16:32:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:32:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient: dump: 2024-09-10T16:32:43.493 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.494 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.495 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 5 monclient: authenticate success, global_id 5337 2024-09-10T16:32:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 1 -- 172.21.15.81:0/3723151859 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f87a00019c0 con 0x7f87b0135bf0 2024-09-10T16:32:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 1 -- 172.21.15.81:0/3723151859 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f87a0004bf0 con 0x7f87b0135bf0 2024-09-10T16:32:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 4 set_mon_vals no callback set 2024-09-10T16:32:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b54df640 10 monclient: dump: 2024-09-10T16:32:43.495 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.496 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.497 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.497 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.497 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 10 monclient: shutdown 2024-09-10T16:32:43.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:43.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 1 -- 172.21.15.81:0/3723151859 >> v1:172.21.15.81:6789/0 conn(0x7f87b0135bf0 legacy=0x7f87b013de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 1 -- 172.21.15.81:0/3723151859 shutdown_connections 2024-09-10T16:32:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 1 -- 172.21.15.81:0/3723151859 >> 172.21.15.81:0/3723151859 conn(0x7f87b006dae0 msgr2=0x7f87b00ab8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 1 -- 172.21.15.81:0/3723151859 shutdown_connections 2024-09-10T16:32:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 1 -- 172.21.15.81:0/3723151859 wait complete. 2024-09-10T16:32:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 10 monclient: build_initial_monmap 2024-09-10T16:32:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 10 monclient: monmap: 2024-09-10T16:32:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:43.498 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:43.499 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 1 Processor -- start 2024-09-10T16:32:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 1 -- start start 2024-09-10T16:32:43.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.485+0000 7f87b8745640 10 monclient: init 2024-09-10T16:32:43.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:43.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 10 monclient: _add_conns ranks=[8,4,2,6,0,3,5,1,7] 2024-09-10T16:32:43.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 10 monclient(hunting): picked mon.noname-e con 0x7f87b00a5510 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:43.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 10 monclient(hunting): picked mon.noname-c con 0x7f87b0135bf0 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:43.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 10 monclient(hunting): picked mon.noname-b con 0x7f87b0136060 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:43.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b00a34f0 con 0x7f87b0136060 2024-09-10T16:32:43.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b01350f0 con 0x7f87b0135bf0 2024-09-10T16:32:43.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b00a8cd0 con 0x7f87b00a5510 2024-09-10T16:32:43.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:43.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 10 monclient(hunting): authenticate will time out at 1130.888414s 2024-09-10T16:32:43.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b5ce0640 1 -- >> v1:172.21.15.81:6791/0 conn(0x7f87b0135bf0 legacy=0x7f87b01d27b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:43.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b6ce2640 1 -- >> v1:172.21.15.81:6790/0 conn(0x7f87b0136060 legacy=0x7f87b01d5ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6790/0 2024-09-10T16:32:43.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b64e1640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f87b00a5510 0x7f87b00a4a20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:33866/0 (socket says 172.21.15.81:33866) 2024-09-10T16:32:43.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b64e1640 1 -- 172.21.15.81:0/4248389737 learned_addr learned my addr 172.21.15.81:0/4248389737 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:43.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001540133 0 0) 0x7f87b00a8cd0 con 0x7f87b00a5510 2024-09-10T16:32:43.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient(hunting): my global_id is 5264 2024-09-10T16:32:43.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8794003530 con 0x7f87b00a5510 2024-09-10T16:32:43.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2846395093 0 0) 0x7f8794003530 con 0x7f87b00a5510 2024-09-10T16:32:43.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f87b00a8cd0 con 0x7f87b00a5510 2024-09-10T16:32:43.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f87ac001ba0 con 0x7f87b00a5510 2024-09-10T16:32:43.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:43.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:32:43.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient(hunting): dump: 2024-09-10T16:32:43.506 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.506 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.507 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.508 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:43.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 983496678 0 0) 0x7f87b00a8cd0 con 0x7f87b00a5510 2024-09-10T16:32:43.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 >> v1:172.21.15.81:6791/0 conn(0x7f87b0135bf0 legacy=0x7f87b01d27b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:32:43.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 >> v1:172.21.15.81:6790/0 conn(0x7f87b0136060 legacy=0x7f87b01d5ee0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:32:43.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:32:43.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 monclient: found mon.e 2024-09-10T16:32:43.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:43.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:32:43.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b0134d50 con 0x7f87b00a5510 2024-09-10T16:32:43.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient: _finish_auth 0 2024-09-10T16:32:43.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:32:43.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:43.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 5 monclient: authenticate success, global_id 5264 2024-09-10T16:32:43.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 10 monclient: _renew_subs 2024-09-10T16:32:43.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:32:43.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 1 -- 172.21.15.81:0/4248389737 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f87b00a1190 con 0x7f87b00a5510 2024-09-10T16:32:43.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 10 monclient: _renew_subs 2024-09-10T16:32:43.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:32:43.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 1 -- 172.21.15.81:0/4248389737 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f87b00a1ef0 con 0x7f87b00a5510 2024-09-10T16:32:43.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f87ac004aa0 con 0x7f87b00a5510 2024-09-10T16:32:43.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:43.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f87ac004f90 con 0x7f87b00a5510 2024-09-10T16:32:43.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b4cde640 4 set_mon_vals no callback set 2024-09-10T16:32:43.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:43.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient: dump: 2024-09-10T16:32:43.511 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.511 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.511 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.511 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.511 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.512 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.512 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.512 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.512 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.512 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.512 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.512 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.513 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.513 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.513 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.513 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:43.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b8745640 1 -- 172.21.15.81:0/4248389737 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f87980065d0 con 0x7f8798002870 2024-09-10T16:32:43.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f87ac010ea0 con 0x7f87b00a5510 2024-09-10T16:32:43.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(125..125 src has 1..125) ==== 3898+0+0 (unknown 2476925705 0 0) 0x7f87ac04afe0 con 0x7f87b00a5510 2024-09-10T16:32:43.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1282568794 0 0) 0x7f87980065d0 con 0x7f8798002870 2024-09-10T16:32:43.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient(hunting): my global_id is 5273 2024-09-10T16:32:43.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87b00a8cd0 con 0x7f8798002870 2024-09-10T16:32:43.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2635534133 0 0) 0x7f87b00a8cd0 con 0x7f8798002870 2024-09-10T16:32:43.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f87980065d0 con 0x7f8798002870 2024-09-10T16:32:43.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f87a0004bf0 con 0x7f8798002870 2024-09-10T16:32:43.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:43.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient: dump: 2024-09-10T16:32:43.515 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.515 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.515 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.515 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.515 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.516 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.516 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.516 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.516 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.516 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.516 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.516 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.516 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.517 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.517 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.517 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87b6ce2640 10 monclient: get_auth_request con 0x7f879403ce30 auth_method 0 2024-09-10T16:32:43.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1555102533 0 0) 0x7f87980065d0 con 0x7f8798002870 2024-09-10T16:32:43.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 --> v1:172.21.15.81:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f879800a170 con 0x7f8798002870 2024-09-10T16:32:43.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f87a00014e0 con 0x7f8798002870 2024-09-10T16:32:43.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 >> v1:172.21.15.81:6793/0 conn(0x7f8798002870 legacy=0x7f8798004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.489+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 >> v1:172.21.15.81:6793/0 conn(0x7f8798002870 legacy=0x7f8798004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87b8745640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87b8745640 1 -- 172.21.15.81:0/4248389737 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8798009e80 con 0x7f8798009140 2024-09-10T16:32:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2308328338 0 0) 0x7f8798009e80 con 0x7f8798009140 2024-09-10T16:32:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 10 monclient(hunting): my global_id is 5282 2024-09-10T16:32:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87980065d0 con 0x7f8798009140 2024-09-10T16:32:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1302459507 0 0) 0x7f87980065d0 con 0x7f8798009140 2024-09-10T16:32:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8798009e80 con 0x7f8798009140 2024-09-10T16:32:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f87a0001910 con 0x7f8798009140 2024-09-10T16:32:43.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:43.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 10 monclient: dump: 2024-09-10T16:32:43.520 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.520 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.520 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.520 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.520 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.520 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.520 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.521 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.521 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.521 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.521 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.521 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.521 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.521 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.521 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.522 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2854132442 0 0) 0x7f8798009e80 con 0x7f8798009140 2024-09-10T16:32:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 --> v1:172.21.15.81:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f879800c420 con 0x7f8798009140 2024-09-10T16:32:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7669 (unknown 0 0 564708408) 0x7f87a0005340 con 0x7f8798009140 2024-09-10T16:32:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 >> v1:172.21.15.81:6793/0 conn(0x7f8798009140 legacy=0x7f87980095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87a6ffd640 1 -- 172.21.15.81:0/4248389737 >> v1:172.21.15.81:6793/0 conn(0x7f8798009140 legacy=0x7f87980095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:43.523 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-09-10T16:32:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 28, 2024-09-10T16:32:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 173458, 2024-09-10T16:32:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-09-10T16:32:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:32:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:32:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:32:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:43.550 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:43.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87b8745640 1 -- 172.21.15.81:0/4248389737 >> v1:172.21.15.189:6812/1108603242 conn(0x7f879403ce30 legacy=0x7f879403f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87b8745640 10 monclient: shutdown 2024-09-10T16:32:43.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87b8745640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:43.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87b8745640 1 -- 172.21.15.81:0/4248389737 >> v1:172.21.15.81:6793/0 conn(0x7f87b00a5510 legacy=0x7f87b00a4a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87b6ce2640 1 -- 172.21.15.81:0/4248389737 reap_dead start 2024-09-10T16:32:43.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87b6ce2640 1 -- 172.21.15.81:0/4248389737 reap_dead start 2024-09-10T16:32:43.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87b8745640 1 -- 172.21.15.81:0/4248389737 shutdown_connections 2024-09-10T16:32:43.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87b8745640 1 -- 172.21.15.81:0/4248389737 >> 172.21.15.81:0/4248389737 conn(0x7f87b006dae0 msgr2=0x7f87b00a72e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:43.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87b8745640 1 -- 172.21.15.81:0/4248389737 shutdown_connections 2024-09-10T16:32:43.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.497+0000 7f87b8745640 1 -- 172.21.15.81:0/4248389737 wait complete. 2024-09-10T16:32:43.552 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-10T16:32:43.552 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon f 2024-09-10T16:32:43.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-10T16:32:43.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.669+0000 7fdacc26f640 10 monclient: get_monmap_and_config 2024-09-10T16:32:43.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.669+0000 7fdacc26f640 10 monclient: build_initial_monmap 2024-09-10T16:32:43.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 10 monclient: monmap: 2024-09-10T16:32:43.674 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:43.674 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.674 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:43.674023+0000 2024-09-10T16:32:43.674 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:43.674023+0000 2024-09-10T16:32:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:43.675 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:43.675 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 1 Processor -- start 2024-09-10T16:32:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 1 -- start start 2024-09-10T16:32:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 10 monclient: init 2024-09-10T16:32:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 10 monclient: _add_conns ranks=[7,3,1,6,8,4,2,5,0] 2024-09-10T16:32:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 10 monclient(hunting): picked mon.noname-i con 0x7fdac40a0a90 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:43.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 10 monclient(hunting): picked mon.noname-g con 0x7fdac40a35f0 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:43.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 10 monclient(hunting): picked mon.noname-f con 0x7fdac40a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:43.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac409df70 con 0x7fdac40a3a40 2024-09-10T16:32:43.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac409fa30 con 0x7fdac40a35f0 2024-09-10T16:32:43.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac409fd10 con 0x7fdac40a0a90 2024-09-10T16:32:43.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:43.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 10 monclient(hunting): authenticate will time out at 1131.073514s 2024-09-10T16:32:43.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdaca00b640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7fdac40a0a90 legacy=0x7fdac40a2ee0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:32:43.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdaca80c640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fdac40a3a40 0x7fdac413fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.81:45154/0 (socket says 172.21.15.81:45154) 2024-09-10T16:32:43.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac980a640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7fdac40a35f0 0x7fdac413c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.81:38850/0 (socket says 172.21.15.81:38850) 2024-09-10T16:32:43.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdaca80c640 1 -- 172.21.15.81:0/3677712777 learned_addr learned my addr 172.21.15.81:0/3677712777 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:43.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 1 -- 172.21.15.81:0/3677712777 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4124457500 0 0) 0x7fdac409fa30 con 0x7fdac40a35f0 2024-09-10T16:32:43.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient(hunting): my global_id is 134310 2024-09-10T16:32:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 1 -- 172.21.15.81:0/3677712777 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaac003530 con 0x7fdac40a35f0 2024-09-10T16:32:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 1 -- 172.21.15.81:0/3677712777 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1575633857 0 0) 0x7fdac409df70 con 0x7fdac40a3a40 2024-09-10T16:32:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient(hunting): my global_id is 5329 2024-09-10T16:32:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 1 -- 172.21.15.81:0/3677712777 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdac409fa30 con 0x7fdac40a3a40 2024-09-10T16:32:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 1 -- 172.21.15.81:0/3677712777 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 87922529 0 0) 0x7fdaac003530 con 0x7fdac40a35f0 2024-09-10T16:32:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 1 -- 172.21.15.81:0/3677712777 >> v1:172.21.15.189:6792/0 conn(0x7fdac40a0a90 legacy=0x7fdac40a2ee0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:32:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 1 -- 172.21.15.81:0/3677712777 >> v1:172.21.15.189:6789/0 conn(0x7fdac40a3a40 legacy=0x7fdac413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient: _finish_hunting 0 2024-09-10T16:32:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 1 monclient: found mon.noname-g 2024-09-10T16:32:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.189:6790/0 2024-09-10T16:32:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 1 -- 172.21.15.81:0/3677712777 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac409fff0 con 0x7fdac40a35f0 2024-09-10T16:32:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient: _finish_auth 0 2024-09-10T16:32:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient: _check_auth_tickets 2024-09-10T16:32:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 1 -- 172.21.15.81:0/3677712777 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdac0001bc0 con 0x7fdac40a35f0 2024-09-10T16:32:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 5 monclient: authenticate success, global_id 134310 2024-09-10T16:32:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-10T16:32:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient: dump: 2024-09-10T16:32:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.684 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.685 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 1 -- 172.21.15.81:0/3677712777 <== mon.3 v1:172.21.15.189:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdac0001de0 con 0x7fdac40a35f0 2024-09-10T16:32:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 1 -- 172.21.15.81:0/3677712777 <== mon.3 v1:172.21.15.189:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdac0004eb0 con 0x7fdac40a35f0 2024-09-10T16:32:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 4 set_mon_vals no callback set 2024-09-10T16:32:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:32:43.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdac9009640 10 monclient: dump: 2024-09-10T16:32:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.686 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.687 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.687 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 10 monclient: shutdown 2024-09-10T16:32:43.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:43.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 1 -- 172.21.15.81:0/3677712777 >> v1:172.21.15.189:6790/0 conn(0x7fdac40a35f0 legacy=0x7fdac413c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 1 -- 172.21.15.81:0/3677712777 shutdown_connections 2024-09-10T16:32:43.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 1 -- 172.21.15.81:0/3677712777 >> 172.21.15.81:0/3677712777 conn(0x7fdac40a3fd0 msgr2=0x7fdac40a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:43.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 1 -- 172.21.15.81:0/3677712777 shutdown_connections 2024-09-10T16:32:43.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.673+0000 7fdacc26f640 1 -- 172.21.15.81:0/3677712777 wait complete. 2024-09-10T16:32:43.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 monclient: build_initial_monmap 2024-09-10T16:32:43.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 monclient: monmap: 2024-09-10T16:32:43.687 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:43.688 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:43.689 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 1 Processor -- start 2024-09-10T16:32:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 1 -- start start 2024-09-10T16:32:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 monclient: init 2024-09-10T16:32:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 monclient: _add_conns ranks=[5,2,6,3,1,0,7,8,4] 2024-09-10T16:32:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 monclient(hunting): picked mon.noname-h con 0x7fdac40a0a90 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 monclient(hunting): picked mon.noname-b con 0x7fdac40a35f0 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 monclient(hunting): picked mon.noname-d con 0x7fdac40a3a40 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac41b5a30 con 0x7fdac40a35f0 2024-09-10T16:32:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac41bb340 con 0x7fdac40a0a90 2024-09-10T16:32:43.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdac40a6a70 con 0x7fdac40a3a40 2024-09-10T16:32:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 monclient(hunting): authenticate will time out at 1131.077427s 2024-09-10T16:32:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdac980a640 1 -- >> v1:172.21.15.81:6790/0 conn(0x7fdac40a35f0 legacy=0x7fdac41d2b70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6790/0 2024-09-10T16:32:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdaca80c640 1 -- >> v1:172.21.15.81:6792/0 conn(0x7fdac40a3a40 legacy=0x7fdac41d62a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6792/0 2024-09-10T16:32:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdaca00b640 1 --1- >> v1:172.21.15.189:6791/0 conn(0x7fdac40a0a90 0x7fdac41cdb80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6791/0 says I am v1:172.21.15.81:40722/0 (socket says 172.21.15.81:40722) 2024-09-10T16:32:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdaca00b640 1 -- 172.21.15.81:0/488339670 learned_addr learned my addr 172.21.15.81:0/488339670 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3001312922 0 0) 0x7fdac41bb340 con 0x7fdac40a0a90 2024-09-10T16:32:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient(hunting): my global_id is 5108 2024-09-10T16:32:43.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdab0003530 con 0x7fdac40a0a90 2024-09-10T16:32:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2202579267 0 0) 0x7fdab0003530 con 0x7fdac40a0a90 2024-09-10T16:32:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdac41bb340 con 0x7fdac40a0a90 2024-09-10T16:32:43.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdabc004400 con 0x7fdac40a0a90 2024-09-10T16:32:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient(hunting): got monmap 1 from mon.noname-h (according to old e1) 2024-09-10T16:32:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient(hunting): dump: 2024-09-10T16:32:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.695 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.696 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.696 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.696 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.696 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.696 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.696 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:43.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3448965050 0 0) 0x7fdac41bb340 con 0x7fdac40a0a90 2024-09-10T16:32:43.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 >> v1:172.21.15.81:6792/0 conn(0x7fdac40a3a40 legacy=0x7fdac41d62a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:32:43.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 >> v1:172.21.15.81:6790/0 conn(0x7fdac40a35f0 legacy=0x7fdac41d2b70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:32:43.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient: _finish_hunting 0 2024-09-10T16:32:43.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 1 monclient: found mon.h 2024-09-10T16:32:43.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:43.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.189:6791/0 2024-09-10T16:32:43.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 --> v1:172.21.15.189:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac41b5750 con 0x7fdac40a0a90 2024-09-10T16:32:43.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient: _finish_auth 0 2024-09-10T16:32:43.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient: _check_auth_tickets 2024-09-10T16:32:43.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:43.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 5 monclient: authenticate success, global_id 5108 2024-09-10T16:32:43.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 monclient: _renew_subs 2024-09-10T16:32:43.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.189:6791/0 2024-09-10T16:32:43.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 1 -- 172.21.15.81:0/488339670 --> v1:172.21.15.189:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fdac409bf50 con 0x7fdac40a0a90 2024-09-10T16:32:43.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 monclient: _renew_subs 2024-09-10T16:32:43.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 monclient: _send_mon_message to mon.h at v1:172.21.15.189:6791/0 2024-09-10T16:32:43.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 1 -- 172.21.15.81:0/488339670 --> v1:172.21.15.189:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fdac4074090 con 0x7fdac40a0a90 2024-09-10T16:32:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.5 v1:172.21.15.189:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fdabc0045a0 con 0x7fdac40a0a90 2024-09-10T16:32:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.5 v1:172.21.15.189:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdabc004b50 con 0x7fdac40a0a90 2024-09-10T16:32:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdac8808640 4 set_mon_vals no callback set 2024-09-10T16:32:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:32:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdabaffd640 10 monclient: dump: 2024-09-10T16:32:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.698 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.699 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.677+0000 7fdacc26f640 1 -- 172.21.15.81:0/488339670 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdaa40065d0 con 0x7fdaa4002870 2024-09-10T16:32:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.5 v1:172.21.15.189:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fdabc004d70 con 0x7fdac40a0a90 2024-09-10T16:32:43.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.5 v1:172.21.15.189:6791/0 8 ==== osd_map(125..125 src has 1..125) ==== 3898+0+0 (unknown 2476925705 0 0) 0x7fdabc04afe0 con 0x7fdac40a0a90 2024-09-10T16:32:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2667628195 0 0) 0x7fdaa40065d0 con 0x7fdaa4002870 2024-09-10T16:32:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 10 monclient(hunting): my global_id is 5338 2024-09-10T16:32:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdac41bb340 con 0x7fdaa4002870 2024-09-10T16:32:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdaca80c640 10 monclient: get_auth_request con 0x7fdab003ce80 auth_method 0 2024-09-10T16:32:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3714198020 0 0) 0x7fdac41bb340 con 0x7fdaa4002870 2024-09-10T16:32:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdaa40065d0 con 0x7fdaa4002870 2024-09-10T16:32:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdac0004eb0 con 0x7fdaa4002870 2024-09-10T16:32:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:32:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 10 monclient: dump: 2024-09-10T16:32:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.701 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.702 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3838581003 0 0) 0x7fdaa40065d0 con 0x7fdaa4002870 2024-09-10T16:32:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 --> v1:172.21.15.189:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdaa400a170 con 0x7fdaa4002870 2024-09-10T16:32:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fdac0001880 con 0x7fdaa4002870 2024-09-10T16:32:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 >> v1:172.21.15.189:6789/0 conn(0x7fdaa4002870 legacy=0x7fdaa4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.681+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 >> v1:172.21.15.189:6789/0 conn(0x7fdaa4002870 legacy=0x7fdaa4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdacc26f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:43.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdacc26f640 1 -- 172.21.15.81:0/488339670 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fdaa4009e60 con 0x7fdaa4009120 2024-09-10T16:32:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3081587018 0 0) 0x7fdaa4009e60 con 0x7fdaa4009120 2024-09-10T16:32:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 10 monclient(hunting): my global_id is 5347 2024-09-10T16:32:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdaa40065d0 con 0x7fdaa4009120 2024-09-10T16:32:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3006892391 0 0) 0x7fdaa40065d0 con 0x7fdaa4009120 2024-09-10T16:32:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fdaa4009e60 con 0x7fdaa4009120 2024-09-10T16:32:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fdac0008480 con 0x7fdaa4009120 2024-09-10T16:32:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:32:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 10 monclient: dump: 2024-09-10T16:32:43.703 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.704 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.705 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3023076630 0 0) 0x7fdaa4009e60 con 0x7fdaa4009120 2024-09-10T16:32:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 --> v1:172.21.15.189:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fdaa400c400 con 0x7fdaa4009120 2024-09-10T16:32:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7500 (unknown 0 0 1456143976) 0x7fdac0001d50 con 0x7fdaa4009120 2024-09-10T16:32:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 >> v1:172.21.15.189:6789/0 conn(0x7fdaa4009120 legacy=0x7fdaa40095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdabaffd640 1 -- 172.21.15.81:0/488339670 >> v1:172.21.15.189:6789/0 conn(0x7fdaa4009120 legacy=0x7fdaa40095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:43.705 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 28, 2024-09-10T16:32:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 173607, 2024-09-10T16:32:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:43.706 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-09-10T16:32:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:43.707 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:43.708 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:43.708 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:43.708 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:43.708 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:43.708 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:43.708 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:43.708 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:43.708 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:43.708 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:43.708 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:43.708 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:43.708 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:43.708 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:43.709 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:43.709 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:43.709 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:43.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.709 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:43.709 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:43.709 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:43.709 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:43.709 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:43.709 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:43.709 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:43.709 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:43.710 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:43.710 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:43.710 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:43.710 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:43.710 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:43.710 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:43.710 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:43.710 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:43.710 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:43.710 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:43.710 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:43.710 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:43.711 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:43.711 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:43.711 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:43.711 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:43.711 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:43.711 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:43.711 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:43.711 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:43.711 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:43.711 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:43.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.711 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:43.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:43.712 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.714 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:43.716 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.718 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.720 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:43.721 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:43.722 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.723 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:43.724 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:32:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:43.725 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:43.725 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:43.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdacc26f640 1 -- 172.21.15.81:0/488339670 >> v1:172.21.15.189:6812/1108603242 conn(0x7fdab003ce80 legacy=0x7fdab003f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdacc26f640 10 monclient: shutdown 2024-09-10T16:32:43.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdacc26f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:43.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdacc26f640 1 -- 172.21.15.81:0/488339670 >> v1:172.21.15.189:6791/0 conn(0x7fdac40a0a90 legacy=0x7fdac41cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdaca80c640 1 -- 172.21.15.81:0/488339670 reap_dead start 2024-09-10T16:32:43.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdaca80c640 1 -- 172.21.15.81:0/488339670 reap_dead start 2024-09-10T16:32:43.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdacc26f640 1 -- 172.21.15.81:0/488339670 shutdown_connections 2024-09-10T16:32:43.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdacc26f640 1 -- 172.21.15.81:0/488339670 >> 172.21.15.81:0/488339670 conn(0x7fdac40a3fd0 msgr2=0x7fdac40a5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:43.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdacc26f640 1 -- 172.21.15.81:0/488339670 shutdown_connections 2024-09-10T16:32:43.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.689+0000 7fdacc26f640 1 -- 172.21.15.81:0/488339670 wait complete. 2024-09-10T16:32:43.727 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-10T16:32:43.727 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon g 2024-09-10T16:32:43.727 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-10T16:32:43.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 10 monclient: get_monmap_and_config 2024-09-10T16:32:43.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 10 monclient: build_initial_monmap 2024-09-10T16:32:43.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 10 monclient: monmap: 2024-09-10T16:32:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:43.842204+0000 2024-09-10T16:32:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:43.842204+0000 2024-09-10T16:32:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:43.843 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:43.844 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:43.844 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 1 Processor -- start 2024-09-10T16:32:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 1 -- start start 2024-09-10T16:32:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 10 monclient: init 2024-09-10T16:32:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:43.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 10 monclient: _add_conns ranks=[4,1,5,8,2,6,7,3,0] 2024-09-10T16:32:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 10 monclient(hunting): picked mon.noname-c con 0x7f0fc009ca10 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 10 monclient(hunting): picked mon.noname-f con 0x7f0fc00a56e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 10 monclient(hunting): picked mon.noname-h con 0x7f0fc00a5b00 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc01362b0 con 0x7f0fc00a56e0 2024-09-10T16:32:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc00a80b0 con 0x7f0fc009ca10 2024-09-10T16:32:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc009de70 con 0x7f0fc00a5b00 2024-09-10T16:32:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 10 monclient(hunting): authenticate will time out at 1131.241678s 2024-09-10T16:32:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbffff640 1 -- >> v1:172.21.15.81:6791/0 conn(0x7f0fc009ca10 legacy=0x7f0fc0135ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc4c46640 1 --1- >> v1:172.21.15.189:6791/0 conn(0x7f0fc00a5b00 0x7f0fc0141650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6791/0 says I am v1:172.21.15.81:40736/0 (socket says 172.21.15.81:40736) 2024-09-10T16:32:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbf7fe640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f0fc00a56e0 0x7f0fc013df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.81:45188/0 (socket says 172.21.15.81:45188) 2024-09-10T16:32:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc4c46640 1 -- 172.21.15.81:0/2078235188 learned_addr learned my addr 172.21.15.81:0/2078235188 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:43.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 1 -- 172.21.15.81:0/2078235188 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 659778171 0 0) 0x7f0fc009de70 con 0x7f0fc00a5b00 2024-09-10T16:32:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient(hunting): my global_id is 5117 2024-09-10T16:32:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 1 -- 172.21.15.81:0/2078235188 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fa8003530 con 0x7f0fc00a5b00 2024-09-10T16:32:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 1 -- 172.21.15.81:0/2078235188 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010365113 0 0) 0x7f0fc01362b0 con 0x7f0fc00a56e0 2024-09-10T16:32:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient(hunting): my global_id is 5356 2024-09-10T16:32:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 1 -- 172.21.15.81:0/2078235188 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fc009de70 con 0x7f0fc00a56e0 2024-09-10T16:32:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 1 -- 172.21.15.81:0/2078235188 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2236017808 0 0) 0x7f0fa8003530 con 0x7f0fc00a5b00 2024-09-10T16:32:43.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 1 -- 172.21.15.81:0/2078235188 >> v1:172.21.15.81:6791/0 conn(0x7f0fc009ca10 legacy=0x7f0fc0135ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:32:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 1 -- 172.21.15.81:0/2078235188 >> v1:172.21.15.189:6789/0 conn(0x7f0fc00a56e0 legacy=0x7f0fc013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient: _finish_hunting 0 2024-09-10T16:32:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 1 monclient: found mon.noname-h 2024-09-10T16:32:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient: _send_mon_message to mon.noname-h at v1:172.21.15.189:6791/0 2024-09-10T16:32:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 1 -- 172.21.15.81:0/2078235188 --> v1:172.21.15.189:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc009e150 con 0x7f0fc00a5b00 2024-09-10T16:32:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient: _finish_auth 0 2024-09-10T16:32:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient: _check_auth_tickets 2024-09-10T16:32:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 1 -- 172.21.15.81:0/2078235188 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0fb8001af0 con 0x7f0fc00a5b00 2024-09-10T16:32:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 5 monclient: authenticate success, global_id 5117 2024-09-10T16:32:43.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient: got monmap 1 from mon.noname-h (according to old e1) 2024-09-10T16:32:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient: dump: 2024-09-10T16:32:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.850 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.851 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.851 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.851 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.851 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.851 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.851 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:43.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 1 -- 172.21.15.81:0/2078235188 <== mon.5 v1:172.21.15.189:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0fb8001c90 con 0x7f0fc00a5b00 2024-09-10T16:32:43.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:43.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 4 set_mon_vals no callback set 2024-09-10T16:32:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 1 -- 172.21.15.81:0/2078235188 <== mon.5 v1:172.21.15.189:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0fb8004c30 con 0x7f0fc00a5b00 2024-09-10T16:32:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:32:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fbeffd640 10 monclient: dump: 2024-09-10T16:32:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:43.852 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:43.853 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 10 monclient: shutdown 2024-09-10T16:32:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 1 -- 172.21.15.81:0/2078235188 >> v1:172.21.15.189:6791/0 conn(0x7f0fc00a5b00 legacy=0x7f0fc0141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 1 -- 172.21.15.81:0/2078235188 shutdown_connections 2024-09-10T16:32:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 1 -- 172.21.15.81:0/2078235188 >> 172.21.15.81:0/2078235188 conn(0x7f0fc006dc90 msgr2=0x7f0fc00ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:43.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 1 -- 172.21.15.81:0/2078235188 shutdown_connections 2024-09-10T16:32:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.841+0000 7f0fc66a9640 1 -- 172.21.15.81:0/2078235188 wait complete. 2024-09-10T16:32:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 10 monclient: build_initial_monmap 2024-09-10T16:32:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 10 monclient: monmap: 2024-09-10T16:32:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:43.854 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:43.855 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:43.855 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:43.855 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:43.855 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:43.855 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 1 Processor -- start 2024-09-10T16:32:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 1 -- start start 2024-09-10T16:32:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 10 monclient: init 2024-09-10T16:32:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 10 monclient: _add_conns ranks=[4,7,2,6,5,8,3,1,0] 2024-09-10T16:32:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 10 monclient(hunting): picked mon.noname-c con 0x7f0fc009ca10 addr v1:172.21.15.81:6791/0 2024-09-10T16:32:43.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 10 monclient(hunting): picked mon.noname-i con 0x7f0fc00a56e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 10 monclient(hunting): picked mon.noname-b con 0x7f0fc00a5b00 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc00a01f0 con 0x7f0fc00a5b00 2024-09-10T16:32:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fbffff640 1 -- >> v1:172.21.15.81:6791/0 conn(0x7f0fc009ca10 legacy=0x7f0fc01cd4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc00a04d0 con 0x7f0fc009ca10 2024-09-10T16:32:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc01ce310 con 0x7f0fc00a56e0 2024-09-10T16:32:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc4c46640 1 -- >> v1:172.21.15.81:6790/0 conn(0x7f0fc00a5b00 legacy=0x7f0fc01d5890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6790/0 2024-09-10T16:32:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fc66a9640 10 monclient(hunting): authenticate will time out at 1131.245453s 2024-09-10T16:32:43.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:43.845+0000 7f0fbf7fe640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7f0fc00a56e0 legacy=0x7f0fc01cdc00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:32:44.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:44.049+0000 7f0fbf7fe640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7f0fc00a56e0 legacy=0x7f0fc01cdc00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:44.049+0000 7f0fc4c46640 1 -- >> v1:172.21.15.81:6790/0 conn(0x7f0fc00a5b00 legacy=0x7f0fc01d5890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6790/0 2024-09-10T16:32:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:44.049+0000 7f0fbffff640 1 -- >> v1:172.21.15.81:6791/0 conn(0x7f0fc009ca10 legacy=0x7f0fc01cd4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:44.453+0000 7f0fc4c46640 1 -- >> v1:172.21.15.81:6790/0 conn(0x7f0fc00a5b00 legacy=0x7f0fc01d5890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6790/0 2024-09-10T16:32:44.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:44.453+0000 7f0fbffff640 1 -- >> v1:172.21.15.81:6791/0 conn(0x7f0fc009ca10 legacy=0x7f0fc01cd4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:44.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:44.453+0000 7f0fbf7fe640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7f0fc00a56e0 legacy=0x7f0fc01cdc00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:32:44.573 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29833]: starting. 2024-09-10T16:32:44.573 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29833]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29832 2024-09-10T16:32:44.573 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29833]: created object 0... 2024-09-10T16:32:44.573 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29833]: created object 25... 2024-09-10T16:32:44.573 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29833]: created object 49... 2024-09-10T16:32:44.573 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29833]: finishing. 2024-09-10T16:32:44.573 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29833]: shutting down. 2024-09-10T16:32:45.086 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29834]: starting. 2024-09-10T16:32:45.087 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29834]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29832 2024-09-10T16:32:45.087 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29834]: shutting down. 2024-09-10T16:32:45.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:45.257+0000 7f0fc4c46640 1 -- >> v1:172.21.15.81:6790/0 conn(0x7f0fc00a5b00 legacy=0x7f0fc01d5890 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6790/0 2024-09-10T16:32:45.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:45.257+0000 7f0fbffff640 1 -- >> v1:172.21.15.81:6791/0 conn(0x7f0fc009ca10 legacy=0x7f0fc01cd4f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6791/0 2024-09-10T16:32:45.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:45.257+0000 7f0fbf7fe640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7f0fc00a56e0 legacy=0x7f0fc01cdc00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:32:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 10 monclient(hunting): tick 2024-09-10T16:32:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 10 monclient(hunting): _check_auth_tickets 2024-09-10T16:32:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 1 monclient(hunting): continuing hunt 2024-09-10T16:32:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 10 monclient(hunting): _reopen_session rank -1 2024-09-10T16:32:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7f0fc00a56e0 legacy=0x7f0fc01cdc00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:32:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 1 -- >> v1:172.21.15.81:6791/0 conn(0x7f0fc009ca10 legacy=0x7f0fc01cd4f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:32:46.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 1 -- >> v1:172.21.15.81:6790/0 conn(0x7f0fc00a5b00 legacy=0x7f0fc01d5890 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:32:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 10 monclient: _add_conns ranks=[1,8,5,3,0,6] 2024-09-10T16:32:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 10 monclient(hunting): picked mon.noname-f con 0x7f0fa0003790 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 10 monclient(hunting): picked mon.noname-e con 0x7f0fa0007420 addr v1:172.21.15.81:6793/0 2024-09-10T16:32:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 10 monclient(hunting): picked mon.noname-h con 0x7f0fa000b1b0 addr v1:172.21.15.189:6791/0 2024-09-10T16:32:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc009f1d0 con 0x7f0fa0003790 2024-09-10T16:32:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc00a01f0 con 0x7f0fa000b1b0 2024-09-10T16:32:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0fc00a04d0 con 0x7f0fa0007420 2024-09-10T16:32:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fa77fe640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbf7fe640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f0fa0007420 0x7f0fa00098e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:59900/0 (socket says 172.21.15.81:59900) 2024-09-10T16:32:46.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbf7fe640 1 -- 172.21.15.81:0/1200399308 learned_addr learned my addr 172.21.15.81:0/1200399308 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:46.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3792935232 0 0) 0x7f0fc00a04d0 con 0x7f0fa0007420 2024-09-10T16:32:46.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): my global_id is 5318 2024-09-10T16:32:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fac003530 con 0x7f0fa0007420 2024-09-10T16:32:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3075007912 0 0) 0x7f0fc00a01f0 con 0x7f0fa000b1b0 2024-09-10T16:32:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): my global_id is 5144 2024-09-10T16:32:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fc00a04d0 con 0x7f0fa000b1b0 2024-09-10T16:32:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3133663984 0 0) 0x7f0fc009f1d0 con 0x7f0fa0003790 2024-09-10T16:32:46.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): my global_id is 5374 2024-09-10T16:32:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fc00a01f0 con 0x7f0fa0003790 2024-09-10T16:32:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2806770945 0 0) 0x7f0fac003530 con 0x7f0fa0007420 2024-09-10T16:32:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0fc009f1d0 con 0x7f0fa0007420 2024-09-10T16:32:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0fb4001c80 con 0x7f0fa0007420 2024-09-10T16:32:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:32:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): dump: 2024-09-10T16:32:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:46.854 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:46.855 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:46.856 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4058265205 0 0) 0x7f0fc00a04d0 con 0x7f0fa000b1b0 2024-09-10T16:32:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0fac003530 con 0x7f0fa000b1b0 2024-09-10T16:32:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2969775660 0 0) 0x7f0fc00a01f0 con 0x7f0fa0003790 2024-09-10T16:32:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0fc00a04d0 con 0x7f0fa0003790 2024-09-10T16:32:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0fb8004c30 con 0x7f0fa000b1b0 2024-09-10T16:32:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): got monmap 1 from mon.h (according to old e1) 2024-09-10T16:32:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): dump: 2024-09-10T16:32:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:46.856 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:46.857 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:46.857 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:46.857 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:46.857 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:46.857 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:46.857 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:46.857 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:46.857 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:46.857 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:46.858 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0fb0004200 con 0x7f0fa0003790 2024-09-10T16:32:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-10T16:32:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.845+0000 7f0fbcff9640 10 monclient(hunting): dump: 2024-09-10T16:32:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:46.858 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:46.859 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 682219681 0 0) 0x7f0fc009f1d0 con 0x7f0fa0007420 2024-09-10T16:32:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 >> v1:172.21.15.189:6791/0 conn(0x7f0fa000b1b0 legacy=0x7f0fa000d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:46.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 >> v1:172.21.15.189:6789/0 conn(0x7f0fa0003790 legacy=0x7f0fa0005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fc4c46640 1 -- 172.21.15.81:0/1200399308 reap_dead start 2024-09-10T16:32:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 10 monclient: _finish_hunting 0 2024-09-10T16:32:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 1 monclient: found mon.e 2024-09-10T16:32:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:32:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fc01ce310 con 0x7f0fa0007420 2024-09-10T16:32:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 10 monclient: _finish_auth 0 2024-09-10T16:32:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 10 monclient: _check_auth_tickets 2024-09-10T16:32:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fc66a9640 5 monclient: authenticate success, global_id 5318 2024-09-10T16:32:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fc66a9640 10 monclient: _renew_subs 2024-09-10T16:32:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fc66a9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:32:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fc66a9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0fc00aa700 con 0x7f0fa0007420 2024-09-10T16:32:46.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fc66a9640 10 monclient: _renew_subs 2024-09-10T16:32:46.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fc66a9640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:32:46.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fc66a9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f0fc009eb30 con 0x7f0fa0007420 2024-09-10T16:32:46.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0fb4004aa0 con 0x7f0fa0007420 2024-09-10T16:32:46.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:46.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0fb4004f90 con 0x7f0fa0007420 2024-09-10T16:32:46.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:46.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbdffb640 4 set_mon_vals no callback set 2024-09-10T16:32:46.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:32:46.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 10 monclient: dump: 2024-09-10T16:32:46.861 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:46.861 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:46.861 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:46.861 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:46.862 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fc66a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:46.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f0fb4010ea0 con 0x7f0fa0007420 2024-09-10T16:32:46.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fc66a9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0f980065d0 con 0x7f0f98002870 2024-09-10T16:32:46.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(128..128 src has 1..128) ==== 3898+0+0 (unknown 3967064135 0 0) 0x7f0fb404b070 con 0x7f0fa0007420 2024-09-10T16:32:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fc4c46640 10 monclient: get_auth_request con 0x7f0fac03d7c0 auth_method 0 2024-09-10T16:32:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4060760458 0 0) 0x7f0f980065d0 con 0x7f0f98002870 2024-09-10T16:32:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 10 monclient(hunting): my global_id is 134328 2024-09-10T16:32:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.849+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0fc009f1d0 con 0x7f0f98002870 2024-09-10T16:32:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.853+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3716500750 0 0) 0x7f0fc009f1d0 con 0x7f0f98002870 2024-09-10T16:32:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.853+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f980065d0 con 0x7f0f98002870 2024-09-10T16:32:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.853+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0fb0004a20 con 0x7f0f98002870 2024-09-10T16:32:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.853+0000 7f0fbcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.853+0000 7f0fbcff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:32:46.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.853+0000 7f0fbcff9640 10 monclient: dump: 2024-09-10T16:32:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:46.866 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:46.867 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.853+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4034878931 0 0) 0x7f0f980065d0 con 0x7f0f98002870 2024-09-10T16:32:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.853+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.189:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0f9800a170 con 0x7f0f98002870 2024-09-10T16:32:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.853+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.3 v1:172.21.15.189:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0fb0004dc0 con 0x7f0f98002870 2024-09-10T16:32:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.853+0000 7f0fbcff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.853+0000 7f0fbcff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.853+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 >> v1:172.21.15.189:6790/0 conn(0x7f0f98002870 legacy=0x7f0f98004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.853+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 >> v1:172.21.15.189:6790/0 conn(0x7f0f98002870 legacy=0x7f0f98004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:46.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fc66a9640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fc66a9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0f98009e60 con 0x7f0f98009120 2024-09-10T16:32:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1875514757 0 0) 0x7f0f98009e60 con 0x7f0f98009120 2024-09-10T16:32:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fbcff9640 10 monclient(hunting): _negotiate 2024-09-10T16:32:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fbcff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fbcff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fbcff9640 10 monclient(hunting): my global_id is 134337 2024-09-10T16:32:46.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f980065d0 con 0x7f0f98009120 2024-09-10T16:32:46.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 636880564 0 0) 0x7f0f980065d0 con 0x7f0f98009120 2024-09-10T16:32:46.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0f98009e60 con 0x7f0f98009120 2024-09-10T16:32:46.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0fb00055f0 con 0x7f0f98009120 2024-09-10T16:32:46.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fbcff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:46.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fbcff9640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:32:46.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fbcff9640 10 monclient: dump: 2024-09-10T16:32:46.869 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:46.870 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:46.871 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2190077293 0 0) 0x7f0f98009e60 con 0x7f0f98009120 2024-09-10T16:32:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.861+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 --> v1:172.21.15.189:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0f9800c400 con 0x7f0f98009120 2024-09-10T16:32:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.865+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 <== mon.3 v1:172.21.15.189:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7499 (unknown 0 0 621960728) 0x7f0fb0006ae0 con 0x7f0f98009120 2024-09-10T16:32:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.865+0000 7f0fbcff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.865+0000 7f0fbcff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.865+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 >> v1:172.21.15.189:6790/0 conn(0x7f0f98009120 legacy=0x7f0f980095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:46.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.865+0000 7f0fbcff9640 1 -- 172.21.15.81:0/1200399308 >> v1:172.21.15.189:6790/0 conn(0x7f0f98009120 legacy=0x7f0f980095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:46.872 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:46.872 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:46.872 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:46.872 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:46.872 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 28, 2024-09-10T16:32:46.872 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 36582, 2024-09-10T16:32:46.872 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 6, 2024-09-10T16:32:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:46.873 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:46.874 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.875 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:46.876 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:46.877 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:46.878 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:46.879 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:46.880 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:46.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:46.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.883 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:46.884 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:46.885 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:46.886 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:46.888 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:46.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:46.890 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-09-10T16:32:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:46.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:46.892 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:46.892 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.865+0000 7f0fc66a9640 1 -- 172.21.15.81:0/1200399308 >> v1:172.21.15.189:6812/1108603242 conn(0x7f0fac03d7c0 legacy=0x7f0fac03fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.865+0000 7f0fc66a9640 10 monclient: shutdown 2024-09-10T16:32:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.865+0000 7f0fc66a9640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.865+0000 7f0fc66a9640 1 -- 172.21.15.81:0/1200399308 >> v1:172.21.15.81:6793/0 conn(0x7f0fa0007420 legacy=0x7f0fa00098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.865+0000 7f0fc66a9640 1 -- 172.21.15.81:0/1200399308 shutdown_connections 2024-09-10T16:32:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.865+0000 7f0fc66a9640 1 -- 172.21.15.81:0/1200399308 >> 172.21.15.81:0/1200399308 conn(0x7f0fc006dc90 msgr2=0x7f0fc01359b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.865+0000 7f0fc66a9640 1 -- 172.21.15.81:0/1200399308 shutdown_connections 2024-09-10T16:32:46.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:46.865+0000 7f0fc66a9640 1 -- 172.21.15.81:0/1200399308 wait complete. 2024-09-10T16:32:46.894 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-10T16:32:46.894 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon h 2024-09-10T16:32:46.894 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-10T16:32:47.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient: get_monmap_and_config 2024-09-10T16:32:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient: build_initial_monmap 2024-09-10T16:32:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient: monmap: 2024-09-10T16:32:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:32:47.022344+0000 2024-09-10T16:32:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:32:47.022344+0000 2024-09-10T16:32:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:47.023 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:47.024 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:47.024 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:47.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 1 Processor -- start 2024-09-10T16:32:47.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 1 -- start start 2024-09-10T16:32:47.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient: init 2024-09-10T16:32:47.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:47.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient: _add_conns ranks=[2,0,7,6,5,1,8,3,4] 2024-09-10T16:32:47.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient(hunting): picked mon.noname-b con 0x7f0df009ca10 addr v1:172.21.15.81:6790/0 2024-09-10T16:32:47.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient(hunting): picked mon.noname-a con 0x7f0df00a56e0 addr v1:172.21.15.81:6789/0 2024-09-10T16:32:47.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient(hunting): picked mon.noname-i con 0x7f0df00a5b00 addr v1:172.21.15.189:6792/0 2024-09-10T16:32:47.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df01362b0 con 0x7f0df00a56e0 2024-09-10T16:32:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df00a80b0 con 0x7f0df009ca10 2024-09-10T16:32:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df009de70 con 0x7f0df00a5b00 2024-09-10T16:32:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient(hunting): authenticate will time out at 1134.421896s 2024-09-10T16:32:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df636b640 1 -- >> v1:172.21.15.81:6790/0 conn(0x7f0df009ca10 legacy=0x7f0df0135ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.81:6790/0 2024-09-10T16:32:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5b6a640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f0df00a56e0 0x7f0df013df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37148/0 (socket says 172.21.15.81:37148) 2024-09-10T16:32:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df6b6c640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7f0df00a5b00 legacy=0x7f0df0141650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:32:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5b6a640 1 -- 172.21.15.81:0/2710492936 learned_addr learned my addr 172.21.15.81:0/2710492936 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 1 -- 172.21.15.81:0/2710492936 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3657477369 0 0) 0x7f0df01362b0 con 0x7f0df00a56e0 2024-09-10T16:32:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient(hunting): _negotiate 2024-09-10T16:32:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:47.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient(hunting): my global_id is 5355 2024-09-10T16:32:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 1 -- 172.21.15.81:0/2710492936 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ddc003530 con 0x7f0df00a56e0 2024-09-10T16:32:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 1 -- 172.21.15.81:0/2710492936 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2703457821 0 0) 0x7f0ddc003530 con 0x7f0df00a56e0 2024-09-10T16:32:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 1 -- 172.21.15.81:0/2710492936 >> v1:172.21.15.189:6792/0 conn(0x7f0df00a5b00 legacy=0x7f0df0141650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:32:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 1 -- 172.21.15.81:0/2710492936 >> v1:172.21.15.81:6790/0 conn(0x7f0df009ca10 legacy=0x7f0df0135ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:32:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient: _finish_hunting 0 2024-09-10T16:32:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 1 monclient: found mon.noname-a 2024-09-10T16:32:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:32:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 1 -- 172.21.15.81:0/2710492936 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df009e150 con 0x7f0df00a56e0 2024-09-10T16:32:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient: _finish_auth 0 2024-09-10T16:32:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient: _check_auth_tickets 2024-09-10T16:32:47.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 1 -- 172.21.15.81:0/2710492936 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0de4001bc0 con 0x7f0df00a56e0 2024-09-10T16:32:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:32:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient: dump: 2024-09-10T16:32:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:47.033 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:47.034 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:47.034 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:47.034 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:47.034 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:47.034 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:47.034 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:47.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 5 monclient: authenticate success, global_id 5355 2024-09-10T16:32:47.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:32:47.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 1 -- 172.21.15.81:0/2710492936 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0de4001de0 con 0x7f0df00a56e0 2024-09-10T16:32:47.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:47.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient: get_monmap_and_config success 2024-09-10T16:32:47.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 1 -- 172.21.15.81:0/2710492936 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0de4004f70 con 0x7f0df00a56e0 2024-09-10T16:32:47.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 4 set_mon_vals no callback set 2024-09-10T16:32:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:32:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df5369640 10 monclient: dump: 2024-09-10T16:32:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:47.035 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:47.036 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient: shutdown 2024-09-10T16:32:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 1 -- 172.21.15.81:0/2710492936 >> v1:172.21.15.81:6789/0 conn(0x7f0df00a56e0 legacy=0x7f0df013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 1 -- 172.21.15.81:0/2710492936 shutdown_connections 2024-09-10T16:32:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 1 -- 172.21.15.81:0/2710492936 >> 172.21.15.81:0/2710492936 conn(0x7f0df006dc90 msgr2=0x7f0df00ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 1 -- 172.21.15.81:0/2710492936 shutdown_connections 2024-09-10T16:32:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 1 -- 172.21.15.81:0/2710492936 wait complete. 2024-09-10T16:32:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient: build_initial_monmap 2024-09-10T16:32:47.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.021+0000 7f0df85cf640 10 monclient: monmap: 2024-09-10T16:32:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:32:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:32:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:32:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:32:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:32:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:32:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:32:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:32:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:32:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:32:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:32:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:32:47.037 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:32:47.038 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:32:47.038 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:32:47.038 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:47.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 1 Processor -- start 2024-09-10T16:32:47.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 1 -- start start 2024-09-10T16:32:47.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 10 monclient: init 2024-09-10T16:32:47.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 10 monclient: _reopen_session rank -1 2024-09-10T16:32:47.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 10 monclient: _add_conns ranks=[6,1,3,2,7,0,5,8,4] 2024-09-10T16:32:47.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 10 monclient(hunting): picked mon.noname-d con 0x7f0df009ca10 addr v1:172.21.15.81:6792/0 2024-09-10T16:32:47.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 10 monclient(hunting): picked mon.noname-f con 0x7f0df00a56e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:32:47.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 10 monclient(hunting): picked mon.noname-g con 0x7f0df00a5b00 addr v1:172.21.15.189:6790/0 2024-09-10T16:32:47.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df00a07b0 con 0x7f0df00a56e0 2024-09-10T16:32:47.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df0134f00 con 0x7f0df00a5b00 2024-09-10T16:32:47.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0df0132200 con 0x7f0df009ca10 2024-09-10T16:32:47.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 10 monclient(hunting): _renew_subs 2024-09-10T16:32:47.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 10 monclient(hunting): authenticate will time out at 1134.424824s 2024-09-10T16:32:47.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df636b640 1 -- >> v1:172.21.15.81:6792/0 conn(0x7f0df009ca10 legacy=0x7f0df01313e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.81:6792/0 2024-09-10T16:32:47.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df5b6a640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f0df00a56e0 0x7f0df0131af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.81:45212/0 (socket says 172.21.15.81:45212) 2024-09-10T16:32:47.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df5b6a640 1 -- 172.21.15.81:0/1888844476 learned_addr learned my addr 172.21.15.81:0/1888844476 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:32:47.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2943667752 0 0) 0x7f0df0134f00 con 0x7f0df00a5b00 2024-09-10T16:32:47.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:47.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:47.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:47.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): my global_id is 134346 2024-09-10T16:32:47.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dd4003530 con 0x7f0df00a5b00 2024-09-10T16:32:47.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3192330651 0 0) 0x7f0df00a07b0 con 0x7f0df00a56e0 2024-09-10T16:32:47.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:47.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:47.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:47.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): my global_id is 5383 2024-09-10T16:32:47.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0df0134f00 con 0x7f0df00a56e0 2024-09-10T16:32:47.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4017882461 0 0) 0x7f0dd4003530 con 0x7f0df00a5b00 2024-09-10T16:32:47.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0df00a07b0 con 0x7f0df00a5b00 2024-09-10T16:32:47.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0de8004190 con 0x7f0df00a5b00 2024-09-10T16:32:47.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:47.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-10T16:32:47.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): dump: 2024-09-10T16:32:47.040 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:47.040 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:47.041 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:47.042 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:32:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2229661900 0 0) 0x7f0df0134f00 con 0x7f0df00a56e0 2024-09-10T16:32:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0dd4003530 con 0x7f0df00a56e0 2024-09-10T16:32:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0de4004eb0 con 0x7f0df00a56e0 2024-09-10T16:32:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:32:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-10T16:32:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient(hunting): dump: 2024-09-10T16:32:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:47.042 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:47.043 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 95333298 0 0) 0x7f0df00a07b0 con 0x7f0df00a5b00 2024-09-10T16:32:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 >> v1:172.21.15.81:6792/0 conn(0x7f0df009ca10 legacy=0x7f0df01313e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:32:47.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 >> v1:172.21.15.189:6789/0 conn(0x7f0df00a56e0 legacy=0x7f0df0131af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:32:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 monclient: found mon.g 2024-09-10T16:32:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:32:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:32:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0df00a04d0 con 0x7f0df00a5b00 2024-09-10T16:32:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient: _finish_auth 0 2024-09-10T16:32:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:32:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:32:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 5 monclient: authenticate success, global_id 134346 2024-09-10T16:32:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 10 monclient: _renew_subs 2024-09-10T16:32:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:32:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0df009f1a0 con 0x7f0df00a5b00 2024-09-10T16:32:47.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 10 monclient: _renew_subs 2024-09-10T16:32:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:32:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f0df01d7110 con 0x7f0df00a5b00 2024-09-10T16:32:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.3 v1:172.21.15.189:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0de80043b0 con 0x7f0df00a5b00 2024-09-10T16:32:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:32:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df4b68640 4 set_mon_vals no callback set 2024-09-10T16:32:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.3 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0de80049e0 con 0x7f0df00a5b00 2024-09-10T16:32:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:32:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0de2ffd640 10 monclient: dump: 2024-09-10T16:32:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:47.045 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:47.046 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.025+0000 7f0df85cf640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0dd80065d0 con 0x7f0dd8002870 2024-09-10T16:32:47.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.3 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f0de8004c00 con 0x7f0df00a5b00 2024-09-10T16:32:47.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.3 v1:172.21.15.189:6790/0 8 ==== osd_map(128..128 src has 1..128) ==== 3898+0+0 (unknown 3967064135 0 0) 0x7f0de804ae30 con 0x7f0df00a5b00 2024-09-10T16:32:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2078657162 0 0) 0x7f0dd80065d0 con 0x7f0dd8002870 2024-09-10T16:32:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 10 monclient(hunting): my global_id is 5153 2024-09-10T16:32:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0df00a07b0 con 0x7f0dd8002870 2024-09-10T16:32:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0df5b6a640 10 monclient: get_auth_request con 0x7f0dd403d410 auth_method 0 2024-09-10T16:32:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2003686144 0 0) 0x7f0df00a07b0 con 0x7f0dd8002870 2024-09-10T16:32:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0dd80065d0 con 0x7f0dd8002870 2024-09-10T16:32:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0dec004110 con 0x7f0dd8002870 2024-09-10T16:32:47.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:32:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 10 monclient: dump: 2024-09-10T16:32:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:47.050 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:47.051 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 358772078 0 0) 0x7f0dd80065d0 con 0x7f0dd8002870 2024-09-10T16:32:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0dd800a170 con 0x7f0dd8002870 2024-09-10T16:32:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0dec006410 con 0x7f0dd8002870 2024-09-10T16:32:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:32:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:32:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 >> v1:172.21.15.189:6791/0 conn(0x7f0dd8002870 legacy=0x7f0dd8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.029+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 >> v1:172.21.15.189:6791/0 conn(0x7f0dd8002870 legacy=0x7f0dd8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.033+0000 7f0df85cf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:32:47.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0df85cf640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0dd8009e80 con 0x7f0dd8009140 2024-09-10T16:32:47.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 330084687 0 0) 0x7f0dd8009e80 con 0x7f0dd8009140 2024-09-10T16:32:47.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:32:47.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:32:47.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:32:47.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 10 monclient(hunting): my global_id is 5162 2024-09-10T16:32:47.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dd80065d0 con 0x7f0dd8009140 2024-09-10T16:32:47.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1728984854 0 0) 0x7f0dd80065d0 con 0x7f0dd8009140 2024-09-10T16:32:47.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0dd8009e80 con 0x7f0dd8009140 2024-09-10T16:32:47.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0dec005d90 con 0x7f0dd8009140 2024-09-10T16:32:47.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:32:47.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:32:47.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 10 monclient: dump: 2024-09-10T16:32:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:32:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:32:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:32:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:32:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:32:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:32:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:32:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:32:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:32:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:32:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:32:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:32:47.053 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:32:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:32:47.054 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:32:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2243971605 0 0) 0x7f0dd8009e80 con 0x7f0dd8009140 2024-09-10T16:32:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 --> v1:172.21.15.189:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0dd800c420 con 0x7f0dd8009140 2024-09-10T16:32:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7667 (unknown 0 0 2062083451) 0x7f0dec005e80 con 0x7f0dd8009140 2024-09-10T16:32:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:32:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:32:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 >> v1:172.21.15.189:6791/0 conn(0x7f0dd8009140 legacy=0x7f0dd80095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:47.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0de2ffd640 1 -- 172.21.15.81:0/1888844476 >> v1:172.21.15.189:6791/0 conn(0x7f0dd8009140 legacy=0x7f0dd80095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:32:47.054 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:32:47.055 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:47.055 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:47.055 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:32:47.055 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 28, 2024-09-10T16:32:47.055 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 176962, 2024-09-10T16:32:47.055 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:32:47.055 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:32:47.055 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:32:47.055 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:32:47.055 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:32:47.055 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:32:47.055 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:47.055 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 6, 2024-09-10T16:32:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:32:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:32:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:47.056 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:47.057 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:47.057 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:47.057 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:32:47.057 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:32:47.057 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:47.057 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:47.057 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:47.057 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:47.057 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:47.057 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:47.057 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:47.057 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:47.057 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:47.058 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:47.058 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:47.058 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:47.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.058 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:32:47.058 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:32:47.058 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:32:47.058 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:32:47.058 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:32:47.058 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:32:47.058 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:47.058 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:32:47.058 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:32:47.058 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:32:47.059 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:32:47.059 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:32:47.059 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:32:47.059 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:32:47.059 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:32:47.059 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:32:47.059 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:32:47.059 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:32:47.059 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:32:47.059 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:32:47.059 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:32:47.059 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:32:47.059 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:32:47.060 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:32:47.060 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:32:47.060 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:32:47.060 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:32:47.060 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:32:47.060 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:47.060 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:32:47.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.060 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:32:47.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.060 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:32:47.060 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:32:47.060 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:47.061 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:47.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.061 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:47.061 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:32:47.061 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:47.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:47.061 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:47.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.061 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:32:47.061 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:32:47.061 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:47.061 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:47.061 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:47.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.062 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:32:47.062 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:32:47.062 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:47.062 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:47.062 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:47.062 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:32:47.062 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:47.062 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:47.062 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:47.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.062 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:32:47.063 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:32:47.063 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:47.063 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:47.063 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:47.063 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.063 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:32:47.063 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:32:47.063 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:47.063 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:47.063 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.063 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:47.063 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:32:47.063 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:47.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:47.064 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:47.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.064 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:32:47.064 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:32:47.064 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:47.064 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:47.064 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:47.064 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.064 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:32:47.064 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:32:47.064 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:47.065 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:47.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.065 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:47.065 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:32:47.065 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:47.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:47.065 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:47.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.065 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:32:47.065 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:32:47.065 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:47.065 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:47.065 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:47.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.066 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:32:47.066 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:32:47.066 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:47.066 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:47.066 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:47.066 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:32:47.066 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:47.066 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:47.066 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:47.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:32:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:32:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:32:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:32:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:47.067 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:32:47.068 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:47.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:47.068 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:47.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.068 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:32:47.068 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:32:47.068 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:47.068 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:47.068 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:47.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.068 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:32:47.069 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:32:47.069 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:47.069 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:47.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:47.069 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:32:47.069 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:47.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:47.069 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:47.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.070 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:32:47.070 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:32:47.070 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:47.070 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:47.070 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:47.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.070 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:32:47.070 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:32:47.070 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:47.071 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:47.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:47.071 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:32:47.071 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:47.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:47.071 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:47.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.071 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:32:47.071 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:32:47.071 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:47.071 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:47.071 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:47.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.072 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:32:47.072 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:32:47.072 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:32:47.072 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:32:47.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.072 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:32:47.072 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:32:47.072 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:32:47.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:47.072 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:47.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.073 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:32:47.073 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:32:47.073 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:32:47.073 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:32:47.073 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:32:47.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:47.073 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:47.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.073 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:32:47.073 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:32:47.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.073 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:47.073 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:47.074 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:47.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:47.074 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:47.074 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:32:47.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.074 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:47.074 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:47.074 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:47.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:47.074 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:32:47.074 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:32:47.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:32:47.074 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:32:47.075 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:32:47.075 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:32:47.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:32:47.075 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:32:47.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:32:47.075 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:32:47.075 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:32:47.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0df85cf640 1 -- 172.21.15.81:0/1888844476 >> v1:172.21.15.189:6812/1108603242 conn(0x7f0dd403d410 legacy=0x7f0dd403f8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:47.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0df85cf640 10 monclient: shutdown 2024-09-10T16:32:47.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0df85cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:32:47.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0df85cf640 1 -- 172.21.15.81:0/1888844476 >> v1:172.21.15.189:6790/0 conn(0x7f0df00a5b00 legacy=0x7f0df01d5820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:32:47.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0df6b6c640 1 -- 172.21.15.81:0/1888844476 reap_dead start 2024-09-10T16:32:47.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0df6b6c640 1 -- 172.21.15.81:0/1888844476 reap_dead start 2024-09-10T16:32:47.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0df85cf640 1 -- 172.21.15.81:0/1888844476 shutdown_connections 2024-09-10T16:32:47.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0df85cf640 1 -- 172.21.15.81:0/1888844476 >> 172.21.15.81:0/1888844476 conn(0x7f0df006dc90 msgr2=0x7f0df0138760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:32:47.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0df85cf640 1 -- 172.21.15.81:0/1888844476 shutdown_connections 2024-09-10T16:32:47.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:32:47.037+0000 7f0df85cf640 1 -- 172.21.15.81:0/1888844476 wait complete. 2024-09-10T16:32:47.077 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-10T16:32:47.077 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-09-10T16:32:47.234 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:47.234 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29867]: starting. 2024-09-10T16:32:47.235 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29867]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29832 2024-09-10T16:32:47.235 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29867]: created object 0... 2024-09-10T16:32:47.235 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29867]: created object 25... 2024-09-10T16:32:47.235 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29867]: created object 49... 2024-09-10T16:32:47.235 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29867]: finishing. 2024-09-10T16:32:47.235 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29867]: shutting down. 2024-09-10T16:32:47.257 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:47.257 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29869]: starting. 2024-09-10T16:32:47.257 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29869]: listing objects. 2024-09-10T16:32:47.257 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29869]: listed object 0... 2024-09-10T16:32:47.257 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29869]: listed object 25... 2024-09-10T16:32:47.257 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29869]: saw 50 objects 2024-09-10T16:32:47.257 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29869]: shutting down. 2024-09-10T16:32:48.106 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:48.106 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29868]: starting. 2024-09-10T16:32:48.106 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29868]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29832 2024-09-10T16:32:48.106 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29868]: shutting down. 2024-09-10T16:32:48.107 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:48.107 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:48.107 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:32:48.110 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:32:50.325 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29920]: starting. 2024-09-10T16:32:50.325 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29920]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29919 2024-09-10T16:32:50.325 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29920]: created object 0... 2024-09-10T16:32:50.325 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29920]: created object 25... 2024-09-10T16:32:50.325 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29920]: created object 49... 2024-09-10T16:32:50.325 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29920]: finishing. 2024-09-10T16:32:50.325 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[29920]: shutting down. 2024-09-10T16:32:51.162 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29921]: starting. 2024-09-10T16:32:51.163 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29921]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29919 2024-09-10T16:32:51.164 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[29921]: shutting down. 2024-09-10T16:32:53.359 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:53.359 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29954]: starting. 2024-09-10T16:32:53.360 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29954]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-29919 2024-09-10T16:32:53.360 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29954]: created object 0... 2024-09-10T16:32:53.360 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29954]: created object 25... 2024-09-10T16:32:53.360 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29954]: created object 49... 2024-09-10T16:32:53.360 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29954]: finishing. 2024-09-10T16:32:53.360 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[29954]: shutting down. 2024-09-10T16:32:53.385 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:53.385 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29956]: starting. 2024-09-10T16:32:53.385 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29956]: listing objects. 2024-09-10T16:32:53.385 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29956]: listed object 0... 2024-09-10T16:32:53.385 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29956]: listed object 25... 2024-09-10T16:32:53.386 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29956]: saw 50 objects 2024-09-10T16:32:53.386 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[29956]: shutting down. 2024-09-10T16:32:54.187 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:54.188 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29955]: starting. 2024-09-10T16:32:54.188 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29955]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-29919 2024-09-10T16:32:54.188 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[29955]: shutting down. 2024-09-10T16:32:54.191 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:54.191 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:54.191 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:32:54.194 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:32:56.263 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30007]: starting. 2024-09-10T16:32:56.263 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30007]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30006 2024-09-10T16:32:56.263 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30007]: created object 0... 2024-09-10T16:32:56.263 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30007]: created object 25... 2024-09-10T16:32:56.263 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30007]: created object 49... 2024-09-10T16:32:56.264 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30007]: finishing. 2024-09-10T16:32:56.264 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30007]: shutting down. 2024-09-10T16:32:57.104 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30008]: starting. 2024-09-10T16:32:57.104 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30008]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30006 2024-09-10T16:32:57.104 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30008]: shutting down. 2024-09-10T16:32:59.280 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:59.280 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30041]: starting. 2024-09-10T16:32:59.280 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30041]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30006 2024-09-10T16:32:59.280 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30041]: created object 0... 2024-09-10T16:32:59.280 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30041]: created object 25... 2024-09-10T16:32:59.280 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30041]: created object 49... 2024-09-10T16:32:59.281 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30041]: finishing. 2024-09-10T16:32:59.281 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30041]: shutting down. 2024-09-10T16:32:59.306 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:32:59.306 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30043]: starting. 2024-09-10T16:32:59.306 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30043]: listing objects. 2024-09-10T16:32:59.306 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30043]: listed object 0... 2024-09-10T16:32:59.306 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30043]: listed object 25... 2024-09-10T16:32:59.306 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30043]: saw 50 objects 2024-09-10T16:32:59.306 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30043]: shutting down. 2024-09-10T16:33:00.123 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:00.124 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30042]: starting. 2024-09-10T16:33:00.124 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30042]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30006 2024-09-10T16:33:00.124 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30042]: shutting down. 2024-09-10T16:33:00.130 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:00.130 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:00.130 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:33:00.130 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:33:02.320 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30094]: starting. 2024-09-10T16:33:02.320 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30094]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30093 2024-09-10T16:33:02.320 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30094]: created object 0... 2024-09-10T16:33:02.320 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30094]: created object 25... 2024-09-10T16:33:02.320 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30094]: created object 49... 2024-09-10T16:33:02.320 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30094]: finishing. 2024-09-10T16:33:02.320 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30094]: shutting down. 2024-09-10T16:33:03.157 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30095]: starting. 2024-09-10T16:33:03.158 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30095]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30093 2024-09-10T16:33:03.158 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30095]: shutting down. 2024-09-10T16:33:05.257 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:05.257 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30128]: starting. 2024-09-10T16:33:05.257 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30128]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30093 2024-09-10T16:33:05.257 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30128]: created object 0... 2024-09-10T16:33:05.257 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30128]: created object 25... 2024-09-10T16:33:05.257 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30128]: created object 49... 2024-09-10T16:33:05.257 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30128]: finishing. 2024-09-10T16:33:05.257 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30128]: shutting down. 2024-09-10T16:33:05.280 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:05.280 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30130]: starting. 2024-09-10T16:33:05.280 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30130]: listing objects. 2024-09-10T16:33:05.281 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30130]: listed object 0... 2024-09-10T16:33:05.281 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30130]: listed object 25... 2024-09-10T16:33:05.281 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30130]: saw 50 objects 2024-09-10T16:33:05.281 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30130]: shutting down. 2024-09-10T16:33:06.096 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:06.096 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30129]: starting. 2024-09-10T16:33:06.096 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30129]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30093 2024-09-10T16:33:06.097 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30129]: shutting down. 2024-09-10T16:33:06.102 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:06.102 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:06.102 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:33:06.102 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:33:08.285 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30181]: starting. 2024-09-10T16:33:08.285 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30181]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30180 2024-09-10T16:33:08.285 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30181]: created object 0... 2024-09-10T16:33:08.286 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30181]: created object 25... 2024-09-10T16:33:08.286 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30181]: created object 49... 2024-09-10T16:33:08.286 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30181]: finishing. 2024-09-10T16:33:08.286 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30181]: shutting down. 2024-09-10T16:33:09.134 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30182]: starting. 2024-09-10T16:33:09.134 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30182]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30180 2024-09-10T16:33:09.134 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30182]: shutting down. 2024-09-10T16:33:11.332 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:11.332 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30215]: starting. 2024-09-10T16:33:11.332 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30215]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30180 2024-09-10T16:33:11.332 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30215]: created object 0... 2024-09-10T16:33:11.332 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30215]: created object 25... 2024-09-10T16:33:11.332 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30215]: created object 49... 2024-09-10T16:33:11.332 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30215]: finishing. 2024-09-10T16:33:11.332 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30215]: shutting down. 2024-09-10T16:33:11.357 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:11.357 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30217]: starting. 2024-09-10T16:33:11.357 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30217]: listing objects. 2024-09-10T16:33:11.357 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30217]: listed object 0... 2024-09-10T16:33:11.357 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30217]: listed object 25... 2024-09-10T16:33:11.357 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30217]: saw 50 objects 2024-09-10T16:33:11.358 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30217]: shutting down. 2024-09-10T16:33:12.183 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:12.183 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30216]: starting. 2024-09-10T16:33:12.184 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30216]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30180 2024-09-10T16:33:12.184 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30216]: shutting down. 2024-09-10T16:33:12.186 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:12.186 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:12.187 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:33:12.190 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:33:14.372 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30268]: starting. 2024-09-10T16:33:14.372 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30268]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30267 2024-09-10T16:33:14.373 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30268]: created object 0... 2024-09-10T16:33:14.373 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30268]: created object 25... 2024-09-10T16:33:14.373 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30268]: created object 49... 2024-09-10T16:33:14.373 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30268]: finishing. 2024-09-10T16:33:14.373 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30268]: shutting down. 2024-09-10T16:33:15.213 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30269]: starting. 2024-09-10T16:33:15.213 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30269]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30267 2024-09-10T16:33:15.213 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30269]: shutting down. 2024-09-10T16:33:17.418 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:17.418 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30302]: starting. 2024-09-10T16:33:17.418 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30302]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30267 2024-09-10T16:33:17.419 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30302]: created object 0... 2024-09-10T16:33:17.419 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30302]: created object 25... 2024-09-10T16:33:17.419 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30302]: created object 49... 2024-09-10T16:33:17.419 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30302]: finishing. 2024-09-10T16:33:17.419 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30302]: shutting down. 2024-09-10T16:33:17.444 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:17.445 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30304]: starting. 2024-09-10T16:33:17.445 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30304]: listing objects. 2024-09-10T16:33:17.445 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30304]: listed object 0... 2024-09-10T16:33:17.445 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30304]: listed object 25... 2024-09-10T16:33:17.445 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30304]: saw 50 objects 2024-09-10T16:33:17.445 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30304]: shutting down. 2024-09-10T16:33:18.244 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:18.244 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30303]: starting. 2024-09-10T16:33:18.244 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30303]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30267 2024-09-10T16:33:18.244 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30303]: shutting down. 2024-09-10T16:33:18.248 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:18.248 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:18.248 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:33:18.252 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:33:20.279 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30355]: starting. 2024-09-10T16:33:20.279 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30355]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30354 2024-09-10T16:33:20.279 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30355]: created object 0... 2024-09-10T16:33:20.279 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30355]: created object 25... 2024-09-10T16:33:20.279 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30355]: created object 49... 2024-09-10T16:33:20.279 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30355]: finishing. 2024-09-10T16:33:20.279 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30355]: shutting down. 2024-09-10T16:33:21.117 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30356]: starting. 2024-09-10T16:33:21.118 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30356]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30354 2024-09-10T16:33:21.118 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30356]: shutting down. 2024-09-10T16:33:23.323 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:23.323 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30389]: starting. 2024-09-10T16:33:23.323 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30389]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30354 2024-09-10T16:33:23.323 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30389]: created object 0... 2024-09-10T16:33:23.323 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30389]: created object 25... 2024-09-10T16:33:23.323 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30389]: created object 49... 2024-09-10T16:33:23.323 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30389]: finishing. 2024-09-10T16:33:23.323 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30389]: shutting down. 2024-09-10T16:33:24.183 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:24.183 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30391]: starting. 2024-09-10T16:33:24.183 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30391]: listing objects. 2024-09-10T16:33:24.183 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30391]: listed object 0... 2024-09-10T16:33:24.183 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30391]: listed object 25... 2024-09-10T16:33:24.183 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30391]: saw 50 objects 2024-09-10T16:33:24.183 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30391]: shutting down. 2024-09-10T16:33:25.110 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:25.110 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30390]: starting. 2024-09-10T16:33:25.110 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30390]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30354 2024-09-10T16:33:25.110 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30390]: shutting down. 2024-09-10T16:33:25.112 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:25.112 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:25.112 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:33:25.117 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:33:27.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30442]: starting. 2024-09-10T16:33:27.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30442]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30441 2024-09-10T16:33:27.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30442]: created object 0... 2024-09-10T16:33:27.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30442]: created object 25... 2024-09-10T16:33:27.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30442]: created object 49... 2024-09-10T16:33:27.340 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30442]: finishing. 2024-09-10T16:33:27.340 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30442]: shutting down. 2024-09-10T16:33:28.191 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30443]: starting. 2024-09-10T16:33:28.191 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30443]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30441 2024-09-10T16:33:28.191 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30443]: shutting down. 2024-09-10T16:33:30.403 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:30.403 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30476]: starting. 2024-09-10T16:33:30.403 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30476]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30441 2024-09-10T16:33:30.403 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30476]: created object 0... 2024-09-10T16:33:30.403 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30476]: created object 25... 2024-09-10T16:33:30.403 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30476]: created object 49... 2024-09-10T16:33:30.403 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30476]: finishing. 2024-09-10T16:33:30.404 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30476]: shutting down. 2024-09-10T16:33:30.428 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:30.429 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30478]: starting. 2024-09-10T16:33:30.429 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30478]: listing objects. 2024-09-10T16:33:30.429 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30478]: listed object 0... 2024-09-10T16:33:30.429 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30478]: listed object 25... 2024-09-10T16:33:30.429 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30478]: saw 50 objects 2024-09-10T16:33:30.429 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30478]: shutting down. 2024-09-10T16:33:31.240 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:31.240 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30477]: starting. 2024-09-10T16:33:31.240 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30477]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30441 2024-09-10T16:33:31.240 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30477]: shutting down. 2024-09-10T16:33:31.242 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:31.243 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:31.243 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:33:31.245 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:33:33.444 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30530]: starting. 2024-09-10T16:33:33.444 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30530]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30529 2024-09-10T16:33:33.444 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30530]: created object 0... 2024-09-10T16:33:33.444 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30530]: created object 25... 2024-09-10T16:33:33.444 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30530]: created object 49... 2024-09-10T16:33:33.444 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30530]: finishing. 2024-09-10T16:33:33.444 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30530]: shutting down. 2024-09-10T16:33:34.266 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30531]: starting. 2024-09-10T16:33:34.266 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30531]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30529 2024-09-10T16:33:34.266 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30531]: shutting down. 2024-09-10T16:33:36.288 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:36.288 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30564]: starting. 2024-09-10T16:33:36.289 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30564]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30529 2024-09-10T16:33:36.289 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30564]: created object 0... 2024-09-10T16:33:36.289 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30564]: created object 25... 2024-09-10T16:33:36.289 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30564]: created object 49... 2024-09-10T16:33:36.289 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30564]: finishing. 2024-09-10T16:33:36.289 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30564]: shutting down. 2024-09-10T16:33:36.315 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:36.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30566]: starting. 2024-09-10T16:33:36.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30566]: listing objects. 2024-09-10T16:33:36.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30566]: listed object 0... 2024-09-10T16:33:36.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30566]: listed object 25... 2024-09-10T16:33:36.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30566]: saw 50 objects 2024-09-10T16:33:36.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30566]: shutting down. 2024-09-10T16:33:37.120 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:37.120 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30565]: starting. 2024-09-10T16:33:37.121 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30565]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30529 2024-09-10T16:33:37.121 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30565]: shutting down. 2024-09-10T16:33:37.123 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:37.124 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:37.124 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:33:37.130 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:33:39.314 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30617]: starting. 2024-09-10T16:33:39.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30617]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30616 2024-09-10T16:33:39.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30617]: created object 0... 2024-09-10T16:33:39.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30617]: created object 25... 2024-09-10T16:33:39.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30617]: created object 49... 2024-09-10T16:33:39.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30617]: finishing. 2024-09-10T16:33:39.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30617]: shutting down. 2024-09-10T16:33:40.136 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30618]: starting. 2024-09-10T16:33:40.136 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30618]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30616 2024-09-10T16:33:40.136 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30618]: shutting down. 2024-09-10T16:33:42.345 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:42.345 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30651]: starting. 2024-09-10T16:33:42.345 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30651]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30616 2024-09-10T16:33:42.345 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30651]: created object 0... 2024-09-10T16:33:42.345 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30651]: created object 25... 2024-09-10T16:33:42.345 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30651]: created object 49... 2024-09-10T16:33:42.345 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30651]: finishing. 2024-09-10T16:33:42.346 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30651]: shutting down. 2024-09-10T16:33:42.374 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:42.374 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30653]: starting. 2024-09-10T16:33:42.374 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30653]: listing objects. 2024-09-10T16:33:42.375 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30653]: listed object 0... 2024-09-10T16:33:42.375 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30653]: listed object 25... 2024-09-10T16:33:42.375 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30653]: saw 50 objects 2024-09-10T16:33:42.375 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30653]: shutting down. 2024-09-10T16:33:43.174 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:43.174 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30652]: starting. 2024-09-10T16:33:43.174 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30652]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30616 2024-09-10T16:33:43.174 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30652]: shutting down. 2024-09-10T16:33:43.177 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:43.177 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:43.177 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:33:43.181 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:33:45.285 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30704]: starting. 2024-09-10T16:33:45.286 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30704]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30703 2024-09-10T16:33:45.286 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30704]: created object 0... 2024-09-10T16:33:45.286 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30704]: created object 25... 2024-09-10T16:33:45.286 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30704]: created object 49... 2024-09-10T16:33:45.286 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30704]: finishing. 2024-09-10T16:33:45.286 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30704]: shutting down. 2024-09-10T16:33:46.118 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30705]: starting. 2024-09-10T16:33:46.118 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30705]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30703 2024-09-10T16:33:46.118 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30705]: shutting down. 2024-09-10T16:33:48.283 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:48.284 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30738]: starting. 2024-09-10T16:33:48.284 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30738]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30703 2024-09-10T16:33:48.284 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30738]: created object 0... 2024-09-10T16:33:48.284 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30738]: created object 25... 2024-09-10T16:33:48.284 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30738]: created object 49... 2024-09-10T16:33:48.284 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30738]: finishing. 2024-09-10T16:33:48.284 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30738]: shutting down. 2024-09-10T16:33:48.308 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:48.309 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30740]: starting. 2024-09-10T16:33:48.309 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30740]: listing objects. 2024-09-10T16:33:48.309 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30740]: listed object 0... 2024-09-10T16:33:48.309 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30740]: listed object 25... 2024-09-10T16:33:48.309 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30740]: saw 50 objects 2024-09-10T16:33:48.309 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30740]: shutting down. 2024-09-10T16:33:49.127 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:49.127 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30739]: starting. 2024-09-10T16:33:49.127 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30739]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30703 2024-09-10T16:33:49.127 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30739]: shutting down. 2024-09-10T16:33:49.130 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:49.130 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:49.131 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:33:49.135 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:33:51.367 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30791]: starting. 2024-09-10T16:33:51.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30791]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30790 2024-09-10T16:33:51.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30791]: created object 0... 2024-09-10T16:33:51.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30791]: created object 25... 2024-09-10T16:33:51.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30791]: created object 49... 2024-09-10T16:33:51.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30791]: finishing. 2024-09-10T16:33:51.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30791]: shutting down. 2024-09-10T16:33:52.194 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30792]: starting. 2024-09-10T16:33:52.194 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30792]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30790 2024-09-10T16:33:52.194 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30792]: shutting down. 2024-09-10T16:33:54.395 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:54.396 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30825]: starting. 2024-09-10T16:33:54.396 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30825]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30790 2024-09-10T16:33:54.396 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30825]: created object 0... 2024-09-10T16:33:54.396 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30825]: created object 25... 2024-09-10T16:33:54.396 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30825]: created object 49... 2024-09-10T16:33:54.396 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30825]: finishing. 2024-09-10T16:33:54.396 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30825]: shutting down. 2024-09-10T16:33:54.420 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:54.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30827]: starting. 2024-09-10T16:33:54.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30827]: listing objects. 2024-09-10T16:33:54.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30827]: listed object 0... 2024-09-10T16:33:54.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30827]: listed object 25... 2024-09-10T16:33:54.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30827]: saw 50 objects 2024-09-10T16:33:54.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30827]: shutting down. 2024-09-10T16:33:55.122 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:55.122 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30826]: starting. 2024-09-10T16:33:55.122 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30826]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30790 2024-09-10T16:33:55.122 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30826]: shutting down. 2024-09-10T16:33:55.126 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:55.126 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:33:55.126 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:33:55.132 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:33:57.318 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30878]: starting. 2024-09-10T16:33:57.318 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30878]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30877 2024-09-10T16:33:57.318 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30878]: created object 0... 2024-09-10T16:33:57.318 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30878]: created object 25... 2024-09-10T16:33:57.318 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30878]: created object 49... 2024-09-10T16:33:57.319 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30878]: finishing. 2024-09-10T16:33:57.319 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30878]: shutting down. 2024-09-10T16:33:58.156 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30879]: starting. 2024-09-10T16:33:58.156 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30879]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30877 2024-09-10T16:33:58.156 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30879]: shutting down. 2024-09-10T16:34:00.303 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:00.304 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30912]: starting. 2024-09-10T16:34:00.304 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30912]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30877 2024-09-10T16:34:00.304 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30912]: created object 0... 2024-09-10T16:34:00.304 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30912]: created object 25... 2024-09-10T16:34:00.304 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30912]: created object 49... 2024-09-10T16:34:00.304 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30912]: finishing. 2024-09-10T16:34:00.304 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30912]: shutting down. 2024-09-10T16:34:00.332 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:00.332 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30914]: starting. 2024-09-10T16:34:00.333 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30914]: listing objects. 2024-09-10T16:34:00.333 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30914]: listed object 0... 2024-09-10T16:34:00.333 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30914]: listed object 25... 2024-09-10T16:34:00.333 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30914]: saw 50 objects 2024-09-10T16:34:00.333 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[30914]: shutting down. 2024-09-10T16:34:01.185 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:01.185 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30913]: starting. 2024-09-10T16:34:01.185 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30913]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30877 2024-09-10T16:34:01.185 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[30913]: shutting down. 2024-09-10T16:34:01.190 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:01.190 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:01.190 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:34:01.192 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:34:03.362 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30965]: starting. 2024-09-10T16:34:03.362 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30965]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30964 2024-09-10T16:34:03.362 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30965]: created object 0... 2024-09-10T16:34:03.362 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30965]: created object 25... 2024-09-10T16:34:03.362 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30965]: created object 49... 2024-09-10T16:34:03.363 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30965]: finishing. 2024-09-10T16:34:03.363 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[30965]: shutting down. 2024-09-10T16:34:05.127 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30966]: starting. 2024-09-10T16:34:05.127 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30966]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30964 2024-09-10T16:34:05.127 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[30966]: shutting down. 2024-09-10T16:34:07.324 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:07.324 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30999]: starting. 2024-09-10T16:34:07.324 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30999]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-30964 2024-09-10T16:34:07.324 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30999]: created object 0... 2024-09-10T16:34:07.324 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30999]: created object 25... 2024-09-10T16:34:07.324 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30999]: created object 49... 2024-09-10T16:34:07.324 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30999]: finishing. 2024-09-10T16:34:07.325 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[30999]: shutting down. 2024-09-10T16:34:07.352 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:07.353 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31001]: starting. 2024-09-10T16:34:07.353 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31001]: listing objects. 2024-09-10T16:34:07.353 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31001]: listed object 0... 2024-09-10T16:34:07.353 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31001]: listed object 25... 2024-09-10T16:34:07.353 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31001]: saw 50 objects 2024-09-10T16:34:07.353 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31001]: shutting down. 2024-09-10T16:34:08.156 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:08.156 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31000]: starting. 2024-09-10T16:34:08.156 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31000]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-30964 2024-09-10T16:34:08.156 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31000]: shutting down. 2024-09-10T16:34:08.159 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:08.159 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:08.159 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:34:08.161 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:34:10.365 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31053]: starting. 2024-09-10T16:34:10.365 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31053]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31052 2024-09-10T16:34:10.365 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31053]: created object 0... 2024-09-10T16:34:10.365 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31053]: created object 25... 2024-09-10T16:34:10.365 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31053]: created object 49... 2024-09-10T16:34:10.365 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31053]: finishing. 2024-09-10T16:34:10.365 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31053]: shutting down. 2024-09-10T16:34:11.217 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31054]: starting. 2024-09-10T16:34:11.217 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31054]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31052 2024-09-10T16:34:11.217 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31054]: shutting down. 2024-09-10T16:34:13.393 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:13.393 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31087]: starting. 2024-09-10T16:34:13.393 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31087]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31052 2024-09-10T16:34:13.393 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31087]: created object 0... 2024-09-10T16:34:13.393 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31087]: created object 25... 2024-09-10T16:34:13.393 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31087]: created object 49... 2024-09-10T16:34:13.393 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31087]: finishing. 2024-09-10T16:34:13.394 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31087]: shutting down. 2024-09-10T16:34:13.420 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:13.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31089]: starting. 2024-09-10T16:34:13.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31089]: listing objects. 2024-09-10T16:34:13.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31089]: listed object 0... 2024-09-10T16:34:13.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31089]: listed object 25... 2024-09-10T16:34:13.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31089]: saw 50 objects 2024-09-10T16:34:13.421 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31089]: shutting down. 2024-09-10T16:34:14.236 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:14.236 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31088]: starting. 2024-09-10T16:34:14.236 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31088]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31052 2024-09-10T16:34:14.236 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31088]: shutting down. 2024-09-10T16:34:14.240 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:14.240 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:14.240 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:34:14.243 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:34:16.302 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31140]: starting. 2024-09-10T16:34:16.303 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31140]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31139 2024-09-10T16:34:16.303 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31140]: created object 0... 2024-09-10T16:34:16.303 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31140]: created object 25... 2024-09-10T16:34:16.303 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31140]: created object 49... 2024-09-10T16:34:16.303 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31140]: finishing. 2024-09-10T16:34:16.303 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31140]: shutting down. 2024-09-10T16:34:17.078 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.c 2024-09-10T16:34:17.078 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-10T16:34:17.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-10T16:34:17.081 INFO:tasks.ceph.mon.c:Started 2024-09-10T16:34:17.081 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.d 2024-09-10T16:34:17.081 INFO:tasks.ceph.mon.d:Restarting daemon 2024-09-10T16:34:17.082 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i d 2024-09-10T16:34:17.084 INFO:tasks.ceph.mon.d:Started 2024-09-10T16:34:17.084 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.b 2024-09-10T16:34:17.084 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-10T16:34:17.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-10T16:34:17.086 INFO:tasks.ceph.mon.b:Started 2024-09-10T16:34:17.087 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2024-09-10T16:34:17.087 INFO:tasks.ceph.mon.i:Restarting daemon 2024-09-10T16:34:17.087 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-09-10T16:34:17.089 INFO:tasks.ceph.mon.i:Started 2024-09-10T16:34:17.089 INFO:tasks.mon_thrash:Sending STOP to mon g 2024-09-10T16:34:17.090 INFO:tasks.ceph.mon.g:Sent signal 19 2024-09-10T16:34:17.090 INFO:tasks.mon_thrash.mon_thrasher:waiting for 15.0 secs to unfreeze mons 2024-09-10T16:34:27.280 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31141]: starting. 2024-09-10T16:34:27.280 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31141]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31139 2024-09-10T16:34:27.281 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31141]: shutting down. 2024-09-10T16:34:29.517 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:29.517 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31216]: starting. 2024-09-10T16:34:29.517 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31216]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31139 2024-09-10T16:34:29.518 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31216]: created object 0... 2024-09-10T16:34:29.518 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31216]: created object 25... 2024-09-10T16:34:29.518 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31216]: created object 49... 2024-09-10T16:34:29.518 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31216]: finishing. 2024-09-10T16:34:29.518 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31216]: shutting down. 2024-09-10T16:34:29.543 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:29.544 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31218]: starting. 2024-09-10T16:34:29.544 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31218]: listing objects. 2024-09-10T16:34:29.544 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31218]: listed object 0... 2024-09-10T16:34:29.544 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31218]: listed object 25... 2024-09-10T16:34:29.544 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31218]: saw 50 objects 2024-09-10T16:34:29.544 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31218]: shutting down. 2024-09-10T16:34:30.367 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:30.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31217]: starting. 2024-09-10T16:34:30.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31217]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31139 2024-09-10T16:34:30.368 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31217]: shutting down. 2024-09-10T16:34:30.371 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:30.371 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:30.372 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:34:30.375 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:34:32.091 INFO:tasks.mon_thrash:Sending CONT to mon g 2024-09-10T16:34:32.092 INFO:tasks.ceph.mon.g:Sent signal 18 2024-09-10T16:34:32.092 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-10T16:34:32.092 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T16:34:32.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.232+0000 7f47f7231640 10 monclient: get_monmap_and_config 2024-09-10T16:34:32.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.232+0000 7f47f7231640 10 monclient: build_initial_monmap 2024-09-10T16:34:32.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.232+0000 7f47f7231640 10 monclient: monmap: 2024-09-10T16:34:32.235 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:32.235956+0000 2024-09-10T16:34:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:32.235956+0000 2024-09-10T16:34:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:32.236 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:32.237 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:32.237 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.232+0000 7f47f7231640 1 Processor -- start 2024-09-10T16:34:32.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.232+0000 7f47f7231640 1 -- start start 2024-09-10T16:34:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.232+0000 7f47f7231640 10 monclient: init 2024-09-10T16:34:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient: _add_conns ranks=[1,0,5,8,3,2,6,4,7] 2024-09-10T16:34:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient(hunting): picked mon.noname-f con 0x7f47f013d4e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient(hunting): picked mon.noname-a con 0x7f47f013d090 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient(hunting): picked mon.noname-h con 0x7f47f0143ad0 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f00a4400 con 0x7f47f013d090 2024-09-10T16:34:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f009cf90 con 0x7f47f013d4e0 2024-09-10T16:34:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f009d9c0 con 0x7f47f0143ad0 2024-09-10T16:34:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:32.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient(hunting): authenticate will time out at 1239.636502s 2024-09-10T16:34:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47effff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f47f013d090 0x7f47f01423b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53018/0 (socket says 172.21.15.81:53018) 2024-09-10T16:34:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47effff640 1 -- 172.21.15.81:0/63051330 learned_addr learned my addr 172.21.15.81:0/63051330 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 1 -- 172.21.15.81:0/63051330 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 548444343 0 0) 0x7f47f00a4400 con 0x7f47f013d090 2024-09-10T16:34:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient(hunting): my global_id is 5715 2024-09-10T16:34:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 1 -- 172.21.15.81:0/63051330 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47e0003530 con 0x7f47f013d090 2024-09-10T16:34:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 1 -- 172.21.15.81:0/63051330 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1737983253 0 0) 0x7f47e0003530 con 0x7f47f013d090 2024-09-10T16:34:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 1 -- 172.21.15.81:0/63051330 >> v1:172.21.15.189:6791/0 conn(0x7f47f0143ad0 legacy=0x7f47f0145ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 1 -- 172.21.15.81:0/63051330 >> v1:172.21.15.189:6789/0 conn(0x7f47f013d4e0 legacy=0x7f47f013d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:34:32.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 1 monclient: found mon.noname-a 2024-09-10T16:34:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:34:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 1 -- 172.21.15.81:0/63051330 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f009dca0 con 0x7f47f013d090 2024-09-10T16:34:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient: _finish_auth 0 2024-09-10T16:34:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:34:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 1 -- 172.21.15.81:0/63051330 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f47dc001840 con 0x7f47f013d090 2024-09-10T16:34:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:34:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient: dump: 2024-09-10T16:34:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.242 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.243 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 5 monclient: authenticate success, global_id 5715 2024-09-10T16:34:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 1 -- 172.21.15.81:0/63051330 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47dc001a60 con 0x7f47f013d090 2024-09-10T16:34:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 1 -- 172.21.15.81:0/63051330 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f47dc004bf0 con 0x7f47f013d090 2024-09-10T16:34:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:34:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47ef7fe640 10 monclient: dump: 2024-09-10T16:34:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.244 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.245 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 4 set_mon_vals no callback set 2024-09-10T16:34:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient: shutdown 2024-09-10T16:34:32.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 1 -- 172.21.15.81:0/63051330 >> v1:172.21.15.81:6789/0 conn(0x7f47f013d090 legacy=0x7f47f01423b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 1 -- 172.21.15.81:0/63051330 shutdown_connections 2024-09-10T16:34:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 1 -- 172.21.15.81:0/63051330 >> 172.21.15.81:0/63051330 conn(0x7f47f00a80e0 msgr2=0x7f47f00a84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 1 -- 172.21.15.81:0/63051330 shutdown_connections 2024-09-10T16:34:32.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 1 -- 172.21.15.81:0/63051330 wait complete. 2024-09-10T16:34:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient: build_initial_monmap 2024-09-10T16:34:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient: monmap: 2024-09-10T16:34:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:32.250 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:32.251 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 1 Processor -- start 2024-09-10T16:34:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 1 -- start start 2024-09-10T16:34:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient: init 2024-09-10T16:34:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient: _add_conns ranks=[7,4,2,6,1,3,5,0,8] 2024-09-10T16:34:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient(hunting): picked mon.noname-i con 0x7f47f013d090 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:32.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient(hunting): picked mon.noname-c con 0x7f47f013d4e0 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient(hunting): picked mon.noname-b con 0x7f47f0143ad0 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f00a6e10 con 0x7f47f0143ad0 2024-09-10T16:34:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f013c9c0 con 0x7f47f013d4e0 2024-09-10T16:34:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47f013ef70 con 0x7f47f013d090 2024-09-10T16:34:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f7231640 10 monclient(hunting): authenticate will time out at 1239.639817s 2024-09-10T16:34:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47effff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f47f013d4e0 0x7f47f013e860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:46046/0 (socket says 172.21.15.81:46046) 2024-09-10T16:34:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47f57ce640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f47f0143ad0 0x7f47f01da130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:40282/0 (socket says 172.21.15.81:40282) 2024-09-10T16:34:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.236+0000 7f47effff640 1 -- 172.21.15.81:0/127247217 learned_addr learned my addr 172.21.15.81:0/127247217 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 465580106 0 0) 0x7f47f009d9c0 con 0x7f47f0143ad0 2024-09-10T16:34:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): my global_id is 144128 2024-09-10T16:34:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47d4003530 con 0x7f47f0143ad0 2024-09-10T16:34:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 134427753 0 0) 0x7f47f013c9c0 con 0x7f47f013d4e0 2024-09-10T16:34:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): my global_id is 144112 2024-09-10T16:34:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47f009d9c0 con 0x7f47f013d4e0 2024-09-10T16:34:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 222799523 0 0) 0x7f47f013ef70 con 0x7f47f013d090 2024-09-10T16:34:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): my global_id is 144115 2024-09-10T16:34:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f47f013c9c0 con 0x7f47f013d090 2024-09-10T16:34:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 201617669 0 0) 0x7f47d4003530 con 0x7f47f0143ad0 2024-09-10T16:34:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47f013ef70 con 0x7f47f0143ad0 2024-09-10T16:34:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f47e8001d40 con 0x7f47f0143ad0 2024-09-10T16:34:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): dump: 2024-09-10T16:34:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.254 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.255 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2915484626 0 0) 0x7f47f009d9c0 con 0x7f47f013d4e0 2024-09-10T16:34:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f47d4003530 con 0x7f47f013d4e0 2024-09-10T16:34:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f47dc004b30 con 0x7f47f013d4e0 2024-09-10T16:34:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient(hunting): dump: 2024-09-10T16:34:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.257 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.257 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.257 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.257 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.257 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 912549354 0 0) 0x7f47f013ef70 con 0x7f47f0143ad0 2024-09-10T16:34:32.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 >> v1:172.21.15.189:6792/0 conn(0x7f47f013d090 legacy=0x7f47f013e150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 >> v1:172.21.15.81:6791/0 conn(0x7f47f013d4e0 legacy=0x7f47f013e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient: _finish_hunting 0 2024-09-10T16:34:32.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 monclient: found mon.b 2024-09-10T16:34:32.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47f0140fc0 con 0x7f47f0143ad0 2024-09-10T16:34:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient: _finish_auth 0 2024-09-10T16:34:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient: _check_auth_tickets 2024-09-10T16:34:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47f7231640 5 monclient: authenticate success, global_id 144128 2024-09-10T16:34:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47f7231640 10 monclient: _renew_subs 2024-09-10T16:34:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47f7231640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47f7231640 1 -- 172.21.15.81:0/127247217 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f47f0140370 con 0x7f47f0143ad0 2024-09-10T16:34:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47f7231640 10 monclient: _renew_subs 2024-09-10T16:34:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47f7231640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47f7231640 1 -- 172.21.15.81:0/127247217 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f47f01db850 con 0x7f47f0143ad0 2024-09-10T16:34:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f47e8002000 con 0x7f47f0143ad0 2024-09-10T16:34:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f47e8003f90 con 0x7f47f0143ad0 2024-09-10T16:34:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47eeffd640 4 set_mon_vals no callback set 2024-09-10T16:34:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 10 monclient: dump: 2024-09-10T16:34:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.261 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47f7231640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47f7231640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47f7231640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47f7231640 1 -- 172.21.15.81:0/127247217 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f47d0005090 con 0x7f47f0143ad0 2024-09-10T16:34:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f47e8004130 con 0x7f47f0143ad0 2024-09-10T16:34:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(224..224 src has 121..224) ==== 3898+0+0 (unknown 3925479928 0 0) 0x7f47e804b090 con 0x7f47f0143ad0 2024-09-10T16:34:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.240+0000 7f47f4fcd640 10 monclient: get_auth_request con 0x7f47d403d800 auth_method 0 2024-09-10T16:34:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.244+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f47f00a6e10 con 0x7f47f0143ad0 2024-09-10T16:34:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.244+0000 7f47ed7fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.244+0000 7f47ed7fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:32.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31270]: starting. 2024-09-10T16:34:32.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31270]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31269 2024-09-10T16:34:32.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31270]: created object 0... 2024-09-10T16:34:32.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31270]: created object 25... 2024-09-10T16:34:32.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31270]: created object 49... 2024-09-10T16:34:32.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31270]: finishing. 2024-09-10T16:34:32.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31270]: shutting down. 2024-09-10T16:34:32.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.492+0000 7f47f7231640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-10T16:34:32.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.492+0000 7f47f7231640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-10T16:34:32.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.492+0000 7f47f7231640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:32.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.492+0000 7f47f7231640 1 -- 172.21.15.81:0/127247217 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f47d0005380 con 0x7f47f0143ad0 2024-09-10T16:34:32.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.492+0000 7f47ed7fa640 1 -- 172.21.15.81:0/127247217 <== mon.2 v1:172.21.15.81:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 2919034402) 0x7f47e8016e30 con 0x7f47f0143ad0 2024-09-10T16:34:32.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.492+0000 7f47ed7fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-10T16:34:32.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.492+0000 7f47ed7fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:32.495 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":36,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","modified":"2024-09-10T16:29:22.909160Z","created":"2024-09-10T16:29:22.909160Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6790","nonce":0}]},"addr":"172.21.15.189:6790/0","public_addr":"172.21.15.189:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6791","nonce":0}]},"addr":"172.21.15.81:6791/0","public_addr":"172.21.15.81:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6791","nonce":0}]},"addr":"172.21.15.189:6791/0","public_addr":"172.21.15.189:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6792","nonce":0}]},"addr":"172.21.15.81:6792/0","public_addr":"172.21.15.81:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6792","nonce":0}]},"addr":"172.21.15.189:6792/0","public_addr":"172.21.15.189:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6793","nonce":0}]},"addr":"172.21.15.81:6793/0","public_addr":"172.21.15.81:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T16:34:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.492+0000 7f47f7231640 1 -- 172.21.15.81:0/127247217 >> v1:172.21.15.189:6812/1108603242 conn(0x7f47d403d800 legacy=0x7f47d403fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.492+0000 7f47f7231640 10 monclient: shutdown 2024-09-10T16:34:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.492+0000 7f47f7231640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.492+0000 7f47f7231640 1 -- 172.21.15.81:0/127247217 >> v1:172.21.15.81:6790/0 conn(0x7f47f0143ad0 legacy=0x7f47f01da130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.496+0000 7f47f7231640 1 -- 172.21.15.81:0/127247217 shutdown_connections 2024-09-10T16:34:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.496+0000 7f47f7231640 1 -- 172.21.15.81:0/127247217 >> 172.21.15.81:0/127247217 conn(0x7f47f00a80e0 msgr2=0x7f47f013bec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:32.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.496+0000 7f47f7231640 1 -- 172.21.15.81:0/127247217 shutdown_connections 2024-09-10T16:34:32.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.496+0000 7f47f7231640 1 -- 172.21.15.81:0/127247217 wait complete. 2024-09-10T16:34:32.514 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-10T16:34:32.514 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-10T16:34:32.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T16:34:32.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient: get_monmap_and_config 2024-09-10T16:34:32.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient: build_initial_monmap 2024-09-10T16:34:32.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient: monmap: 2024-09-10T16:34:32.633 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:32.634 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.634 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:32.634161+0000 2024-09-10T16:34:32.634 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:32.634161+0000 2024-09-10T16:34:32.634 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:32.634 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.634 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:32.634 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:32.634 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:32.634 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:32.634 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:32.634 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:32.634 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:32.634 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:32.635 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:32.635 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 1 Processor -- start 2024-09-10T16:34:32.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 1 -- start start 2024-09-10T16:34:32.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient: init 2024-09-10T16:34:32.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:32.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient: _add_conns ranks=[7,6,3,8,4,0,1,5,2] 2024-09-10T16:34:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient(hunting): picked mon.noname-i con 0x7fe98813d400 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient(hunting): picked mon.noname-d con 0x7fe9880a7930 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient(hunting): picked mon.noname-g con 0x7fe9880718d0 addr v1:172.21.15.189:6790/0 2024-09-10T16:34:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe988070e80 con 0x7fe9880718d0 2024-09-10T16:34:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe988070ba0 con 0x7fe9880a7930 2024-09-10T16:34:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9880a54b0 con 0x7fe98813d400 2024-09-10T16:34:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient(hunting): authenticate will time out at 1240.033616s 2024-09-10T16:34:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe985d9b640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fe9880a7930 0x7fe988142310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:36612/0 (socket says 172.21.15.81:36612) 2024-09-10T16:34:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe985d9b640 1 -- 172.21.15.81:0/535489769 learned_addr learned my addr 172.21.15.81:0/535489769 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 1 -- 172.21.15.81:0/535489769 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685307592 0 0) 0x7fe988070ba0 con 0x7fe9880a7930 2024-09-10T16:34:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient(hunting): my global_id is 144114 2024-09-10T16:34:32.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 1 -- 172.21.15.81:0/535489769 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe970003530 con 0x7fe9880a7930 2024-09-10T16:34:32.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 1 -- 172.21.15.81:0/535489769 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2970700845 0 0) 0x7fe970003530 con 0x7fe9880a7930 2024-09-10T16:34:32.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 1 -- 172.21.15.81:0/535489769 >> v1:172.21.15.189:6792/0 conn(0x7fe98813d400 legacy=0x7fe98813d7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 1 -- 172.21.15.81:0/535489769 >> v1:172.21.15.189:6790/0 conn(0x7fe9880718d0 legacy=0x7fe988145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient: _finish_hunting 0 2024-09-10T16:34:32.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 1 monclient: found mon.noname-d 2024-09-10T16:34:32.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:32.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:34:32.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 1 -- 172.21.15.81:0/535489769 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9880a5c20 con 0x7fe9880a7930 2024-09-10T16:34:32.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient: _finish_auth 0 2024-09-10T16:34:32.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient: _check_auth_tickets 2024-09-10T16:34:32.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:32.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 1 -- 172.21.15.81:0/535489769 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fe97c001840 con 0x7fe9880a7930 2024-09-10T16:34:32.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 5 monclient: authenticate success, global_id 144114 2024-09-10T16:34:32.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:32.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:34:32.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient: dump: 2024-09-10T16:34:32.645 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.645 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.645 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.645 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.645 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.645 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.645 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.645 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.646 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.646 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.646 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.646 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.646 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.646 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.646 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.646 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:32.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 1 -- 172.21.15.81:0/535489769 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe97c001a60 con 0x7fe9880a7930 2024-09-10T16:34:32.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:32.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:32.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 4 set_mon_vals no callback set 2024-09-10T16:34:32.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 1 -- 172.21.15.81:0/535489769 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fe97c001d50 con 0x7fe9880a7930 2024-09-10T16:34:32.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:32.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98559a640 10 monclient: dump: 2024-09-10T16:34:32.647 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.647 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.647 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.647 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.647 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.647 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.647 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.647 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.647 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.647 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.647 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.648 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.648 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.648 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.648 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.648 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient: shutdown 2024-09-10T16:34:32.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:32.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 1 -- 172.21.15.81:0/535489769 >> v1:172.21.15.81:6792/0 conn(0x7fe9880a7930 legacy=0x7fe988142310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 1 -- 172.21.15.81:0/535489769 shutdown_connections 2024-09-10T16:34:32.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 1 -- 172.21.15.81:0/535489769 >> 172.21.15.81:0/535489769 conn(0x7fe98806dc90 msgr2=0x7fe9880ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:32.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 1 -- 172.21.15.81:0/535489769 shutdown_connections 2024-09-10T16:34:32.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 1 -- 172.21.15.81:0/535489769 wait complete. 2024-09-10T16:34:32.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient: build_initial_monmap 2024-09-10T16:34:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 10 monclient: monmap: 2024-09-10T16:34:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:32.649 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:32.650 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:32.650 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:32.650 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.632+0000 7fe98c8a5640 1 Processor -- start 2024-09-10T16:34:32.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 1 -- start start 2024-09-10T16:34:32.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 10 monclient: init 2024-09-10T16:34:32.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:32.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 10 monclient: _add_conns ranks=[7,4,8,3,6,1,5,2,0] 2024-09-10T16:34:32.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 10 monclient(hunting): picked mon.noname-i con 0x7fe9880718d0 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:32.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 10 monclient(hunting): picked mon.noname-c con 0x7fe9880a7930 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:32.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 10 monclient(hunting): picked mon.noname-e con 0x7fe98813d400 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:32.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe988141550 con 0x7fe9880a7930 2024-09-10T16:34:32.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe98813f410 con 0x7fe9880718d0 2024-09-10T16:34:32.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe988140060 con 0x7fe98813d400 2024-09-10T16:34:32.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:32.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 10 monclient(hunting): authenticate will time out at 1240.036526s 2024-09-10T16:34:32.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe985d9b640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fe9880a7930 0x7fe98813ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:46058/0 (socket says 172.21.15.81:46058) 2024-09-10T16:34:32.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe985d9b640 1 -- 172.21.15.81:0/209821001 learned_addr learned my addr 172.21.15.81:0/209821001 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:32.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1748486102 0 0) 0x7fe988141550 con 0x7fe9880a7930 2024-09-10T16:34:32.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): my global_id is 144121 2024-09-10T16:34:32.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe968003530 con 0x7fe9880a7930 2024-09-10T16:34:32.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 563147332 0 0) 0x7fe988140060 con 0x7fe98813d400 2024-09-10T16:34:32.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): my global_id is 5804 2024-09-10T16:34:32.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe988141550 con 0x7fe98813d400 2024-09-10T16:34:32.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1668633077 0 0) 0x7fe968003530 con 0x7fe9880a7930 2024-09-10T16:34:32.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe988140060 con 0x7fe9880a7930 2024-09-10T16:34:32.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1495031891 0 0) 0x7fe988141550 con 0x7fe98813d400 2024-09-10T16:34:32.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe968003530 con 0x7fe98813d400 2024-09-10T16:34:32.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2066182090 0 0) 0x7fe98813f410 con 0x7fe9880718d0 2024-09-10T16:34:32.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): my global_id is 144133 2024-09-10T16:34:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe988141550 con 0x7fe9880718d0 2024-09-10T16:34:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fe97c001800 con 0x7fe9880a7930 2024-09-10T16:34:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:34:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): dump: 2024-09-10T16:34:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.653 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.654 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fe9780019e0 con 0x7fe98813d400 2024-09-10T16:34:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): dump: 2024-09-10T16:34:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.656 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.656 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.656 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.656 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.656 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.656 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1408509838 0 0) 0x7fe988140060 con 0x7fe9880a7930 2024-09-10T16:34:32.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 >> v1:172.21.15.81:6793/0 conn(0x7fe98813d400 legacy=0x7fe9881da2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 >> v1:172.21.15.189:6792/0 conn(0x7fe9880718d0 legacy=0x7fe98813e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:34:32.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 monclient: found mon.c 2024-09-10T16:34:32.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:32.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9881423c0 con 0x7fe9880a7930 2024-09-10T16:34:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient: _finish_auth 0 2024-09-10T16:34:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:34:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 5 monclient: authenticate success, global_id 144121 2024-09-10T16:34:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 10 monclient: _renew_subs 2024-09-10T16:34:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fe988141b20 con 0x7fe9880a7930 2024-09-10T16:34:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 10 monclient: _renew_subs 2024-09-10T16:34:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fe988146e20 con 0x7fe9880a7930 2024-09-10T16:34:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fe97c001d10 con 0x7fe9880a7930 2024-09-10T16:34:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fe97c0019e0 con 0x7fe9880a7930 2024-09-10T16:34:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe984d99640 4 set_mon_vals no callback set 2024-09-10T16:34:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient: dump: 2024-09-10T16:34:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.659 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe98c8a5640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe96c0065d0 con 0x7fe96c002870 2024-09-10T16:34:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fe97c011070 con 0x7fe9880a7930 2024-09-10T16:34:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(224..224 src has 121..224) ==== 3898+0+0 (unknown 3925479928 0 0) 0x7fe97c04afa0 con 0x7fe9880a7930 2024-09-10T16:34:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 521238769 0 0) 0x7fe96c0065d0 con 0x7fe96c002870 2024-09-10T16:34:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient(hunting): my global_id is 5724 2024-09-10T16:34:32.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe988140060 con 0x7fe96c002870 2024-09-10T16:34:32.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1246040492 0 0) 0x7fe988140060 con 0x7fe96c002870 2024-09-10T16:34:32.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe96c0065d0 con 0x7fe96c002870 2024-09-10T16:34:32.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fe980001b50 con 0x7fe96c002870 2024-09-10T16:34:32.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:34:32.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient: dump: 2024-09-10T16:34:32.660 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.660 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.662 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe986d9d640 10 monclient: get_auth_request con 0x7fe96803d6e0 auth_method 0 2024-09-10T16:34:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3569657636 0 0) 0x7fe96c0065d0 con 0x7fe96c002870 2024-09-10T16:34:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe96c00a170 con 0x7fe96c002870 2024-09-10T16:34:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fe980001fd0 con 0x7fe96c002870 2024-09-10T16:34:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 >> v1:172.21.15.81:6789/0 conn(0x7fe96c002870 legacy=0x7fe96c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.636+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 >> v1:172.21.15.81:6789/0 conn(0x7fe96c002870 legacy=0x7fe96c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:32.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe98c8a5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:32.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe98c8a5640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fe96c009e80 con 0x7fe96c009140 2024-09-10T16:34:32.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2567473949 0 0) 0x7fe96c009e80 con 0x7fe96c009140 2024-09-10T16:34:32.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 10 monclient(hunting): my global_id is 5733 2024-09-10T16:34:32.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe96c0065d0 con 0x7fe96c009140 2024-09-10T16:34:32.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3487235214 0 0) 0x7fe96c0065d0 con 0x7fe96c009140 2024-09-10T16:34:32.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fe96c009e80 con 0x7fe96c009140 2024-09-10T16:34:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fe980003f50 con 0x7fe96c009140 2024-09-10T16:34:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:34:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 10 monclient: dump: 2024-09-10T16:34:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.665 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.666 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3947730782 0 0) 0x7fe96c009e80 con 0x7fe96c009140 2024-09-10T16:34:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 --> v1:172.21.15.81:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fe96c00c420 con 0x7fe96c009140 2024-09-10T16:34:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7713 (unknown 0 0 2678479397) 0x7fe9800049d0 con 0x7fe96c009140 2024-09-10T16:34:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:32.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 >> v1:172.21.15.81:6789/0 conn(0x7fe96c009140 legacy=0x7fe96c0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe976ffd640 1 -- 172.21.15.81:0/209821001 >> v1:172.21.15.81:6789/0 conn(0x7fe96c009140 legacy=0x7fe96c0095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:32.667 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:32.667 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:32.667 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:32.667 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-09-10T16:34:32.667 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:32.667 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 282593, 2024-09-10T16:34:32.667 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:32.667 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:32.667 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:32.668 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:32.668 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:32.668 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:32.668 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:32.668 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:32.668 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:32.668 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:32.668 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:32.668 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-09-10T16:34:32.668 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:32.668 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:32.668 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:32.668 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:32.669 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:32.669 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:32.669 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:32.669 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:32.669 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:32.669 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:32.669 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:32.669 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:32.669 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:32.669 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:32.669 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:32.669 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:32.669 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:32.670 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:32.670 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:32.670 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:32.670 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:32.670 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:32.670 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:32.670 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:32.670 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:32.670 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:32.670 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:32.670 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:32.670 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.670 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:32.671 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:32.671 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:32.671 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:32.671 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:32.671 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:32.671 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:32.671 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:32.671 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:32.671 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:32.671 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:32.671 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:32.671 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:32.671 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:32.672 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:32.672 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:32.672 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:32.672 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:32.672 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:32.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:32.672 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:32.672 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:32.672 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:32.672 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:32.673 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:32.673 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:32.673 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:32.673 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:32.673 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:32.673 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:32.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.673 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:32.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.673 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:32.673 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:32.673 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.674 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.675 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:32.675 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:32.675 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.675 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.675 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.675 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:32.675 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.676 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.676 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:32.676 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:32.676 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.676 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.676 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.676 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:32.676 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:32.676 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.677 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.677 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:32.677 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.677 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.677 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:32.677 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:32.677 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.677 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.677 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.679 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:32.679 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:32.679 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.679 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.679 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.679 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:32.679 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:32.679 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.679 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.680 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:32.680 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.680 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.680 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:32.680 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:32.680 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.680 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.680 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.680 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:32.680 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:32.681 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.681 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.681 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:32.681 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.681 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.682 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:32.682 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:32.682 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.682 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.682 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.682 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:32.682 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:32.682 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.682 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.682 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.682 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:32.683 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.683 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.683 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:32.683 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:32.683 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.683 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.683 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.683 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:32.683 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:32.683 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.685 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:32.685 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:32.685 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.685 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.685 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.685 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:32.685 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.685 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.685 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:32.686 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:32.686 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.686 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.686 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.686 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.686 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:32.686 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:32.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.686 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:32.686 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:32.686 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:32.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.687 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:32.687 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:34:32.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.687 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:32.687 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:32.687 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:34:32.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.687 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:32.687 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:32.688 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.688 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:32.688 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:32.688 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:32.688 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.688 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.688 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:32.688 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:32.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe98c8a5640 1 -- 172.21.15.81:0/209821001 >> v1:172.21.15.189:6812/1108603242 conn(0x7fe96803d6e0 legacy=0x7fe96803fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe98c8a5640 10 monclient: shutdown 2024-09-10T16:34:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe98c8a5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe98c8a5640 1 -- 172.21.15.81:0/209821001 >> v1:172.21.15.81:6791/0 conn(0x7fe9880a7930 legacy=0x7fe98813ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe986d9d640 1 -- 172.21.15.81:0/209821001 reap_dead start 2024-09-10T16:34:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe986d9d640 1 -- 172.21.15.81:0/209821001 reap_dead start 2024-09-10T16:34:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe98c8a5640 1 -- 172.21.15.81:0/209821001 shutdown_connections 2024-09-10T16:34:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe98c8a5640 1 -- 172.21.15.81:0/209821001 >> 172.21.15.81:0/209821001 conn(0x7fe98806dc90 msgr2=0x7fe98813c980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe98c8a5640 1 -- 172.21.15.81:0/209821001 shutdown_connections 2024-09-10T16:34:32.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.644+0000 7fe98c8a5640 1 -- 172.21.15.81:0/209821001 wait complete. 2024-09-10T16:34:32.690 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:32.691 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-10T16:34:32.691 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T16:34:32.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient: get_monmap_and_config 2024-09-10T16:34:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient: build_initial_monmap 2024-09-10T16:34:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient: monmap: 2024-09-10T16:34:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:32.814166+0000 2024-09-10T16:34:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:32.814166+0000 2024-09-10T16:34:32.814 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:32.815 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:32.816 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 1 Processor -- start 2024-09-10T16:34:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 1 -- start start 2024-09-10T16:34:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient: init 2024-09-10T16:34:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient: _add_conns ranks=[7,6,1,2,3,8,5,0,4] 2024-09-10T16:34:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient(hunting): picked mon.noname-i con 0x7fed1009ca10 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient(hunting): picked mon.noname-d con 0x7fed100a56e0 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient(hunting): picked mon.noname-f con 0x7fed100a5b00 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed101362b0 con 0x7fed100a5b00 2024-09-10T16:34:32.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed100a80b0 con 0x7fed100a56e0 2024-09-10T16:34:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed1009de70 con 0x7fed1009ca10 2024-09-10T16:34:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient(hunting): authenticate will time out at 1240.213644s 2024-09-10T16:34:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0f7fe640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fed100a56e0 0x7fed1013df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:36616/0 (socket says 172.21.15.81:36616) 2024-09-10T16:34:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0f7fe640 1 -- 172.21.15.81:0/1545417330 learned_addr learned my addr 172.21.15.81:0/1545417330 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 1 -- 172.21.15.81:0/1545417330 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 579451474 0 0) 0x7fed100a80b0 con 0x7fed100a56e0 2024-09-10T16:34:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient(hunting): my global_id is 144123 2024-09-10T16:34:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 1 -- 172.21.15.81:0/1545417330 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecf8003530 con 0x7fed100a56e0 2024-09-10T16:34:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 1 -- 172.21.15.81:0/1545417330 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2575317589 0 0) 0x7fecf8003530 con 0x7fed100a56e0 2024-09-10T16:34:32.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 1 -- 172.21.15.81:0/1545417330 >> v1:172.21.15.189:6792/0 conn(0x7fed1009ca10 legacy=0x7fed10135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 1 -- 172.21.15.81:0/1545417330 >> v1:172.21.15.189:6789/0 conn(0x7fed100a5b00 legacy=0x7fed10141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient: _finish_hunting 0 2024-09-10T16:34:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 1 monclient: found mon.noname-d 2024-09-10T16:34:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:34:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 1 -- 172.21.15.81:0/1545417330 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed1009e150 con 0x7fed100a56e0 2024-09-10T16:34:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient: _finish_auth 0 2024-09-10T16:34:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient: _check_auth_tickets 2024-09-10T16:34:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 1 -- 172.21.15.81:0/1545417330 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fed04001bc0 con 0x7fed100a56e0 2024-09-10T16:34:32.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:34:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient: dump: 2024-09-10T16:34:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.827 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.828 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.828 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.828 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.829 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.829 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.829 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.829 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.829 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 5 monclient: authenticate success, global_id 144123 2024-09-10T16:34:32.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:32.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 1 -- 172.21.15.81:0/1545417330 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fed04001de0 con 0x7fed100a56e0 2024-09-10T16:34:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 1 -- 172.21.15.81:0/1545417330 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fed04004f70 con 0x7fed100a56e0 2024-09-10T16:34:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed0effd640 10 monclient: dump: 2024-09-10T16:34:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.830 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.831 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 4 set_mon_vals no callback set 2024-09-10T16:34:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient: shutdown 2024-09-10T16:34:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:32.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 1 -- 172.21.15.81:0/1545417330 >> v1:172.21.15.81:6792/0 conn(0x7fed100a56e0 legacy=0x7fed1013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 1 -- 172.21.15.81:0/1545417330 shutdown_connections 2024-09-10T16:34:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 1 -- 172.21.15.81:0/1545417330 >> 172.21.15.81:0/1545417330 conn(0x7fed1006dc90 msgr2=0x7fed100ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 1 -- 172.21.15.81:0/1545417330 shutdown_connections 2024-09-10T16:34:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 1 -- 172.21.15.81:0/1545417330 wait complete. 2024-09-10T16:34:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient: build_initial_monmap 2024-09-10T16:34:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.812+0000 7fed16400640 10 monclient: monmap: 2024-09-10T16:34:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:32.832 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:32.833 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 1 Processor -- start 2024-09-10T16:34:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 1 -- start start 2024-09-10T16:34:32.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 10 monclient: init 2024-09-10T16:34:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 10 monclient: _add_conns ranks=[5,1,2,8,6,4,0,7,3] 2024-09-10T16:34:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 10 monclient(hunting): picked mon.noname-h con 0x7fed1009ca10 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 10 monclient(hunting): picked mon.noname-f con 0x7fed100a56e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 10 monclient(hunting): picked mon.noname-b con 0x7fed100a5b00 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed101307d0 con 0x7fed100a56e0 2024-09-10T16:34:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed10132660 con 0x7fed100a5b00 2024-09-10T16:34:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed100aa9b0 con 0x7fed1009ca10 2024-09-10T16:34:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 10 monclient(hunting): authenticate will time out at 1240.216670s 2024-09-10T16:34:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed1499d640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fed100a5b00 0x7fed101d5fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:40284/0 (socket says 172.21.15.81:40284) 2024-09-10T16:34:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed1499d640 1 -- 172.21.15.81:0/105714919 learned_addr learned my addr 172.21.15.81:0/105714919 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:32.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 125783491 0 0) 0x7fed10132660 con 0x7fed100a5b00 2024-09-10T16:34:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): my global_id is 144137 2024-09-10T16:34:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecfc003560 con 0x7fed100a5b00 2024-09-10T16:34:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3238934122 0 0) 0x7fecfc003560 con 0x7fed100a5b00 2024-09-10T16:34:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fed10132660 con 0x7fed100a5b00 2024-09-10T16:34:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fed00001a80 con 0x7fed100a5b00 2024-09-10T16:34:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): dump: 2024-09-10T16:34:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.835 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.836 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.836 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 420612811 0 0) 0x7fed101307d0 con 0x7fed100a56e0 2024-09-10T16:34:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): my global_id is 5941 2024-09-10T16:34:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecfc003560 con 0x7fed100a56e0 2024-09-10T16:34:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2569048913 0 0) 0x7fed10132660 con 0x7fed100a5b00 2024-09-10T16:34:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 >> v1:172.21.15.189:6791/0 conn(0x7fed1009ca10 legacy=0x7fed1012ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 >> v1:172.21.15.189:6789/0 conn(0x7fed100a56e0 legacy=0x7fed1012f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient: _finish_hunting 0 2024-09-10T16:34:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 monclient: found mon.b 2024-09-10T16:34:32.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed100aa4a0 con 0x7fed100a5b00 2024-09-10T16:34:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient: _finish_auth 0 2024-09-10T16:34:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient: _check_auth_tickets 2024-09-10T16:34:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 5 monclient: authenticate success, global_id 144137 2024-09-10T16:34:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 10 monclient: _renew_subs 2024-09-10T16:34:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 1 -- 172.21.15.81:0/105714919 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fed10135410 con 0x7fed100a5b00 2024-09-10T16:34:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 10 monclient: _renew_subs 2024-09-10T16:34:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 1 -- 172.21.15.81:0/105714919 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fed101311a0 con 0x7fed100a5b00 2024-09-10T16:34:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fed000038d0 con 0x7fed100a5b00 2024-09-10T16:34:32.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fed00003ec0 con 0x7fed100a5b00 2024-09-10T16:34:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0e7fc640 4 set_mon_vals no callback set 2024-09-10T16:34:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient: dump: 2024-09-10T16:34:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.839 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.840 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed16400640 1 -- 172.21.15.81:0/105714919 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fecf00065d0 con 0x7fecf0002870 2024-09-10T16:34:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fed00004060 con 0x7fed100a5b00 2024-09-10T16:34:32.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(224..224 src has 121..224) ==== 3898+0+0 (unknown 3925479928 0 0) 0x7fed0004ad30 con 0x7fed100a5b00 2024-09-10T16:34:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 834222914 0 0) 0x7fecf00065d0 con 0x7fecf0002870 2024-09-10T16:34:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient(hunting): my global_id is 144146 2024-09-10T16:34:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fed10132660 con 0x7fecf0002870 2024-09-10T16:34:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0f7fe640 10 monclient: get_auth_request con 0x7fecfc03cfa0 auth_method 0 2024-09-10T16:34:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 166572944 0 0) 0x7fed10132660 con 0x7fecf0002870 2024-09-10T16:34:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fecf00065d0 con 0x7fecf0002870 2024-09-10T16:34:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fed08001970 con 0x7fecf0002870 2024-09-10T16:34:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient: dump: 2024-09-10T16:34:32.841 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.842 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.843 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1885592962 0 0) 0x7fecf00065d0 con 0x7fecf0002870 2024-09-10T16:34:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 --> v1:172.21.15.81:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fecf000a170 con 0x7fecf0002870 2024-09-10T16:34:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fed08001c50 con 0x7fecf0002870 2024-09-10T16:34:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 >> v1:172.21.15.81:6790/0 conn(0x7fecf0002870 legacy=0x7fecf0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.816+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 >> v1:172.21.15.81:6790/0 conn(0x7fecf0002870 legacy=0x7fecf0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed16400640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:32.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed16400640 1 -- 172.21.15.81:0/105714919 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fecf0009e60 con 0x7fecf0009120 2024-09-10T16:34:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3912333772 0 0) 0x7fecf0009e60 con 0x7fecf0009120 2024-09-10T16:34:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 10 monclient(hunting): my global_id is 144155 2024-09-10T16:34:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fecf00065d0 con 0x7fecf0009120 2024-09-10T16:34:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 506628933 0 0) 0x7fecf00065d0 con 0x7fecf0009120 2024-09-10T16:34:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fecf0009e60 con 0x7fecf0009120 2024-09-10T16:34:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fed08003b30 con 0x7fecf0009120 2024-09-10T16:34:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 10 monclient: dump: 2024-09-10T16:34:32.845 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.846 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.847 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4060561319 0 0) 0x7fecf0009e60 con 0x7fecf0009120 2024-09-10T16:34:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 --> v1:172.21.15.81:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fecf000c400 con 0x7fecf0009120 2024-09-10T16:34:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 2002390694) 0x7fed08005000 con 0x7fecf0009120 2024-09-10T16:34:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 >> v1:172.21.15.81:6790/0 conn(0x7fecf0009120 legacy=0x7fecf00095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed0cff9640 1 -- 172.21.15.81:0/105714919 >> v1:172.21.15.81:6790/0 conn(0x7fecf0009120 legacy=0x7fecf00095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:32.847 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:32.847 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:32.848 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:32.848 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:32.848 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:32.848 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 15663, 2024-09-10T16:34:32.848 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:32.848 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:32.848 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:32.848 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:32.848 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:32.848 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:32.848 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:32.848 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:32.849 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:32.849 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:32.849 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:32.849 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-09-10T16:34:32.849 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:32.849 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:32.849 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:32.849 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:32.849 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:32.849 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:32.849 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:32.849 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:32.849 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:32.850 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:32.850 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:32.850 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:32.850 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:32.850 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:32.850 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:32.850 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:32.850 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:32.850 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:32.850 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:32.850 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:32.850 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:32.851 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:32.852 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:32.853 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:32.853 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:32.853 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:32.853 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:32.853 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:32.853 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:32.853 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:32.853 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:32.853 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:32.853 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:32.853 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:32.853 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:32.853 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:32.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.854 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:32.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.854 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:32.854 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:32.854 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:32.855 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.855 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:32.855 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:32.855 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.855 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.855 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.855 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:32.855 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:32.856 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:32.856 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.856 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.856 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:32.856 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:32.856 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.857 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.857 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.857 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:32.857 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:32.857 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.857 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.857 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:32.857 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:32.858 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:32.858 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.858 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.858 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.858 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:32.858 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:32.858 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:32.859 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.859 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:32.859 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:32.859 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.859 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.859 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.860 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:32.860 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:32.860 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.860 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.860 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:32.860 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.860 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.860 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.861 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:32.861 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:32.861 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.861 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.861 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.861 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.861 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:32.861 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:32.861 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.861 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.862 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:32.862 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.862 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.862 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.862 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:32.862 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:32.863 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.863 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.863 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.863 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:32.863 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:32.863 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.863 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.863 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:32.864 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.864 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.864 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:32.864 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:32.864 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.864 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.864 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.864 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:32.864 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:32.865 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:32.865 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.865 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.865 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:32.865 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:32.865 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:32.867 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:32.868 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:34:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:32.869 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:32.869 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed16400640 1 -- 172.21.15.81:0/105714919 >> v1:172.21.15.189:6812/1108603242 conn(0x7fecfc03cfa0 legacy=0x7fecfc03f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed16400640 10 monclient: shutdown 2024-09-10T16:34:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed16400640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed16400640 1 -- 172.21.15.81:0/105714919 >> v1:172.21.15.81:6790/0 conn(0x7fed100a5b00 legacy=0x7fed101d5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed1499d640 1 -- 172.21.15.81:0/105714919 reap_dead start 2024-09-10T16:34:32.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed1499d640 1 -- 172.21.15.81:0/105714919 reap_dead start 2024-09-10T16:34:32.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed16400640 1 -- 172.21.15.81:0/105714919 shutdown_connections 2024-09-10T16:34:32.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed16400640 1 -- 172.21.15.81:0/105714919 >> 172.21.15.81:0/105714919 conn(0x7fed1006dc90 msgr2=0x7fed1012c460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:32.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed16400640 1 -- 172.21.15.81:0/105714919 shutdown_connections 2024-09-10T16:34:32.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.824+0000 7fed16400640 1 -- 172.21.15.81:0/105714919 wait complete. 2024-09-10T16:34:32.871 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:32.871 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-10T16:34:32.871 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T16:34:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 10 monclient: get_monmap_and_config 2024-09-10T16:34:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 10 monclient: build_initial_monmap 2024-09-10T16:34:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 10 monclient: monmap: 2024-09-10T16:34:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:32.986553+0000 2024-09-10T16:34:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:32.986553+0000 2024-09-10T16:34:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:32.988 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:32.988 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:32.988 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 1 Processor -- start 2024-09-10T16:34:32.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 1 -- start start 2024-09-10T16:34:32.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 10 monclient: init 2024-09-10T16:34:32.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:32.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 10 monclient: _add_conns ranks=[7,1,3,6,0,8,2,5,4] 2024-09-10T16:34:32.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 10 monclient(hunting): picked mon.noname-i con 0x7f4f900a0a90 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:32.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 10 monclient(hunting): picked mon.noname-f con 0x7f4f900a35f0 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:32.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 10 monclient(hunting): picked mon.noname-g con 0x7f4f900a3a40 addr v1:172.21.15.189:6790/0 2024-09-10T16:34:32.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9009df70 con 0x7f4f900a35f0 2024-09-10T16:34:32.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9009fa30 con 0x7f4f900a3a40 2024-09-10T16:34:32.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f9009fd10 con 0x7f4f900a0a90 2024-09-10T16:34:32.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:32.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 10 monclient(hunting): authenticate will time out at 1240.386196s 2024-09-10T16:34:32.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8ffff640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f4f900a3a40 0x7f4f9013fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.81:45068/0 (socket says 172.21.15.81:45068) 2024-09-10T16:34:32.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8ffff640 1 -- 172.21.15.81:0/4259108875 learned_addr learned my addr 172.21.15.81:0/4259108875 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:32.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8f7fe640 1 --1- 172.21.15.81:0/4259108875 >> v1:172.21.15.189:6792/0 conn(0x7f4f900a0a90 0x7f4f900a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6792/0 says I am v1:172.21.15.81:54032/0 (socket says 172.21.15.81:54032) 2024-09-10T16:34:32.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/4259108875 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4279434851 0 0) 0x7f4f9009fa30 con 0x7f4f900a3a40 2024-09-10T16:34:32.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient(hunting): my global_id is 134832 2024-09-10T16:34:32.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/4259108875 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f78003530 con 0x7f4f900a3a40 2024-09-10T16:34:32.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/4259108875 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3757179656 0 0) 0x7f4f9009df70 con 0x7f4f900a35f0 2024-09-10T16:34:32.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient(hunting): my global_id is 5950 2024-09-10T16:34:32.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/4259108875 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f9009fa30 con 0x7f4f900a35f0 2024-09-10T16:34:32.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/4259108875 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 506626089 0 0) 0x7f4f9009fd10 con 0x7f4f900a0a90 2024-09-10T16:34:32.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:32.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:32.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:32.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient(hunting): my global_id is 144151 2024-09-10T16:34:32.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/4259108875 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f9009df70 con 0x7f4f900a0a90 2024-09-10T16:34:32.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/4259108875 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3573082695 0 0) 0x7f4f78003530 con 0x7f4f900a3a40 2024-09-10T16:34:32.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/4259108875 >> v1:172.21.15.189:6792/0 conn(0x7f4f900a0a90 legacy=0x7f4f900a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/4259108875 >> v1:172.21.15.189:6789/0 conn(0x7f4f900a35f0 legacy=0x7f4f9013c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:34:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 1 monclient: found mon.noname-g 2024-09-10T16:34:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient: _send_mon_message to mon.noname-g at v1:172.21.15.189:6790/0 2024-09-10T16:34:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/4259108875 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9009fff0 con 0x7f4f900a3a40 2024-09-10T16:34:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient: _finish_auth 0 2024-09-10T16:34:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:34:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/4259108875 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4f88001770 con 0x7f4f900a3a40 2024-09-10T16:34:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient: got monmap 1 from mon.noname-g (according to old e1) 2024-09-10T16:34:32.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient: dump: 2024-09-10T16:34:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.995 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.996 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 5 monclient: authenticate success, global_id 134832 2024-09-10T16:34:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/4259108875 <== mon.3 v1:172.21.15.189:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f88001990 con 0x7f4f900a3a40 2024-09-10T16:34:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f95df3640 4 set_mon_vals no callback set 2024-09-10T16:34:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/4259108875 <== mon.3 v1:172.21.15.189:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4f88004bf0 con 0x7f4f900a3a40 2024-09-10T16:34:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:34:32.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.984+0000 7f4f8e7fc640 10 monclient: dump: 2024-09-10T16:34:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:32.997 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:32.998 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient: shutdown 2024-09-10T16:34:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 1 -- 172.21.15.81:0/4259108875 >> v1:172.21.15.189:6790/0 conn(0x7f4f900a3a40 legacy=0x7f4f9013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 1 -- 172.21.15.81:0/4259108875 shutdown_connections 2024-09-10T16:34:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 1 -- 172.21.15.81:0/4259108875 >> 172.21.15.81:0/4259108875 conn(0x7f4f900a3fd0 msgr2=0x7f4f900a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 1 -- 172.21.15.81:0/4259108875 shutdown_connections 2024-09-10T16:34:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 1 -- 172.21.15.81:0/4259108875 wait complete. 2024-09-10T16:34:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient: build_initial_monmap 2024-09-10T16:34:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient: monmap: 2024-09-10T16:34:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:32.998 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:32.999 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:32.999 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 1 Processor -- start 2024-09-10T16:34:33.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 1 -- start start 2024-09-10T16:34:33.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient: init 2024-09-10T16:34:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:33.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient: _add_conns ranks=[7,1,8,3,2,5,6,4,0] 2024-09-10T16:34:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient(hunting): picked mon.noname-i con 0x7f4f900a0a90 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient(hunting): picked mon.noname-f con 0x7f4f900a35f0 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient(hunting): picked mon.noname-e con 0x7f4f900a3a40 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f900a6cb0 con 0x7f4f900a35f0 2024-09-10T16:34:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f900966a0 con 0x7f4f900a0a90 2024-09-10T16:34:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f90096f40 con 0x7f4f900a3a40 2024-09-10T16:34:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient(hunting): authenticate will time out at 1240.390670s 2024-09-10T16:34:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f8ffff640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f4f900a3a40 0x7f4f901d4270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:38566/0 (socket says 172.21.15.81:38566) 2024-09-10T16:34:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f8ffff640 1 -- 172.21.15.81:0/3058061100 learned_addr learned my addr 172.21.15.81:0/3058061100 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4003973799 0 0) 0x7f4f90096f40 con 0x7f4f900a3a40 2024-09-10T16:34:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): my global_id is 5813 2024-09-10T16:34:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f7c003530 con 0x7f4f900a3a40 2024-09-10T16:34:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3493445352 0 0) 0x7f4f7c003530 con 0x7f4f900a3a40 2024-09-10T16:34:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f90096f40 con 0x7f4f900a3a40 2024-09-10T16:34:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4f880017f0 con 0x7f4f900a3a40 2024-09-10T16:34:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:34:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): dump: 2024-09-10T16:34:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.006 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.007 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:33.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3759182623 0 0) 0x7f4f900966a0 con 0x7f4f900a0a90 2024-09-10T16:34:33.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): my global_id is 144160 2024-09-10T16:34:33.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f7c003530 con 0x7f4f900a0a90 2024-09-10T16:34:33.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1028001172 0 0) 0x7f4f900a6cb0 con 0x7f4f900a35f0 2024-09-10T16:34:33.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient(hunting): my global_id is 5959 2024-09-10T16:34:33.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f900966a0 con 0x7f4f900a35f0 2024-09-10T16:34:33.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2826834760 0 0) 0x7f4f90096f40 con 0x7f4f900a3a40 2024-09-10T16:34:33.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 >> v1:172.21.15.189:6792/0 conn(0x7f4f900a0a90 legacy=0x7f4f9009a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 >> v1:172.21.15.189:6789/0 conn(0x7f4f900a35f0 legacy=0x7f4f901d0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient: _finish_hunting 0 2024-09-10T16:34:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 monclient: found mon.e 2024-09-10T16:34:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f90095740 con 0x7f4f900a3a40 2024-09-10T16:34:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient: _finish_auth 0 2024-09-10T16:34:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient: _check_auth_tickets 2024-09-10T16:34:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 5 monclient: authenticate success, global_id 5813 2024-09-10T16:34:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient: _renew_subs 2024-09-10T16:34:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9009aba0 con 0x7f4f900a3a40 2024-09-10T16:34:33.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient: _renew_subs 2024-09-10T16:34:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f95df3640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f4f901cbc20 con 0x7f4f900a3a40 2024-09-10T16:34:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4f88001990 con 0x7f4f900a3a40 2024-09-10T16:34:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4f88004ea0 con 0x7f4f900a3a40 2024-09-10T16:34:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f8dffb640 4 set_mon_vals no callback set 2024-09-10T16:34:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.988+0000 7f4f77fff640 10 monclient: dump: 2024-09-10T16:34:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.010 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.011 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.011 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.011 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.011 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.011 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.011 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.011 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.011 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.011 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.011 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.011 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f95df3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:33.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f95df3640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4f700065d0 con 0x7f4f70002870 2024-09-10T16:34:33.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3941634703 0 0) 0x7f4f700065d0 con 0x7f4f70002870 2024-09-10T16:34:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 10 monclient(hunting): my global_id is 144130 2024-09-10T16:34:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f90096f40 con 0x7f4f70002870 2024-09-10T16:34:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f4f88005040 con 0x7f4f900a3a40 2024-09-10T16:34:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(224..224 src has 121..224) ==== 3898+0+0 (unknown 3925479928 0 0) 0x7f4f8804ad10 con 0x7f4f900a3a40 2024-09-10T16:34:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1470698202 0 0) 0x7f4f90096f40 con 0x7f4f70002870 2024-09-10T16:34:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f700065d0 con 0x7f4f70002870 2024-09-10T16:34:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4f80001870 con 0x7f4f70002870 2024-09-10T16:34:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:33.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 10 monclient: dump: 2024-09-10T16:34:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.013 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.014 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1964823944 0 0) 0x7f4f700065d0 con 0x7f4f70002870 2024-09-10T16:34:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.81:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4f7000a170 con 0x7f4f70002870 2024-09-10T16:34:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f8effd640 10 monclient: get_auth_request con 0x7f4f7c03d1c0 auth_method 0 2024-09-10T16:34:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4f80001c20 con 0x7f4f70002870 2024-09-10T16:34:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 >> v1:172.21.15.81:6791/0 conn(0x7f4f70002870 legacy=0x7f4f70004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.992+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 >> v1:172.21.15.81:6791/0 conn(0x7f4f70002870 legacy=0x7f4f70004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.996+0000 7f4f95df3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:32.996+0000 7f4f95df3640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4f70009e60 con 0x7f4f70009120 2024-09-10T16:34:33.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1617213963 0 0) 0x7f4f70009e60 con 0x7f4f70009120 2024-09-10T16:34:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 10 monclient(hunting): my global_id is 144139 2024-09-10T16:34:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f700065d0 con 0x7f4f70009120 2024-09-10T16:34:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2476187773 0 0) 0x7f4f700065d0 con 0x7f4f70009120 2024-09-10T16:34:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4f70009e60 con 0x7f4f70009120 2024-09-10T16:34:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4f80004da0 con 0x7f4f70009120 2024-09-10T16:34:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 10 monclient: dump: 2024-09-10T16:34:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.015 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.016 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.016 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.016 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.016 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.016 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.016 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.016 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.016 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.016 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.016 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.016 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.016 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.016 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 67408251 0 0) 0x7f4f70009e60 con 0x7f4f70009120 2024-09-10T16:34:33.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 --> v1:172.21.15.81:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4f7000c3b0 con 0x7f4f70009120 2024-09-10T16:34:33.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 3917669643) 0x7f4f800061f0 con 0x7f4f70009120 2024-09-10T16:34:33.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:33.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:33.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 >> v1:172.21.15.81:6791/0 conn(0x7f4f70009120 legacy=0x7f4f700095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f77fff640 1 -- 172.21.15.81:0/3058061100 >> v1:172.21.15.81:6791/0 conn(0x7f4f70009120 legacy=0x7f4f700095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:33.017 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:33.017 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 15847, 2024-09-10T16:34:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:33.018 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-09-10T16:34:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.019 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.020 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:33.021 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.022 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.023 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:33.024 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:33.025 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:33.028 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.031 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.032 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.034 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:33.035 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.037 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:33.037 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:33.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f95df3640 1 -- 172.21.15.81:0/3058061100 >> v1:172.21.15.189:6812/1108603242 conn(0x7f4f7c03d1c0 legacy=0x7f4f7c03f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f95df3640 10 monclient: shutdown 2024-09-10T16:34:33.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f95df3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:33.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f95df3640 1 -- 172.21.15.81:0/3058061100 >> v1:172.21.15.81:6793/0 conn(0x7f4f900a3a40 legacy=0x7f4f901d4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f8ffff640 1 -- 172.21.15.81:0/3058061100 reap_dead start 2024-09-10T16:34:33.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f8ffff640 1 -- 172.21.15.81:0/3058061100 reap_dead start 2024-09-10T16:34:33.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f95df3640 1 -- 172.21.15.81:0/3058061100 shutdown_connections 2024-09-10T16:34:33.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f95df3640 1 -- 172.21.15.81:0/3058061100 >> 172.21.15.81:0/3058061100 conn(0x7f4f900a3fd0 msgr2=0x7f4f90072900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:33.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f95df3640 1 -- 172.21.15.81:0/3058061100 shutdown_connections 2024-09-10T16:34:33.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.000+0000 7f4f95df3640 1 -- 172.21.15.81:0/3058061100 wait complete. 2024-09-10T16:34:33.039 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:33.039 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-10T16:34:33.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-10T16:34:33.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 10 monclient: get_monmap_and_config 2024-09-10T16:34:33.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 10 monclient: build_initial_monmap 2024-09-10T16:34:33.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 10 monclient: monmap: 2024-09-10T16:34:33.162 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:33.162 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.162 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:33.162695+0000 2024-09-10T16:34:33.162 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:33.162695+0000 2024-09-10T16:34:33.162 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:33.162 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:33.163 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:33.163 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 1 Processor -- start 2024-09-10T16:34:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 1 -- start start 2024-09-10T16:34:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 10 monclient: init 2024-09-10T16:34:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 10 monclient: _add_conns ranks=[1,0,4,3,5,8,6,7,2] 2024-09-10T16:34:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 10 monclient(hunting): picked mon.noname-f con 0x7fbda00a0a90 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 10 monclient(hunting): picked mon.noname-a con 0x7fbda00a35f0 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 10 monclient(hunting): picked mon.noname-c con 0x7fbda00a3a40 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda009df70 con 0x7fbda00a35f0 2024-09-10T16:34:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda009fa30 con 0x7fbda00a0a90 2024-09-10T16:34:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda009fd10 con 0x7fbda00a3a40 2024-09-10T16:34:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 10 monclient(hunting): authenticate will time out at 1240.562020s 2024-09-10T16:34:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9e7fc640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbda00a35f0 0x7fbda013c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53030/0 (socket says 172.21.15.81:53030) 2024-09-10T16:34:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9f7fe640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fbda00a3a40 0x7fbda013fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:46094/0 (socket says 172.21.15.81:46094) 2024-09-10T16:34:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9e7fc640 1 -- 172.21.15.81:0/3860913385 learned_addr learned my addr 172.21.15.81:0/3860913385 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 1 -- 172.21.15.81:0/3860913385 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1872632882 0 0) 0x7fbda009df70 con 0x7fbda00a35f0 2024-09-10T16:34:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient(hunting): my global_id is 5742 2024-09-10T16:34:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 1 -- 172.21.15.81:0/3860913385 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd8c003530 con 0x7fbda00a35f0 2024-09-10T16:34:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 1 -- 172.21.15.81:0/3860913385 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 955492706 0 0) 0x7fbda009fd10 con 0x7fbda00a3a40 2024-09-10T16:34:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient(hunting): my global_id is 144148 2024-09-10T16:34:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 1 -- 172.21.15.81:0/3860913385 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbda009df70 con 0x7fbda00a3a40 2024-09-10T16:34:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 1 -- 172.21.15.81:0/3860913385 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4116015751 0 0) 0x7fbd8c003530 con 0x7fbda00a35f0 2024-09-10T16:34:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 1 -- 172.21.15.81:0/3860913385 >> v1:172.21.15.81:6791/0 conn(0x7fbda00a3a40 legacy=0x7fbda013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 1 -- 172.21.15.81:0/3860913385 >> v1:172.21.15.189:6789/0 conn(0x7fbda00a0a90 legacy=0x7fbda00a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient: _finish_hunting 0 2024-09-10T16:34:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 1 monclient: found mon.noname-a 2024-09-10T16:34:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:34:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 1 -- 172.21.15.81:0/3860913385 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda009fff0 con 0x7fbda00a35f0 2024-09-10T16:34:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient: _finish_auth 0 2024-09-10T16:34:33.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient: _check_auth_tickets 2024-09-10T16:34:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 1 -- 172.21.15.81:0/3860913385 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fbd90001860 con 0x7fbda00a35f0 2024-09-10T16:34:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 5 monclient: authenticate success, global_id 5742 2024-09-10T16:34:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:34:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient: dump: 2024-09-10T16:34:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.173 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.174 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 1 -- 172.21.15.81:0/3860913385 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd90001a80 con 0x7fbda00a35f0 2024-09-10T16:34:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 1 -- 172.21.15.81:0/3860913385 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fbd90004bf0 con 0x7fbda00a35f0 2024-09-10T16:34:33.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 4 set_mon_vals no callback set 2024-09-10T16:34:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:34:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbd9dffb640 10 monclient: dump: 2024-09-10T16:34:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.175 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.176 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 10 monclient: shutdown 2024-09-10T16:34:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 1 -- 172.21.15.81:0/3860913385 >> v1:172.21.15.81:6789/0 conn(0x7fbda00a35f0 legacy=0x7fbda013c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 1 -- 172.21.15.81:0/3860913385 shutdown_connections 2024-09-10T16:34:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 1 -- 172.21.15.81:0/3860913385 >> 172.21.15.81:0/3860913385 conn(0x7fbda00a3fd0 msgr2=0x7fbda00a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 1 -- 172.21.15.81:0/3860913385 shutdown_connections 2024-09-10T16:34:33.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.160+0000 7fbda59d5640 1 -- 172.21.15.81:0/3860913385 wait complete. 2024-09-10T16:34:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 monclient: build_initial_monmap 2024-09-10T16:34:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 monclient: monmap: 2024-09-10T16:34:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:33.177 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:33.178 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 1 Processor -- start 2024-09-10T16:34:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 1 -- start start 2024-09-10T16:34:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 monclient: init 2024-09-10T16:34:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 monclient: _add_conns ranks=[7,6,5,3,2,1,4,0,8] 2024-09-10T16:34:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 monclient(hunting): picked mon.noname-i con 0x7fbda00a0a90 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 monclient(hunting): picked mon.noname-d con 0x7fbda00a35f0 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 monclient(hunting): picked mon.noname-h con 0x7fbda00a3a40 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda0073fe0 con 0x7fbda00a3a40 2024-09-10T16:34:33.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda0098fd0 con 0x7fbda00a35f0 2024-09-10T16:34:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbda01cb3c0 con 0x7fbda00a0a90 2024-09-10T16:34:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 monclient(hunting): authenticate will time out at 1240.565074s 2024-09-10T16:34:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd9e7fc640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fbda00a35f0 0x7fbda01cacb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:36626/0 (socket says 172.21.15.81:36626) 2024-09-10T16:34:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd9e7fc640 1 -- 172.21.15.81:0/2477503131 learned_addr learned my addr 172.21.15.81:0/2477503131 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 907179794 0 0) 0x7fbda0098fd0 con 0x7fbda00a35f0 2024-09-10T16:34:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): my global_id is 144132 2024-09-10T16:34:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd80003560 con 0x7fbda00a35f0 2024-09-10T16:34:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1103583297 0 0) 0x7fbd80003560 con 0x7fbda00a35f0 2024-09-10T16:34:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbda0098fd0 con 0x7fbda00a35f0 2024-09-10T16:34:33.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fbd90004b30 con 0x7fbda00a35f0 2024-09-10T16:34:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:34:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): dump: 2024-09-10T16:34:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.180 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.181 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2625598866 0 0) 0x7fbda009df70 con 0x7fbda00a3a40 2024-09-10T16:34:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): my global_id is 5756 2024-09-10T16:34:33.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd80003560 con 0x7fbda00a3a40 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1661156673 0 0) 0x7fbda01cb3c0 con 0x7fbda00a0a90 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): my global_id is 144169 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbda009df70 con 0x7fbda00a0a90 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2265158884 0 0) 0x7fbda0098fd0 con 0x7fbda00a35f0 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 >> v1:172.21.15.189:6792/0 conn(0x7fbda00a0a90 legacy=0x7fbda01ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 >> v1:172.21.15.189:6791/0 conn(0x7fbda00a3a40 legacy=0x7fbda01d5e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient: _finish_hunting 0 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 monclient: found mon.d 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbda0073ab0 con 0x7fbda00a35f0 2024-09-10T16:34:33.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient: _finish_auth 0 2024-09-10T16:34:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient: _check_auth_tickets 2024-09-10T16:34:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 5 monclient: authenticate success, global_id 144132 2024-09-10T16:34:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 monclient: _renew_subs 2024-09-10T16:34:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbda00a6c20 con 0x7fbda00a35f0 2024-09-10T16:34:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 monclient: _renew_subs 2024-09-10T16:34:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fbda01d7580 con 0x7fbda00a35f0 2024-09-10T16:34:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbd90004ef0 con 0x7fbda00a35f0 2024-09-10T16:34:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fbd90001a60 con 0x7fbda00a35f0 2024-09-10T16:34:33.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd9d7fa640 4 set_mon_vals no callback set 2024-09-10T16:34:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient: dump: 2024-09-10T16:34:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.184 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.185 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbda59d5640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbd840065d0 con 0x7fbd84002870 2024-09-10T16:34:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fbd90011150 con 0x7fbda00a35f0 2024-09-10T16:34:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(224..224 src has 121..224) ==== 3898+0+0 (unknown 3925479928 0 0) 0x7fbd9004ae50 con 0x7fbda00a35f0 2024-09-10T16:34:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 674193805 0 0) 0x7fbd840065d0 con 0x7fbd84002870 2024-09-10T16:34:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient(hunting): my global_id is 144141 2024-09-10T16:34:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbda0098fd0 con 0x7fbd84002870 2024-09-10T16:34:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd9f7fe640 10 monclient: get_auth_request con 0x7fbd8003d210 auth_method 0 2024-09-10T16:34:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 484118331 0 0) 0x7fbda0098fd0 con 0x7fbd84002870 2024-09-10T16:34:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd840065d0 con 0x7fbd84002870 2024-09-10T16:34:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fbd88001ce0 con 0x7fbd84002870 2024-09-10T16:34:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 10 monclient: dump: 2024-09-10T16:34:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.186 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.187 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 253374196 0 0) 0x7fbd840065d0 con 0x7fbd84002870 2024-09-10T16:34:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.164+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.81:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fbd8400a170 con 0x7fbd84002870 2024-09-10T16:34:33.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.168+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fbd88001ff0 con 0x7fbd84002870 2024-09-10T16:34:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.168+0000 7fbd97fff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.168+0000 7fbd97fff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.168+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 >> v1:172.21.15.81:6792/0 conn(0x7fbd84002870 legacy=0x7fbd84004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.168+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 >> v1:172.21.15.81:6792/0 conn(0x7fbd84002870 legacy=0x7fbd84004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbda59d5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbda59d5640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fbd84009e80 con 0x7fbd84009140 2024-09-10T16:34:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1363152883 0 0) 0x7fbd84009e80 con 0x7fbd84009140 2024-09-10T16:34:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 10 monclient(hunting): my global_id is 144150 2024-09-10T16:34:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd840065d0 con 0x7fbd84009140 2024-09-10T16:34:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 825912596 0 0) 0x7fbd840065d0 con 0x7fbd84009140 2024-09-10T16:34:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbd84009e80 con 0x7fbd84009140 2024-09-10T16:34:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fbd88003eb0 con 0x7fbd84009140 2024-09-10T16:34:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 10 monclient: dump: 2024-09-10T16:34:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.190 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.191 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2280056860 0 0) 0x7fbd84009e80 con 0x7fbd84009140 2024-09-10T16:34:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 --> v1:172.21.15.81:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fbd8400c400 con 0x7fbd84009140 2024-09-10T16:34:33.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7710 (unknown 0 0 2948095028) 0x7fbd88005440 con 0x7fbd84009140 2024-09-10T16:34:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 >> v1:172.21.15.81:6792/0 conn(0x7fbd84009140 legacy=0x7fbd840095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.172+0000 7fbd97fff640 1 -- 172.21.15.81:0/2477503131 >> v1:172.21.15.81:6792/0 conn(0x7fbd84009140 legacy=0x7fbd840095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:33.192 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:33.192 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:33.192 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:33.192 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:33.192 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:33.192 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 16019, 2024-09-10T16:34:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:34:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:33.193 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.194 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:33.195 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:33.195 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.195 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.195 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.195 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.195 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.195 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.195 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.195 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.195 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.195 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.195 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.196 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:33.196 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:33.196 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:33.196 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:33.196 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:33.196 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:33.196 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:33.196 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:33.196 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:33.196 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:33.196 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:33.196 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:33.196 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:33.196 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:33.197 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:33.197 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:33.197 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:33.197 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.197 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.197 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.197 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.197 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.197 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.197 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.197 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.197 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.197 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.198 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.198 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.198 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:33.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.198 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:33.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.198 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:33.198 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:33.198 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.198 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.198 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.198 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:33.198 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.199 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.199 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:33.199 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:33.199 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.199 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.199 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.199 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.199 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.199 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:33.199 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:33.199 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.199 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:33.200 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.200 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.200 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:33.200 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:33.200 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.200 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.200 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.201 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:33.201 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:33.201 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.201 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.201 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:33.201 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.201 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.201 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.201 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:33.202 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:33.202 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.202 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.202 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.202 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:33.202 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:33.202 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.202 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.202 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:33.202 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.203 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.203 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.203 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:33.203 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:33.203 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.203 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.203 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.203 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.203 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.203 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:33.203 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:33.203 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.203 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.204 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:33.205 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.206 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.206 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.206 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:33.206 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:33.206 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.206 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.206 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:33.206 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.206 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.206 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:33.207 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:33.207 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.207 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.207 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.207 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:33.207 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:33.207 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.207 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.207 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.208 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:33.208 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.208 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.208 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.208 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:33.208 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:33.208 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.208 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.208 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.208 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.208 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:33.208 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:33.209 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.209 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:33.209 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.209 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.209 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.209 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.209 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:33.209 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:33.209 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.209 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.210 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.210 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.210 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:33.210 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:33.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.210 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.210 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.210 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:33.210 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.210 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.210 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:33.210 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.211 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.211 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.211 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:34:33.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.211 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.211 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-09-10T16:34:33.211 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.211 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.211 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.211 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:33.211 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.211 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.211 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:33.212 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.176+0000 7fbda59d5640 1 -- 172.21.15.81:0/2477503131 >> v1:172.21.15.189:6812/1108603242 conn(0x7fbd8003d210 legacy=0x7fbd8003f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.176+0000 7fbda59d5640 10 monclient: shutdown 2024-09-10T16:34:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.176+0000 7fbda59d5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.176+0000 7fbda59d5640 1 -- 172.21.15.81:0/2477503131 >> v1:172.21.15.81:6792/0 conn(0x7fbda00a35f0 legacy=0x7fbda01cacb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.176+0000 7fbd9f7fe640 1 -- 172.21.15.81:0/2477503131 reap_dead start 2024-09-10T16:34:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.176+0000 7fbd9f7fe640 1 -- 172.21.15.81:0/2477503131 reap_dead start 2024-09-10T16:34:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.176+0000 7fbda59d5640 1 -- 172.21.15.81:0/2477503131 shutdown_connections 2024-09-10T16:34:33.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.176+0000 7fbda59d5640 1 -- 172.21.15.81:0/2477503131 >> 172.21.15.81:0/2477503131 conn(0x7fbda00a3fd0 msgr2=0x7fbda0072870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:33.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.176+0000 7fbda59d5640 1 -- 172.21.15.81:0/2477503131 shutdown_connections 2024-09-10T16:34:33.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.176+0000 7fbda59d5640 1 -- 172.21.15.81:0/2477503131 wait complete. 2024-09-10T16:34:33.214 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:33.214 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-10T16:34:33.214 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-10T16:34:33.248 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31271]: starting. 2024-09-10T16:34:33.248 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31271]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31269 2024-09-10T16:34:33.248 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31271]: shutting down. 2024-09-10T16:34:33.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.332+0000 7f455a3be640 10 monclient: get_monmap_and_config 2024-09-10T16:34:33.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.332+0000 7f455a3be640 10 monclient: build_initial_monmap 2024-09-10T16:34:33.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.332+0000 7f455a3be640 10 monclient: monmap: 2024-09-10T16:34:33.336 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:33.336 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.336 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:33.336624+0000 2024-09-10T16:34:33.336 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:33.336624+0000 2024-09-10T16:34:33.337 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:33.337 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.337 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:33.337 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:33.337 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:33.337 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:33.337 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:33.337 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:33.337 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:33.338 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:33.338 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:33.338 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.332+0000 7f455a3be640 1 Processor -- start 2024-09-10T16:34:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.332+0000 7f455a3be640 1 -- start start 2024-09-10T16:34:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.332+0000 7f455a3be640 10 monclient: init 2024-09-10T16:34:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient: _add_conns ranks=[0,2,6,1,7,3,8,4,5] 2024-09-10T16:34:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient(hunting): picked mon.noname-a con 0x7f455409d440 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient(hunting): picked mon.noname-b con 0x7f45540a39e0 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient(hunting): picked mon.noname-d con 0x7f45540a0900 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45540a37a0 con 0x7f455409d440 2024-09-10T16:34:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4554074d30 con 0x7f45540a39e0 2024-09-10T16:34:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455409d820 con 0x7f45540a0900 2024-09-10T16:34:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient(hunting): authenticate will time out at 1240.736213s 2024-09-10T16:34:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f45537fe640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f45540a39e0 0x7f45540a01f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:40302/0 (socket says 172.21.15.81:40302) 2024-09-10T16:34:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f45537fe640 1 -- 172.21.15.81:0/4220629464 learned_addr learned my addr 172.21.15.81:0/4220629464 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 1 -- 172.21.15.81:0/4220629464 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3848147022 0 0) 0x7f45540a37a0 con 0x7f455409d440 2024-09-10T16:34:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient(hunting): my global_id is 5751 2024-09-10T16:34:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 1 -- 172.21.15.81:0/4220629464 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f453c003530 con 0x7f455409d440 2024-09-10T16:34:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 1 -- 172.21.15.81:0/4220629464 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1204073822 0 0) 0x7f4554074d30 con 0x7f45540a39e0 2024-09-10T16:34:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient(hunting): my global_id is 144191 2024-09-10T16:34:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 1 -- 172.21.15.81:0/4220629464 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45540a37a0 con 0x7f45540a39e0 2024-09-10T16:34:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 1 -- 172.21.15.81:0/4220629464 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2978667992 0 0) 0x7f455409d820 con 0x7f45540a0900 2024-09-10T16:34:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient(hunting): my global_id is 144168 2024-09-10T16:34:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 1 -- 172.21.15.81:0/4220629464 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4554074d30 con 0x7f45540a0900 2024-09-10T16:34:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 1 -- 172.21.15.81:0/4220629464 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1958122358 0 0) 0x7f453c003530 con 0x7f455409d440 2024-09-10T16:34:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 1 -- 172.21.15.81:0/4220629464 >> v1:172.21.15.81:6792/0 conn(0x7f45540a0900 legacy=0x7f455413e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 1 -- 172.21.15.81:0/4220629464 >> v1:172.21.15.81:6790/0 conn(0x7f45540a39e0 legacy=0x7f45540a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:34:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 1 monclient: found mon.noname-a 2024-09-10T16:34:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:34:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 1 -- 172.21.15.81:0/4220629464 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f455409e1c0 con 0x7f455409d440 2024-09-10T16:34:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient: _finish_auth 0 2024-09-10T16:34:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:34:33.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:33.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 1 -- 172.21.15.81:0/4220629464 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4548001860 con 0x7f455409d440 2024-09-10T16:34:33.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:34:33.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient: dump: 2024-09-10T16:34:33.350 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.350 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.350 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.350 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.350 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.350 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.350 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.351 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.351 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.351 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.351 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.351 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.351 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.351 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.351 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.351 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 5 monclient: authenticate success, global_id 5751 2024-09-10T16:34:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 1 -- 172.21.15.81:0/4220629464 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4548001a00 con 0x7f455409d440 2024-09-10T16:34:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 1 -- 172.21.15.81:0/4220629464 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4548003940 con 0x7f455409d440 2024-09-10T16:34:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:34:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4552ffd640 10 monclient: dump: 2024-09-10T16:34:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.352 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.353 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 4 set_mon_vals no callback set 2024-09-10T16:34:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient: shutdown 2024-09-10T16:34:33.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:33.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 1 -- 172.21.15.81:0/4220629464 >> v1:172.21.15.81:6789/0 conn(0x7f455409d440 legacy=0x7f455409fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 1 -- 172.21.15.81:0/4220629464 shutdown_connections 2024-09-10T16:34:33.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 1 -- 172.21.15.81:0/4220629464 >> 172.21.15.81:0/4220629464 conn(0x7f45540a3fd0 msgr2=0x7f45540a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:33.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 1 -- 172.21.15.81:0/4220629464 shutdown_connections 2024-09-10T16:34:33.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 1 -- 172.21.15.81:0/4220629464 wait complete. 2024-09-10T16:34:33.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient: build_initial_monmap 2024-09-10T16:34:33.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient: monmap: 2024-09-10T16:34:33.354 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:33.354 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:33.354 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:33.354 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:33.354 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:33.354 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:33.354 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:33.355 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:33.355 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:33.355 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:33.355 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:33.355 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:33.355 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:33.355 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:33.355 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:33.355 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 1 Processor -- start 2024-09-10T16:34:33.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 1 -- start start 2024-09-10T16:34:33.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient: init 2024-09-10T16:34:33.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:33.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient: _add_conns ranks=[0,6,4,1,2,3,7,5,8] 2024-09-10T16:34:33.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient(hunting): picked mon.noname-a con 0x7f455409d440 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:33.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient(hunting): picked mon.noname-d con 0x7f45540a0900 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:33.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient(hunting): picked mon.noname-c con 0x7f45540a39e0 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:33.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45541b2a60 con 0x7f455409d440 2024-09-10T16:34:33.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f455409cae0 con 0x7f45540a39e0 2024-09-10T16:34:33.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45541b12a0 con 0x7f45540a0900 2024-09-10T16:34:33.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:33.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f455a3be640 10 monclient(hunting): authenticate will time out at 1240.739408s 2024-09-10T16:34:33.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4553fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f455409d440 0x7f45541c9b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53050/0 (socket says 172.21.15.81:53050) 2024-09-10T16:34:33.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4553fff640 1 -- 172.21.15.81:0/1979733488 learned_addr learned my addr 172.21.15.81:0/1979733488 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:33.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2856884152 0 0) 0x7f45541b2a60 con 0x7f455409d440 2024-09-10T16:34:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 10 monclient(hunting): my global_id is 5760 2024-09-10T16:34:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4540003530 con 0x7f455409d440 2024-09-10T16:34:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3357518895 0 0) 0x7f455409cae0 con 0x7f45540a39e0 2024-09-10T16:34:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 10 monclient(hunting): my global_id is 144184 2024-09-10T16:34:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45541b2a60 con 0x7f45540a39e0 2024-09-10T16:34:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2807382164 0 0) 0x7f45541b12a0 con 0x7f45540a0900 2024-09-10T16:34:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 10 monclient(hunting): my global_id is 144177 2024-09-10T16:34:33.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.336+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f455409cae0 con 0x7f45540a0900 2024-09-10T16:34:33.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4049739464 0 0) 0x7f45541b2a60 con 0x7f45540a39e0 2024-09-10T16:34:33.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45541b12a0 con 0x7f45540a39e0 2024-09-10T16:34:33.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f454c001da0 con 0x7f45540a39e0 2024-09-10T16:34:33.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:33.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:34:33.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient(hunting): dump: 2024-09-10T16:34:33.358 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.358 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.358 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.359 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.359 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.359 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.359 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.359 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.359 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.359 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.359 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.359 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.359 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.359 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.359 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.359 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:33.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1807827504 0 0) 0x7f4540003530 con 0x7f455409d440 2024-09-10T16:34:33.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45541b2a60 con 0x7f455409d440 2024-09-10T16:34:33.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1120294467 0 0) 0x7f455409cae0 con 0x7f45540a0900 2024-09-10T16:34:33.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4540003530 con 0x7f45540a0900 2024-09-10T16:34:33.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4548003600 con 0x7f455409d440 2024-09-10T16:34:33.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:33.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:34:33.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient(hunting): dump: 2024-09-10T16:34:33.360 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.360 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.360 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.360 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.360 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.361 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.361 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.361 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.361 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.361 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.361 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.361 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.361 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.361 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.361 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.361 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4544001860 con 0x7f45540a0900 2024-09-10T16:34:33.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:33.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:33.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient(hunting): dump: 2024-09-10T16:34:33.362 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.362 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.362 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.362 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.362 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.362 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.362 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.363 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.363 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.363 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.363 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.363 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.363 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.363 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.363 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.363 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2421634193 0 0) 0x7f45541b12a0 con 0x7f45540a39e0 2024-09-10T16:34:33.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 >> v1:172.21.15.81:6792/0 conn(0x7f45540a0900 legacy=0x7f45541ceb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 >> v1:172.21.15.81:6789/0 conn(0x7f455409d440 legacy=0x7f45541c9b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:34:33.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 monclient: found mon.c 2024-09-10T16:34:33.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:33.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:33.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4554073e70 con 0x7f45540a39e0 2024-09-10T16:34:33.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient: _finish_auth 0 2024-09-10T16:34:33.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:34:33.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:33.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f455a3be640 5 monclient: authenticate success, global_id 144184 2024-09-10T16:34:33.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f455a3be640 10 monclient: _renew_subs 2024-09-10T16:34:33.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f455a3be640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:33.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f455a3be640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f45541b2780 con 0x7f45540a39e0 2024-09-10T16:34:33.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f455a3be640 10 monclient: _renew_subs 2024-09-10T16:34:33.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f455a3be640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:33.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f455a3be640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f45541b92e0 con 0x7f45540a39e0 2024-09-10T16:34:33.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f454c002040 con 0x7f45540a39e0 2024-09-10T16:34:33.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:33.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f454c004010 con 0x7f45540a39e0 2024-09-10T16:34:33.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f45527fc640 4 set_mon_vals no callback set 2024-09-10T16:34:33.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:33.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient: dump: 2024-09-10T16:34:33.365 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.365 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.365 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.365 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.365 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.365 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.365 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.366 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.366 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.366 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.366 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.366 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.366 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.366 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.366 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.366 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f455a3be640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:33.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f455a3be640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f45340065d0 con 0x7f4534002870 2024-09-10T16:34:33.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f454c00ff20 con 0x7f45540a39e0 2024-09-10T16:34:33.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(225..225 src has 121..225) ==== 3506+0+0 (unknown 2064295275 0 0) 0x7f454c049df0 con 0x7f45540a39e0 2024-09-10T16:34:33.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2107889092 0 0) 0x7f45340065d0 con 0x7f4534002870 2024-09-10T16:34:33.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient(hunting): my global_id is 5840 2024-09-10T16:34:33.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45541b12a0 con 0x7f4534002870 2024-09-10T16:34:33.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1522543653 0 0) 0x7f45541b12a0 con 0x7f4534002870 2024-09-10T16:34:33.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f45340065d0 con 0x7f4534002870 2024-09-10T16:34:33.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4548003c00 con 0x7f4534002870 2024-09-10T16:34:33.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:33.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient: dump: 2024-09-10T16:34:33.367 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.367 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.368 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.368 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.368 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.368 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.368 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.368 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.368 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.368 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.368 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.368 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.368 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.368 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.368 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.369 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f45537fe640 10 monclient: get_auth_request con 0x7f454003da30 auth_method 0 2024-09-10T16:34:33.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3120987317 0 0) 0x7f45340065d0 con 0x7f4534002870 2024-09-10T16:34:33.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f453400a170 con 0x7f4534002870 2024-09-10T16:34:33.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4548003ef0 con 0x7f4534002870 2024-09-10T16:34:33.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:33.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:33.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 >> v1:172.21.15.81:6793/0 conn(0x7f4534002870 legacy=0x7f4534004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.340+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 >> v1:172.21.15.81:6793/0 conn(0x7f4534002870 legacy=0x7f4534004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f455a3be640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f455a3be640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4534009e80 con 0x7f4534009140 2024-09-10T16:34:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2619587996 0 0) 0x7f4534009e80 con 0x7f4534009140 2024-09-10T16:34:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 10 monclient(hunting): my global_id is 5849 2024-09-10T16:34:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45340065d0 con 0x7f4534009140 2024-09-10T16:34:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1208321635 0 0) 0x7f45340065d0 con 0x7f4534009140 2024-09-10T16:34:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4534009e80 con 0x7f4534009140 2024-09-10T16:34:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f45480046d0 con 0x7f4534009140 2024-09-10T16:34:33.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 10 monclient: dump: 2024-09-10T16:34:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.372 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.373 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.373 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.373 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.373 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.373 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.373 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.373 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.373 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1765901921 0 0) 0x7f4534009e80 con 0x7f4534009140 2024-09-10T16:34:33.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 --> v1:172.21.15.81:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f453400c420 con 0x7f4534009140 2024-09-10T16:34:33.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 3599526584) 0x7f45480048b0 con 0x7f4534009140 2024-09-10T16:34:33.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 >> v1:172.21.15.81:6793/0 conn(0x7f4534009140 legacy=0x7f45340095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f4550ff9640 1 -- 172.21.15.81:0/1979733488 >> v1:172.21.15.81:6793/0 conn(0x7f4534009140 legacy=0x7f45340095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:33.374 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:33.374 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:33.374 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:33.374 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:33.374 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:33.374 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 283309, 2024-09-10T16:34:33.375 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:33.375 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:33.375 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:33.375 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:33.375 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:33.375 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:33.375 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:33.375 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:33.375 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:33.375 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:33.375 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.375 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:34:33.376 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:33.376 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:33.376 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:33.376 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.376 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.376 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.376 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.376 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.376 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.376 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.376 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.376 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.376 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.377 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.377 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.377 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:33.377 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:33.377 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.377 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.377 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.377 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.377 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.377 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.377 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.377 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.378 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.378 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.378 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.378 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.378 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:33.378 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:33.378 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:33.378 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:33.378 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:33.379 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:33.379 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:33.379 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:33.379 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:33.379 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:33.379 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:33.379 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:33.379 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:33.379 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:33.379 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:33.379 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:33.379 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:33.379 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.380 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.380 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.380 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.380 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.380 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.380 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.380 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.380 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.380 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.380 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.381 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.381 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:33.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.381 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:33.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.381 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:33.381 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:33.381 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.381 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.381 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.381 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.381 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:33.381 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.381 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.382 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.382 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:33.382 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:33.382 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.382 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.382 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.382 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.382 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:33.382 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:33.382 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.383 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.383 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.383 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.383 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:33.383 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.383 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.383 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.383 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:33.383 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:33.383 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.383 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.383 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.383 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.384 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:33.384 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:33.384 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.384 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.384 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:33.384 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.384 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.384 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:33.385 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:33.385 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.385 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.385 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.385 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:33.385 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:33.385 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.385 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.385 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.388 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:33.388 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.388 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.389 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.389 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:33.389 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:33.389 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.389 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.389 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.389 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.389 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.390 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:33.390 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:33.390 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.390 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:33.390 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.390 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.390 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.390 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:33.390 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:33.391 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.391 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.391 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.391 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:33.391 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:33.391 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.391 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.391 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.391 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:33.391 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.392 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.392 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.392 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:33.392 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:33.392 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.392 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.392 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.392 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.392 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.392 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:33.392 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:33.392 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.393 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:33.393 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.393 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.393 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.393 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:33.393 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:33.393 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.393 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.393 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:33.394 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:33.395 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.395 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.395 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.395 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.395 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:33.395 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:33.395 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.395 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.395 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.396 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:33.396 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.396 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.396 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.396 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:33.396 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:33.396 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.396 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.396 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.396 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.396 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.397 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:33.397 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:33.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.397 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.397 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.397 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:33.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.397 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.397 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:34:33.397 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.397 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.397 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.397 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:34:33.397 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.398 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.398 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:33.398 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.398 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.398 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.398 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:34:33.398 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.398 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.398 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.398 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:33.398 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:33.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f455a3be640 1 -- 172.21.15.81:0/1979733488 >> v1:172.21.15.189:6812/1108603242 conn(0x7f454003da30 legacy=0x7f454003fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f455a3be640 10 monclient: shutdown 2024-09-10T16:34:33.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f455a3be640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:33.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f455a3be640 1 -- 172.21.15.81:0/1979733488 >> v1:172.21.15.81:6791/0 conn(0x7f45540a39e0 legacy=0x7f45541d2240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f455895b640 1 -- 172.21.15.81:0/1979733488 reap_dead start 2024-09-10T16:34:33.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f455895b640 1 -- 172.21.15.81:0/1979733488 reap_dead start 2024-09-10T16:34:33.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f455a3be640 1 -- 172.21.15.81:0/1979733488 shutdown_connections 2024-09-10T16:34:33.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f455a3be640 1 -- 172.21.15.81:0/1979733488 >> 172.21.15.81:0/1979733488 conn(0x7f45540a3fd0 msgr2=0x7f455409a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:33.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f455a3be640 1 -- 172.21.15.81:0/1979733488 shutdown_connections 2024-09-10T16:34:33.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.348+0000 7f455a3be640 1 -- 172.21.15.81:0/1979733488 wait complete. 2024-09-10T16:34:33.401 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:33.401 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-10T16:34:33.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-10T16:34:33.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 10 monclient: get_monmap_and_config 2024-09-10T16:34:33.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 10 monclient: build_initial_monmap 2024-09-10T16:34:33.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 10 monclient: monmap: 2024-09-10T16:34:33.514 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:33.514 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.514 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:33.514777+0000 2024-09-10T16:34:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:33.514777+0000 2024-09-10T16:34:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:33.515 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:33.515 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 1 Processor -- start 2024-09-10T16:34:33.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 1 -- start start 2024-09-10T16:34:33.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 10 monclient: init 2024-09-10T16:34:33.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:33.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 10 monclient: _add_conns ranks=[4,6,3,0,5,2,1,8,7] 2024-09-10T16:34:33.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 10 monclient(hunting): picked mon.noname-c con 0x7f6124073a90 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:33.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 10 monclient(hunting): picked mon.noname-d con 0x7f612409dd10 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:33.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 10 monclient(hunting): picked mon.noname-g con 0x7f6124074580 addr v1:172.21.15.189:6790/0 2024-09-10T16:34:33.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61240a1c80 con 0x7f6124074580 2024-09-10T16:34:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61240a2a00 con 0x7f6124073a90 2024-09-10T16:34:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f61240a2ce0 con 0x7f612409dd10 2024-09-10T16:34:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 10 monclient(hunting): authenticate will time out at 1240.914244s 2024-09-10T16:34:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f61227fc640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f612409dd10 0x7f612413df40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:36672/0 (socket says 172.21.15.81:36672) 2024-09-10T16:34:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f61227fc640 1 -- 172.21.15.81:0/189190808 learned_addr learned my addr 172.21.15.81:0/189190808 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6122ffd640 1 --1- 172.21.15.81:0/189190808 >> v1:172.21.15.81:6791/0 conn(0x7f6124073a90 0x7f6124073e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:46102/0 (socket says 172.21.15.81:46102) 2024-09-10T16:34:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 1 -- 172.21.15.81:0/189190808 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3797699773 0 0) 0x7f61240a2ce0 con 0x7f612409dd10 2024-09-10T16:34:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient(hunting): my global_id is 144186 2024-09-10T16:34:33.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 1 -- 172.21.15.81:0/189190808 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f610c003530 con 0x7f612409dd10 2024-09-10T16:34:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 1 -- 172.21.15.81:0/189190808 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 585354460 0 0) 0x7f61240a2a00 con 0x7f6124073a90 2024-09-10T16:34:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient(hunting): my global_id is 144193 2024-09-10T16:34:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 1 -- 172.21.15.81:0/189190808 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61240a2ce0 con 0x7f6124073a90 2024-09-10T16:34:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 1 -- 172.21.15.81:0/189190808 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3473443861 0 0) 0x7f61240a2ce0 con 0x7f6124073a90 2024-09-10T16:34:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 1 -- 172.21.15.81:0/189190808 >> v1:172.21.15.81:6792/0 conn(0x7f612409dd10 legacy=0x7f612413df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 1 -- 172.21.15.81:0/189190808 >> v1:172.21.15.189:6790/0 conn(0x7f6124074580 legacy=0x7f6124141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:34:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 1 monclient: found mon.noname-c 2024-09-10T16:34:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:33.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:34:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 1 -- 172.21.15.81:0/189190808 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61240749f0 con 0x7f6124073a90 2024-09-10T16:34:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient: _finish_auth 0 2024-09-10T16:34:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:34:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 1 -- 172.21.15.81:0/189190808 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6114001820 con 0x7f6124073a90 2024-09-10T16:34:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:34:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient: dump: 2024-09-10T16:34:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.526 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.527 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 5 monclient: authenticate success, global_id 144193 2024-09-10T16:34:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 1 -- 172.21.15.81:0/189190808 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f61140019c0 con 0x7f6124073a90 2024-09-10T16:34:33.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 1 -- 172.21.15.81:0/189190808 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6114004b30 con 0x7f6124073a90 2024-09-10T16:34:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 4 set_mon_vals no callback set 2024-09-10T16:34:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6121ffb640 10 monclient: dump: 2024-09-10T16:34:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.528 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.529 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 10 monclient: shutdown 2024-09-10T16:34:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 1 -- 172.21.15.81:0/189190808 >> v1:172.21.15.81:6791/0 conn(0x7f6124073a90 legacy=0x7f6124073e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 1 -- 172.21.15.81:0/189190808 shutdown_connections 2024-09-10T16:34:33.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 1 -- 172.21.15.81:0/189190808 >> 172.21.15.81:0/189190808 conn(0x7f61240a3d80 msgr2=0x7f61240a4190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 1 -- 172.21.15.81:0/189190808 shutdown_connections 2024-09-10T16:34:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.512+0000 7f6123fff640 1 -- 172.21.15.81:0/189190808 wait complete. 2024-09-10T16:34:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 monclient: build_initial_monmap 2024-09-10T16:34:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 monclient: monmap: 2024-09-10T16:34:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:33.530 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:33.531 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 1 Processor -- start 2024-09-10T16:34:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 1 -- start start 2024-09-10T16:34:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 monclient: init 2024-09-10T16:34:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 monclient: _add_conns ranks=[6,8,4,5,3,0,1,7,2] 2024-09-10T16:34:33.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 monclient(hunting): picked mon.noname-d con 0x7f6124073a90 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 monclient(hunting): picked mon.noname-e con 0x7f6124074580 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 monclient(hunting): picked mon.noname-c con 0x7f612409dd10 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612413c730 con 0x7f612409dd10 2024-09-10T16:34:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612413ca10 con 0x7f6124073a90 2024-09-10T16:34:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f612409d540 con 0x7f6124074580 2024-09-10T16:34:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 monclient(hunting): authenticate will time out at 1240.917532s 2024-09-10T16:34:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f61237fe640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f612409dd10 0x7f61241d5ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:46116/0 (socket says 172.21.15.81:46116) 2024-09-10T16:34:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f61237fe640 1 -- 172.21.15.81:0/4035391173 learned_addr learned my addr 172.21.15.81:0/4035391173 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2382269849 0 0) 0x7f612413ca10 con 0x7f6124073a90 2024-09-10T16:34:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): my global_id is 144195 2024-09-10T16:34:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6110003530 con 0x7f6124073a90 2024-09-10T16:34:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 431772123 0 0) 0x7f612409d540 con 0x7f6124074580 2024-09-10T16:34:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): my global_id is 5858 2024-09-10T16:34:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f612413ca10 con 0x7f6124074580 2024-09-10T16:34:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2913328293 0 0) 0x7f612413c730 con 0x7f612409dd10 2024-09-10T16:34:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): my global_id is 144202 2024-09-10T16:34:33.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f612409d540 con 0x7f612409dd10 2024-09-10T16:34:33.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1983432486 0 0) 0x7f612413ca10 con 0x7f6124074580 2024-09-10T16:34:33.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f612413c730 con 0x7f6124074580 2024-09-10T16:34:33.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3476516358 0 0) 0x7f6110003530 con 0x7f6124073a90 2024-09-10T16:34:33.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f612413ca10 con 0x7f6124073a90 2024-09-10T16:34:33.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f61140017e0 con 0x7f6124073a90 2024-09-10T16:34:33.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:33.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:34:33.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): dump: 2024-09-10T16:34:33.534 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.534 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.534 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.534 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.534 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.535 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.535 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.535 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.535 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.535 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.535 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.535 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.535 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.535 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.535 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.535 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:33.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2427568167 0 0) 0x7f612409d540 con 0x7f612409dd10 2024-09-10T16:34:33.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6110003530 con 0x7f612409dd10 2024-09-10T16:34:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6118001970 con 0x7f6124074580 2024-09-10T16:34:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): dump: 2024-09-10T16:34:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.537 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f611c001da0 con 0x7f612409dd10 2024-09-10T16:34:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient(hunting): dump: 2024-09-10T16:34:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.538 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.539 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3352662414 0 0) 0x7f612413ca10 con 0x7f6124073a90 2024-09-10T16:34:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 >> v1:172.21.15.81:6793/0 conn(0x7f6124074580 legacy=0x7f61241d2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 >> v1:172.21.15.81:6791/0 conn(0x7f612409dd10 legacy=0x7f61241d5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient: _finish_hunting 0 2024-09-10T16:34:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 monclient: found mon.d 2024-09-10T16:34:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6124139530 con 0x7f6124073a90 2024-09-10T16:34:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient: _finish_auth 0 2024-09-10T16:34:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient: _check_auth_tickets 2024-09-10T16:34:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 5 monclient: authenticate success, global_id 144195 2024-09-10T16:34:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 monclient: _renew_subs 2024-09-10T16:34:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f612413b230 con 0x7f6124073a90 2024-09-10T16:34:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 monclient: _renew_subs 2024-09-10T16:34:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f612413ae20 con 0x7f6124073a90 2024-09-10T16:34:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6114001980 con 0x7f6124073a90 2024-09-10T16:34:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6114004b00 con 0x7f6124073a90 2024-09-10T16:34:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f61217fa640 4 set_mon_vals no callback set 2024-09-10T16:34:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 10 monclient: dump: 2024-09-10T16:34:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.541 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.542 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f6123fff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f61040065d0 con 0x7f6104002870 2024-09-10T16:34:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f6114010ea0 con 0x7f6124073a90 2024-09-10T16:34:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.516+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(225..225 src has 121..225) ==== 3506+0+0 (unknown 2064295275 0 0) 0x7f611404ad70 con 0x7f6124073a90 2024-09-10T16:34:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f61237fe640 10 monclient: get_auth_request con 0x7f611003da20 auth_method 0 2024-09-10T16:34:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 31284838 0 0) 0x7f61040065d0 con 0x7f6104002870 2024-09-10T16:34:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 10 monclient(hunting): my global_id is 5995 2024-09-10T16:34:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f612413ca10 con 0x7f6104002870 2024-09-10T16:34:33.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1532716405 0 0) 0x7f612413ca10 con 0x7f6104002870 2024-09-10T16:34:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f61040065d0 con 0x7f6104002870 2024-09-10T16:34:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6118004b30 con 0x7f6104002870 2024-09-10T16:34:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:34:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 10 monclient: dump: 2024-09-10T16:34:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.543 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.544 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4080210364 0 0) 0x7f61040065d0 con 0x7f6104002870 2024-09-10T16:34:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.189:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f610400a170 con 0x7f6104002870 2024-09-10T16:34:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f6118007480 con 0x7f6104002870 2024-09-10T16:34:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:33.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 >> v1:172.21.15.189:6789/0 conn(0x7f6104002870 legacy=0x7f6104004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.520+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 >> v1:172.21.15.189:6789/0 conn(0x7f6104002870 legacy=0x7f6104004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:33.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.524+0000 7f6123fff640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.524+0000 7f6123fff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6104009e80 con 0x7f6104009140 2024-09-10T16:34:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 477009114 0 0) 0x7f6104009e80 con 0x7f6104009140 2024-09-10T16:34:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 10 monclient(hunting): my global_id is 6004 2024-09-10T16:34:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f61040065d0 con 0x7f6104009140 2024-09-10T16:34:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 186681000 0 0) 0x7f61040065d0 con 0x7f6104009140 2024-09-10T16:34:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6104009e80 con 0x7f6104009140 2024-09-10T16:34:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f61180055f0 con 0x7f6104009140 2024-09-10T16:34:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:34:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 10 monclient: dump: 2024-09-10T16:34:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.547 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.548 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1076615784 0 0) 0x7f6104009e80 con 0x7f6104009140 2024-09-10T16:34:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 --> v1:172.21.15.189:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f610400c420 con 0x7f6104009140 2024-09-10T16:34:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 1243412473) 0x7f6118007630 con 0x7f6104009140 2024-09-10T16:34:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 >> v1:172.21.15.189:6789/0 conn(0x7f6104009140 legacy=0x7f61040095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f610bfff640 1 -- 172.21.15.81:0/4035391173 >> v1:172.21.15.189:6789/0 conn(0x7f6104009140 legacy=0x7f61040095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:33.548 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:33.549 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:33.549 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:33.549 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:33.549 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:33.549 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 283444, 2024-09-10T16:34:33.549 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:33.549 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:33.549 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:33.549 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:33.549 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:33.549 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:33.549 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:33.549 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:33.550 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:33.550 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:33.550 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.550 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:34:33.550 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:33.550 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:33.550 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:33.550 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.550 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.550 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.550 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.550 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.550 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.551 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.551 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.551 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.551 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.551 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.551 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:33.551 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:33.551 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.552 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.552 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.552 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.552 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.552 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.552 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.552 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.552 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.552 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.552 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.552 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:33.552 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:33.553 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:33.553 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:33.553 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:33.553 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:33.553 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:33.553 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:33.553 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:33.553 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:33.553 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:33.553 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:33.553 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:33.553 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:33.553 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:33.554 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:33.554 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:33.554 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.554 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.554 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.554 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.554 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.554 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.554 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.554 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.554 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.554 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.555 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.555 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:33.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.555 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:33.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.555 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:33.555 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:33.555 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.555 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.555 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:33.555 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.556 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.556 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:33.556 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:33.556 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.556 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.556 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.556 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:33.556 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:33.556 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.556 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:33.557 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.557 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.557 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.557 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:33.557 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:33.557 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.557 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.557 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.557 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.558 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:33.558 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:33.558 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.558 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.558 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.558 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:33.558 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.558 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.558 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.558 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:33.558 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:33.558 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.559 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.559 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.559 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:33.559 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:33.559 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.559 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.559 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.559 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:33.559 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.559 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.560 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.560 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:33.560 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:33.560 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.560 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.560 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.560 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:33.560 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:33.560 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.560 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.560 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.561 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:33.562 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:33.562 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.562 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.562 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.562 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:33.562 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.562 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.562 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.562 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:33.562 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:33.562 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.563 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.564 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:33.564 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:33.564 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.564 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.564 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.564 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:33.564 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:33.564 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.564 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.565 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.565 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.565 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:33.565 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.565 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.565 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.565 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:33.565 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:33.565 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.565 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.566 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.566 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:33.566 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:33.566 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.566 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.566 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.566 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:33.566 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.566 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.566 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.567 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:33.567 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:33.567 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.567 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.567 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.567 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.567 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.567 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:33.567 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:33.567 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.567 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.567 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.567 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:33.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.568 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.568 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:33.568 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.568 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.568 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.568 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:34:33.568 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.568 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.568 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:33.568 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:33.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f6123fff640 1 -- 172.21.15.81:0/4035391173 >> v1:172.21.15.189:6812/1108603242 conn(0x7f611003da20 legacy=0x7f611003fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f6123fff640 10 monclient: shutdown 2024-09-10T16:34:33.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f6123fff640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:33.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f6123fff640 1 -- 172.21.15.81:0/4035391173 >> v1:172.21.15.81:6792/0 conn(0x7f6124073a90 legacy=0x7f612413a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f61237fe640 1 -- 172.21.15.81:0/4035391173 reap_dead start 2024-09-10T16:34:33.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f61237fe640 1 -- 172.21.15.81:0/4035391173 reap_dead start 2024-09-10T16:34:33.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f6123fff640 1 -- 172.21.15.81:0/4035391173 shutdown_connections 2024-09-10T16:34:33.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f6123fff640 1 -- 172.21.15.81:0/4035391173 >> 172.21.15.81:0/4035391173 conn(0x7f61240a3d80 msgr2=0x7f612409f610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:33.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f6123fff640 1 -- 172.21.15.81:0/4035391173 shutdown_connections 2024-09-10T16:34:33.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.528+0000 7f6123fff640 1 -- 172.21.15.81:0/4035391173 wait complete. 2024-09-10T16:34:33.571 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:33.571 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-10T16:34:33.571 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-10T16:34:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 10 monclient: get_monmap_and_config 2024-09-10T16:34:33.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 10 monclient: build_initial_monmap 2024-09-10T16:34:33.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 10 monclient: monmap: 2024-09-10T16:34:33.690 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:33.690 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.690 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:33.690231+0000 2024-09-10T16:34:33.690 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:33.690231+0000 2024-09-10T16:34:33.690 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:33.690 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.690 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:33.690 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:33.690 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:33.690 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:33.690 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:33.691 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:33.691 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:33.691 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:33.691 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:33.691 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 1 Processor -- start 2024-09-10T16:34:33.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 1 -- start start 2024-09-10T16:34:33.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 10 monclient: init 2024-09-10T16:34:33.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:33.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 10 monclient: _add_conns ranks=[1,4,8,0,7,5,6,2,3] 2024-09-10T16:34:33.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 10 monclient(hunting): picked mon.noname-f con 0x7f681806e990 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:33.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 10 monclient(hunting): picked mon.noname-c con 0x7f68180a4600 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:33.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 10 monclient(hunting): picked mon.noname-e con 0x7f68180a49e0 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:33.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f681806f7f0 con 0x7f681806e990 2024-09-10T16:34:33.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68180a5630 con 0x7f68180a4600 2024-09-10T16:34:33.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6818070900 con 0x7f68180a49e0 2024-09-10T16:34:33.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:33.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 10 monclient(hunting): authenticate will time out at 1241.089775s 2024-09-10T16:34:33.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681e1a7640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f68180a49e0 0x7f6818141a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:59106/0 (socket says 172.21.15.81:59106) 2024-09-10T16:34:33.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681d1a5640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f68180a4600 0x7f681813e2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:41724/0 (socket says 172.21.15.81:41724) 2024-09-10T16:34:33.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681e1a7640 1 -- 172.21.15.81:0/4159920758 learned_addr learned my addr 172.21.15.81:0/4159920758 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:33.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 1 -- 172.21.15.81:0/4159920758 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 739021515 0 0) 0x7f6818070900 con 0x7f68180a49e0 2024-09-10T16:34:33.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient(hunting): my global_id is 5867 2024-09-10T16:34:33.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 1 -- 172.21.15.81:0/4159920758 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6804003530 con 0x7f68180a49e0 2024-09-10T16:34:33.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 1 -- 172.21.15.81:0/4159920758 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4115616307 0 0) 0x7f68180a5630 con 0x7f68180a4600 2024-09-10T16:34:33.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient(hunting): my global_id is 144211 2024-09-10T16:34:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 1 -- 172.21.15.81:0/4159920758 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6818070900 con 0x7f68180a4600 2024-09-10T16:34:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 1 -- 172.21.15.81:0/4159920758 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 823654291 0 0) 0x7f6804003530 con 0x7f68180a49e0 2024-09-10T16:34:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 1 -- 172.21.15.81:0/4159920758 >> v1:172.21.15.81:6791/0 conn(0x7f68180a4600 legacy=0x7f681813e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 1 -- 172.21.15.81:0/4159920758 >> v1:172.21.15.189:6789/0 conn(0x7f681806e990 legacy=0x7f68180a3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient: _finish_hunting 0 2024-09-10T16:34:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 1 monclient: found mon.noname-e 2024-09-10T16:34:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:34:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 1 -- 172.21.15.81:0/4159920758 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6818070630 con 0x7f68180a49e0 2024-09-10T16:34:33.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient: _finish_auth 0 2024-09-10T16:34:33.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient: _check_auth_tickets 2024-09-10T16:34:33.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:33.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 1 -- 172.21.15.81:0/4159920758 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6810001770 con 0x7f68180a49e0 2024-09-10T16:34:33.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:34:33.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient: dump: 2024-09-10T16:34:33.701 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.701 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.701 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.701 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.701 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.701 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.701 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.702 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 5 monclient: authenticate success, global_id 5867 2024-09-10T16:34:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 1 -- 172.21.15.81:0/4159920758 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6810001910 con 0x7f68180a49e0 2024-09-10T16:34:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:33.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 1 -- 172.21.15.81:0/4159920758 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6810004bf0 con 0x7f68180a49e0 2024-09-10T16:34:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681c9a4640 10 monclient: dump: 2024-09-10T16:34:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.703 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.704 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 4 set_mon_vals no callback set 2024-09-10T16:34:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 10 monclient: shutdown 2024-09-10T16:34:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 1 -- 172.21.15.81:0/4159920758 >> v1:172.21.15.81:6793/0 conn(0x7f68180a49e0 legacy=0x7f6818141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 1 -- 172.21.15.81:0/4159920758 shutdown_connections 2024-09-10T16:34:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 1 -- 172.21.15.81:0/4159920758 >> 172.21.15.81:0/4159920758 conn(0x7f68180a94f0 msgr2=0x7f68180a9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:33.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 1 -- 172.21.15.81:0/4159920758 shutdown_connections 2024-09-10T16:34:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.688+0000 7f681fc0a640 1 -- 172.21.15.81:0/4159920758 wait complete. 2024-09-10T16:34:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 monclient: build_initial_monmap 2024-09-10T16:34:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 monclient: monmap: 2024-09-10T16:34:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:33.705 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:33.706 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 1 Processor -- start 2024-09-10T16:34:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 1 -- start start 2024-09-10T16:34:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 monclient: init 2024-09-10T16:34:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 monclient: _add_conns ranks=[0,2,3,6,1,7,8,4,5] 2024-09-10T16:34:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 monclient(hunting): picked mon.noname-a con 0x7f681806e990 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 monclient(hunting): picked mon.noname-b con 0x7f68180a4600 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:33.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 monclient(hunting): picked mon.noname-g con 0x7f68180a49e0 addr v1:172.21.15.189:6790/0 2024-09-10T16:34:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6818142130 con 0x7f681806e990 2024-09-10T16:34:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68180a6cf0 con 0x7f68180a4600 2024-09-10T16:34:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f68180a9100 con 0x7f68180a49e0 2024-09-10T16:34:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 monclient(hunting): authenticate will time out at 1241.093068s 2024-09-10T16:34:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681d1a5640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f68180a4600 0x7f68181d2970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:33236/0 (socket says 172.21.15.81:33236) 2024-09-10T16:34:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681d1a5640 1 -- 172.21.15.81:0/307490028 learned_addr learned my addr 172.21.15.81:0/307490028 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4030062171 0 0) 0x7f68180a6cf0 con 0x7f68180a4600 2024-09-10T16:34:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): my global_id is 144200 2024-09-10T16:34:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67fc003560 con 0x7f68180a4600 2024-09-10T16:34:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2022001109 0 0) 0x7f6818142130 con 0x7f681806e990 2024-09-10T16:34:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): my global_id is 5769 2024-09-10T16:34:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68180a6cf0 con 0x7f681806e990 2024-09-10T16:34:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2431678371 0 0) 0x7f68180a6cf0 con 0x7f681806e990 2024-09-10T16:34:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6818142130 con 0x7f681806e990 2024-09-10T16:34:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1481574080 0 0) 0x7f67fc003560 con 0x7f68180a4600 2024-09-10T16:34:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68180a6cf0 con 0x7f68180a4600 2024-09-10T16:34:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f680c001980 con 0x7f681806e990 2024-09-10T16:34:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:34:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): dump: 2024-09-10T16:34:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.710 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6814001f20 con 0x7f68180a4600 2024-09-10T16:34:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): dump: 2024-09-10T16:34:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.710 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.711 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2592592257 0 0) 0x7f68180a9100 con 0x7f68180a49e0 2024-09-10T16:34:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): my global_id is 134877 2024-09-10T16:34:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f67fc003560 con 0x7f68180a49e0 2024-09-10T16:34:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 722911862 0 0) 0x7f68180a6cf0 con 0x7f68180a4600 2024-09-10T16:34:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 >> v1:172.21.15.189:6790/0 conn(0x7f68180a49e0 legacy=0x7f68181d60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 >> v1:172.21.15.81:6789/0 conn(0x7f681806e990 legacy=0x7f6818141a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:34:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 monclient: found mon.b 2024-09-10T16:34:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6818127020 con 0x7f68180a4600 2024-09-10T16:34:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient: _finish_auth 0 2024-09-10T16:34:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:34:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 5 monclient: authenticate success, global_id 144200 2024-09-10T16:34:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 monclient: _renew_subs 2024-09-10T16:34:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f68181269d0 con 0x7f68180a4600 2024-09-10T16:34:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 monclient: _renew_subs 2024-09-10T16:34:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f68181cdb00 con 0x7f68180a4600 2024-09-10T16:34:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6814004e20 con 0x7f68180a4600 2024-09-10T16:34:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6814005390 con 0x7f68180a4600 2024-09-10T16:34:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680bfff640 4 set_mon_vals no callback set 2024-09-10T16:34:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient: dump: 2024-09-10T16:34:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.715 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681fc0a640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f68000065d0 con 0x7f6800002870 2024-09-10T16:34:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f6814005530 con 0x7f68180a4600 2024-09-10T16:34:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(225..225 src has 121..225) ==== 3506+0+0 (unknown 2064295275 0 0) 0x7f681404b170 con 0x7f68180a4600 2024-09-10T16:34:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3305701900 0 0) 0x7f68000065d0 con 0x7f6800002870 2024-09-10T16:34:33.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 10 monclient(hunting): my global_id is 134886 2024-09-10T16:34:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68180a6cf0 con 0x7f6800002870 2024-09-10T16:34:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.692+0000 7f681e1a7640 10 monclient: get_auth_request con 0x7f67fc03d6f0 auth_method 0 2024-09-10T16:34:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.696+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2259112187 0 0) 0x7f68180a6cf0 con 0x7f6800002870 2024-09-10T16:34:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.696+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f68000065d0 con 0x7f6800002870 2024-09-10T16:34:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.696+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f680c003c10 con 0x7f6800002870 2024-09-10T16:34:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.696+0000 7f680a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.696+0000 7f680a7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:34:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.696+0000 7f680a7fc640 10 monclient: dump: 2024-09-10T16:34:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.717 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.718 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.718 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.718 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.696+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3088082916 0 0) 0x7f68000065d0 con 0x7f6800002870 2024-09-10T16:34:33.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.696+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.189:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f680000a170 con 0x7f6800002870 2024-09-10T16:34:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.696+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.3 v1:172.21.15.189:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f680c005130 con 0x7f6800002870 2024-09-10T16:34:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.696+0000 7f680a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.696+0000 7f680a7fc640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.696+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 >> v1:172.21.15.189:6790/0 conn(0x7f6800002870 legacy=0x7f6800004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.696+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 >> v1:172.21.15.189:6790/0 conn(0x7f6800002870 legacy=0x7f6800004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.700+0000 7f681fc0a640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.700+0000 7f681fc0a640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f6800009e80 con 0x7f6800009140 2024-09-10T16:34:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3617827552 0 0) 0x7f6800009e80 con 0x7f6800009140 2024-09-10T16:34:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 10 monclient(hunting): my global_id is 134895 2024-09-10T16:34:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f68000065d0 con 0x7f6800009140 2024-09-10T16:34:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2706448327 0 0) 0x7f68000065d0 con 0x7f6800009140 2024-09-10T16:34:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f6800009e80 con 0x7f6800009140 2024-09-10T16:34:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f680c005950 con 0x7f6800009140 2024-09-10T16:34:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:34:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 10 monclient: dump: 2024-09-10T16:34:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.721 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.722 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3370886195 0 0) 0x7f6800009e80 con 0x7f6800009140 2024-09-10T16:34:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 --> v1:172.21.15.189:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f680000c420 con 0x7f6800009140 2024-09-10T16:34:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 <== mon.3 v1:172.21.15.189:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 1634093034) 0x7f680c005a40 con 0x7f6800009140 2024-09-10T16:34:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 >> v1:172.21.15.189:6790/0 conn(0x7f6800009140 legacy=0x7f68000095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f680a7fc640 1 -- 172.21.15.81:0/307490028 >> v1:172.21.15.189:6790/0 conn(0x7f6800009140 legacy=0x7f68000095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:33.723 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:33.723 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:33.723 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:33.723 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:33.724 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:33.724 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 143424, 2024-09-10T16:34:33.724 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:33.724 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:33.724 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:33.724 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:33.724 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:33.724 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:33.724 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:33.724 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:33.724 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:33.724 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:33.724 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.725 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:34:33.725 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:33.725 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:33.725 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:33.725 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.725 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.725 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.725 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.725 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.725 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.725 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.725 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.725 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.726 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.726 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.726 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.726 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:33.726 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:33.726 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.726 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.726 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.726 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.726 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.726 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.726 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:33.727 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:33.728 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:33.728 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:33.728 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:33.728 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:33.728 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:33.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:33.728 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:33.728 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:33.728 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:33.728 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.728 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.728 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.729 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.729 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.729 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.729 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.729 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.729 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.729 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.729 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.729 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.729 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:33.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.729 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:33.729 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.730 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:33.730 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:33.730 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.730 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.730 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.730 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:33.730 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.730 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.730 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.730 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.730 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:33.731 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:33.731 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.731 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.731 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.731 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:33.731 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:33.731 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.731 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.731 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.731 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:33.732 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.732 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.732 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.732 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:33.732 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:33.732 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.732 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.732 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.732 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.732 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:33.732 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:33.733 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.733 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.733 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.733 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:33.733 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.733 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.733 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.733 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:33.733 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:33.733 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.733 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.734 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.734 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:33.734 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:33.734 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.734 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.734 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.734 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.734 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:33.734 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.734 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.734 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.735 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:33.735 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:33.735 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.735 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.735 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.735 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.735 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:33.735 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:33.735 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.735 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.735 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.736 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:33.736 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.736 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.736 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:33.736 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:33.736 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.736 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.736 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.736 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:33.737 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:33.737 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.737 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.737 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.737 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.737 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:33.737 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.737 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.737 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.737 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.737 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:33.737 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:33.737 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.738 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.738 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.738 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:33.738 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:33.738 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.738 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.738 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.738 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:33.738 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.738 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.739 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.739 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:33.739 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:33.739 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.739 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.739 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.739 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.739 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:33.739 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:33.739 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.739 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.740 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.740 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.740 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:33.740 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.740 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.740 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.740 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:33.740 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:33.740 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.740 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.740 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.740 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:33.741 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:33.742 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.742 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.742 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.742 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.742 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:33.742 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:33.742 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.742 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.742 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.742 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:33.742 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.743 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.743 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:33.743 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.743 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.743 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.743 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:34:33.743 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.743 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.743 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:33.743 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f681fc0a640 1 -- 172.21.15.81:0/307490028 >> v1:172.21.15.189:6812/1108603242 conn(0x7f67fc03d6f0 legacy=0x7f67fc03fbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f681fc0a640 10 monclient: shutdown 2024-09-10T16:34:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f681fc0a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f681fc0a640 1 -- 172.21.15.81:0/307490028 >> v1:172.21.15.81:6790/0 conn(0x7f68180a4600 legacy=0x7f68181d2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f681e1a7640 1 -- 172.21.15.81:0/307490028 reap_dead start 2024-09-10T16:34:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f681e1a7640 1 -- 172.21.15.81:0/307490028 reap_dead start 2024-09-10T16:34:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f681fc0a640 1 -- 172.21.15.81:0/307490028 shutdown_connections 2024-09-10T16:34:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f681fc0a640 1 -- 172.21.15.81:0/307490028 >> 172.21.15.81:0/307490028 conn(0x7f68180a94f0 msgr2=0x7f6818142870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f681fc0a640 1 -- 172.21.15.81:0/307490028 shutdown_connections 2024-09-10T16:34:33.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.704+0000 7f681fc0a640 1 -- 172.21.15.81:0/307490028 wait complete. 2024-09-10T16:34:33.746 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:33.746 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-10T16:34:33.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-10T16:34:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.860+0000 7efcd1696640 10 monclient: get_monmap_and_config 2024-09-10T16:34:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.860+0000 7efcd1696640 10 monclient: build_initial_monmap 2024-09-10T16:34:33.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 10 monclient: monmap: 2024-09-10T16:34:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:33.866062+0000 2024-09-10T16:34:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:33.866062+0000 2024-09-10T16:34:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:33.866 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:33.867 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:33.867 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:33.867 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 1 Processor -- start 2024-09-10T16:34:33.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 1 -- start start 2024-09-10T16:34:33.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 10 monclient: init 2024-09-10T16:34:33.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:33.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 10 monclient: _add_conns ranks=[1,2,8,3,6,5,0,4,7] 2024-09-10T16:34:33.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 10 monclient(hunting): picked mon.noname-f con 0x7efccc0a3ef0 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:33.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 10 monclient(hunting): picked mon.noname-b con 0x7efccc073d20 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:33.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 10 monclient(hunting): picked mon.noname-e con 0x7efccc0a49e0 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:33.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efccc073870 con 0x7efccc0a3ef0 2024-09-10T16:34:33.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efccc0a5630 con 0x7efccc073d20 2024-09-10T16:34:33.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efccc073590 con 0x7efccc0a49e0 2024-09-10T16:34:33.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:33.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 10 monclient(hunting): authenticate will time out at 1241.265634s 2024-09-10T16:34:33.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efccb7fe640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7efccc0a49e0 0x7efccc13f830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:59116/0 (socket says 172.21.15.81:59116) 2024-09-10T16:34:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcca7fc640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7efccc073d20 0x7efccc13c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:33244/0 (socket says 172.21.15.81:33244) 2024-09-10T16:34:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efccb7fe640 1 -- 172.21.15.81:0/2889012038 learned_addr learned my addr 172.21.15.81:0/2889012038 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 1 -- 172.21.15.81:0/2889012038 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3363322264 0 0) 0x7efccc0a5630 con 0x7efccc073d20 2024-09-10T16:34:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient(hunting): my global_id is 144209 2024-09-10T16:34:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 1 -- 172.21.15.81:0/2889012038 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcb4003530 con 0x7efccc073d20 2024-09-10T16:34:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 1 -- 172.21.15.81:0/2889012038 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3268433898 0 0) 0x7efccc073590 con 0x7efccc0a49e0 2024-09-10T16:34:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient(hunting): my global_id is 5876 2024-09-10T16:34:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 1 -- 172.21.15.81:0/2889012038 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efccc0a5630 con 0x7efccc0a49e0 2024-09-10T16:34:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 1 -- 172.21.15.81:0/2889012038 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 211337806 0 0) 0x7efcb4003530 con 0x7efccc073d20 2024-09-10T16:34:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 1 -- 172.21.15.81:0/2889012038 >> v1:172.21.15.81:6793/0 conn(0x7efccc0a49e0 legacy=0x7efccc13f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 1 -- 172.21.15.81:0/2889012038 >> v1:172.21.15.189:6789/0 conn(0x7efccc0a3ef0 legacy=0x7efccc0a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:34:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 1 monclient: found mon.noname-b 2024-09-10T16:34:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:34:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 1 -- 172.21.15.81:0/2889012038 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc0a5870 con 0x7efccc073d20 2024-09-10T16:34:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient: _finish_auth 0 2024-09-10T16:34:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:34:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:33.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 1 -- 172.21.15.81:0/2889012038 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7efcc0001840 con 0x7efccc073d20 2024-09-10T16:34:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient: dump: 2024-09-10T16:34:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.877 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.878 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 5 monclient: authenticate success, global_id 144209 2024-09-10T16:34:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 1 -- 172.21.15.81:0/2889012038 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efcc0001a60 con 0x7efccc073d20 2024-09-10T16:34:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 4 set_mon_vals no callback set 2024-09-10T16:34:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 1 -- 172.21.15.81:0/2889012038 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7efcc0004b30 con 0x7efccc073d20 2024-09-10T16:34:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcc9ffb640 10 monclient: dump: 2024-09-10T16:34:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.879 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.880 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.880 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.880 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 10 monclient: shutdown 2024-09-10T16:34:33.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:33.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 1 -- 172.21.15.81:0/2889012038 >> v1:172.21.15.81:6790/0 conn(0x7efccc073d20 legacy=0x7efccc13c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 1 -- 172.21.15.81:0/2889012038 shutdown_connections 2024-09-10T16:34:33.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 1 -- 172.21.15.81:0/2889012038 >> 172.21.15.81:0/2889012038 conn(0x7efccc0a94f0 msgr2=0x7efccc0a9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:33.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 1 -- 172.21.15.81:0/2889012038 shutdown_connections 2024-09-10T16:34:33.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.864+0000 7efcd1696640 1 -- 172.21.15.81:0/2889012038 wait complete. 2024-09-10T16:34:33.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 monclient: build_initial_monmap 2024-09-10T16:34:33.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 monclient: monmap: 2024-09-10T16:34:33.880 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:33.881 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:33.882 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 1 Processor -- start 2024-09-10T16:34:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 1 -- start start 2024-09-10T16:34:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 monclient: init 2024-09-10T16:34:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 monclient: _add_conns ranks=[8,2,5,1,4,3,7,6,0] 2024-09-10T16:34:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 monclient(hunting): picked mon.noname-e con 0x7efccc073d20 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 monclient(hunting): picked mon.noname-b con 0x7efccc0a3ef0 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 monclient(hunting): picked mon.noname-h con 0x7efccc0a49e0 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efccc070480 con 0x7efccc0a3ef0 2024-09-10T16:34:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efccc0a69f0 con 0x7efccc0a49e0 2024-09-10T16:34:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efccc128c70 con 0x7efccc073d20 2024-09-10T16:34:33.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 monclient(hunting): authenticate will time out at 1241.269243s 2024-09-10T16:34:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efccaffd640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7efccc073d20 0x7efccc13f5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:59124/0 (socket says 172.21.15.81:59124) 2024-09-10T16:34:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcca7fc640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7efccc0a3ef0 0x7efccc1d2790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:33246/0 (socket says 172.21.15.81:33246) 2024-09-10T16:34:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efccaffd640 1 -- 172.21.15.81:0/1618079537 learned_addr learned my addr 172.21.15.81:0/1618079537 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3005951981 0 0) 0x7efccc070480 con 0x7efccc0a3ef0 2024-09-10T16:34:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): my global_id is 144218 2024-09-10T16:34:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcb8003530 con 0x7efccc0a3ef0 2024-09-10T16:34:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3555705626 0 0) 0x7efccc128c70 con 0x7efccc073d20 2024-09-10T16:34:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): my global_id is 5885 2024-09-10T16:34:33.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efccc070480 con 0x7efccc073d20 2024-09-10T16:34:33.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3960686213 0 0) 0x7efcb8003530 con 0x7efccc0a3ef0 2024-09-10T16:34:33.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efccc128c70 con 0x7efccc0a3ef0 2024-09-10T16:34:33.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7efcc0001800 con 0x7efccc0a3ef0 2024-09-10T16:34:33.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:33.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:33.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): dump: 2024-09-10T16:34:33.884 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.884 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.884 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.884 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.884 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.885 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.885 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.885 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.885 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.885 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.885 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.885 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.885 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.885 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.885 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.885 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:33.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4080125954 0 0) 0x7efccc070480 con 0x7efccc073d20 2024-09-10T16:34:33.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcb8003530 con 0x7efccc073d20 2024-09-10T16:34:33.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7efcbc001a20 con 0x7efccc073d20 2024-09-10T16:34:33.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:33.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:33.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): dump: 2024-09-10T16:34:33.886 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.886 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.886 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.886 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.886 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.886 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.886 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.886 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.886 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.886 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.887 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.887 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.887 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.887 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.887 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.887 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3760712207 0 0) 0x7efcc40015a0 con 0x7efccc0a49e0 2024-09-10T16:34:33.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): my global_id is 5783 2024-09-10T16:34:33.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efccc070480 con 0x7efccc0a49e0 2024-09-10T16:34:33.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 210469356 0 0) 0x7efccc128c70 con 0x7efccc0a3ef0 2024-09-10T16:34:33.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 >> v1:172.21.15.81:6793/0 conn(0x7efccc073d20 legacy=0x7efccc13f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 >> v1:172.21.15.189:6791/0 conn(0x7efccc0a49e0 legacy=0x7efccc1d5ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient: _finish_hunting 0 2024-09-10T16:34:33.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 monclient: found mon.b 2024-09-10T16:34:33.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:33.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:33.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efccc128f50 con 0x7efccc0a3ef0 2024-09-10T16:34:33.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient: _finish_auth 0 2024-09-10T16:34:33.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient: _check_auth_tickets 2024-09-10T16:34:33.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:33.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 5 monclient: authenticate success, global_id 144218 2024-09-10T16:34:33.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 monclient: _renew_subs 2024-09-10T16:34:33.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:33.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7efccc09ffd0 con 0x7efccc0a3ef0 2024-09-10T16:34:33.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 monclient: _renew_subs 2024-09-10T16:34:33.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:33.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7efccc13fcc0 con 0x7efccc0a3ef0 2024-09-10T16:34:33.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7efcc0004df0 con 0x7efccc0a3ef0 2024-09-10T16:34:33.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:33.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcc97fa640 4 set_mon_vals no callback set 2024-09-10T16:34:33.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7efcc0001a60 con 0x7efccc0a3ef0 2024-09-10T16:34:33.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:33.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient: dump: 2024-09-10T16:34:33.889 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.889 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.889 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.890 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.890 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.890 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.890 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.890 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.890 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.890 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.890 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.890 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.890 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.890 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.890 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.890 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcd1696640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efcac0065d0 con 0x7efcac002870 2024-09-10T16:34:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7efcc0011050 con 0x7efccc0a3ef0 2024-09-10T16:34:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(225..225 src has 121..225) ==== 3506+0+0 (unknown 2064295275 0 0) 0x7efcc004ada0 con 0x7efccc0a3ef0 2024-09-10T16:34:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 320983143 0 0) 0x7efcac0065d0 con 0x7efcac002870 2024-09-10T16:34:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 10 monclient(hunting): my global_id is 5792 2024-09-10T16:34:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efccc128c70 con 0x7efcac002870 2024-09-10T16:34:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.868+0000 7efccb7fe640 10 monclient: get_auth_request con 0x7efcb803d9c0 auth_method 0 2024-09-10T16:34:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.872+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 244784695 0 0) 0x7efccc128c70 con 0x7efcac002870 2024-09-10T16:34:33.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.872+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcac0065d0 con 0x7efcac002870 2024-09-10T16:34:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.872+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7efcbc0039a0 con 0x7efcac002870 2024-09-10T16:34:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.872+0000 7efcb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.872+0000 7efcb37fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:34:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.872+0000 7efcb37fe640 10 monclient: dump: 2024-09-10T16:34:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.892 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.893 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.872+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2385430589 0 0) 0x7efcac0065d0 con 0x7efcac002870 2024-09-10T16:34:33.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.872+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.189:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7efcac00a170 con 0x7efcac002870 2024-09-10T16:34:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.872+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7efcbc0057b0 con 0x7efcac002870 2024-09-10T16:34:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.872+0000 7efcb37fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.872+0000 7efcb37fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.872+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 >> v1:172.21.15.189:6791/0 conn(0x7efcac002870 legacy=0x7efcac004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.872+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 >> v1:172.21.15.189:6791/0 conn(0x7efcac002870 legacy=0x7efcac004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.876+0000 7efcd1696640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.876+0000 7efcd1696640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7efcac009e10 con 0x7efcac0090f0 2024-09-10T16:34:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3511232000 0 0) 0x7efcac009e10 con 0x7efcac0090f0 2024-09-10T16:34:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:33.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 10 monclient(hunting): my global_id is 5801 2024-09-10T16:34:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efcac0065d0 con 0x7efcac0090f0 2024-09-10T16:34:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4147495706 0 0) 0x7efcac0065d0 con 0x7efcac0090f0 2024-09-10T16:34:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7efcac009e10 con 0x7efcac0090f0 2024-09-10T16:34:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7efcbc004380 con 0x7efcac0090f0 2024-09-10T16:34:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:34:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 10 monclient: dump: 2024-09-10T16:34:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:33.896 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:33.897 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 117883197 0 0) 0x7efcac009e10 con 0x7efcac0090f0 2024-09-10T16:34:33.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 --> v1:172.21.15.189:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7efcac00c3b0 con 0x7efcac0090f0 2024-09-10T16:34:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 1592899428) 0x7efcbc005960 con 0x7efcac0090f0 2024-09-10T16:34:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 >> v1:172.21.15.189:6791/0 conn(0x7efcac0090f0 legacy=0x7efcac009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcb37fe640 1 -- 172.21.15.81:0/1618079537 >> v1:172.21.15.189:6791/0 conn(0x7efcac0090f0 legacy=0x7efcac009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:33.898 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:33.898 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 283804, 2024-09-10T16:34:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:34:33.899 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.900 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.901 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:33.902 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:33.903 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:33.904 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.906 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:33.907 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:33.908 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.909 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.910 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.911 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:33.912 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.913 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.914 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:33.915 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.916 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:34:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.917 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:33.918 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:33.918 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:33.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcd1696640 1 -- 172.21.15.81:0/1618079537 >> v1:172.21.15.189:6812/1108603242 conn(0x7efcb803d9c0 legacy=0x7efcb803fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcd1696640 10 monclient: shutdown 2024-09-10T16:34:33.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcd1696640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:33.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcd1696640 1 -- 172.21.15.81:0/1618079537 >> v1:172.21.15.81:6790/0 conn(0x7efccc0a3ef0 legacy=0x7efccc1d2790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:33.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efccb7fe640 1 -- 172.21.15.81:0/1618079537 reap_dead start 2024-09-10T16:34:33.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efccb7fe640 1 -- 172.21.15.81:0/1618079537 reap_dead start 2024-09-10T16:34:33.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcd1696640 1 -- 172.21.15.81:0/1618079537 shutdown_connections 2024-09-10T16:34:33.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcd1696640 1 -- 172.21.15.81:0/1618079537 >> 172.21.15.81:0/1618079537 conn(0x7efccc0a94f0 msgr2=0x7efccc140500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:33.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcd1696640 1 -- 172.21.15.81:0/1618079537 shutdown_connections 2024-09-10T16:34:33.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:33.880+0000 7efcd1696640 1 -- 172.21.15.81:0/1618079537 wait complete. 2024-09-10T16:34:33.921 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:33.921 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-10T16:34:33.921 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-10T16:34:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 10 monclient: get_monmap_and_config 2024-09-10T16:34:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 10 monclient: build_initial_monmap 2024-09-10T16:34:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 10 monclient: monmap: 2024-09-10T16:34:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:34.034441+0000 2024-09-10T16:34:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:34.034441+0000 2024-09-10T16:34:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:34.035 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:34.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 1 Processor -- start 2024-09-10T16:34:34.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 1 -- start start 2024-09-10T16:34:34.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 10 monclient: init 2024-09-10T16:34:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 10 monclient: _add_conns ranks=[4,5,1,0,6,8,3,7,2] 2024-09-10T16:34:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 10 monclient(hunting): picked mon.noname-c con 0x7f2d580a0a90 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 10 monclient(hunting): picked mon.noname-h con 0x7f2d580a35f0 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 10 monclient(hunting): picked mon.noname-f con 0x7f2d580a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5809df70 con 0x7f2d580a3a40 2024-09-10T16:34:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5809fa30 con 0x7f2d580a0a90 2024-09-10T16:34:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5809fd10 con 0x7f2d580a35f0 2024-09-10T16:34:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:34.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 10 monclient(hunting): authenticate will time out at 1241.433654s 2024-09-10T16:34:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d577fe640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f2d580a0a90 0x7f2d580a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:41734/0 (socket says 172.21.15.81:41734) 2024-09-10T16:34:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d577fe640 1 -- 172.21.15.81:0/3445100839 learned_addr learned my addr 172.21.15.81:0/3445100839 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 1 -- 172.21.15.81:0/3445100839 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2907435517 0 0) 0x7f2d5809fa30 con 0x7f2d580a0a90 2024-09-10T16:34:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient(hunting): my global_id is 144220 2024-09-10T16:34:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 1 -- 172.21.15.81:0/3445100839 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d40003530 con 0x7f2d580a0a90 2024-09-10T16:34:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 1 -- 172.21.15.81:0/3445100839 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 103424614 0 0) 0x7f2d5809df70 con 0x7f2d580a3a40 2024-09-10T16:34:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:34.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient(hunting): my global_id is 6031 2024-09-10T16:34:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 1 -- 172.21.15.81:0/3445100839 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d5809fa30 con 0x7f2d580a3a40 2024-09-10T16:34:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 1 -- 172.21.15.81:0/3445100839 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1373898444 0 0) 0x7f2d5809fd10 con 0x7f2d580a35f0 2024-09-10T16:34:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient(hunting): my global_id is 5810 2024-09-10T16:34:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 1 -- 172.21.15.81:0/3445100839 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d5809df70 con 0x7f2d580a35f0 2024-09-10T16:34:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 1 -- 172.21.15.81:0/3445100839 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1760960979 0 0) 0x7f2d5809fa30 con 0x7f2d580a3a40 2024-09-10T16:34:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 1 -- 172.21.15.81:0/3445100839 >> v1:172.21.15.189:6791/0 conn(0x7f2d580a35f0 legacy=0x7f2d5813c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 1 -- 172.21.15.81:0/3445100839 >> v1:172.21.15.81:6791/0 conn(0x7f2d580a0a90 legacy=0x7f2d580a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient: _finish_hunting 0 2024-09-10T16:34:34.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 1 monclient: found mon.noname-f 2024-09-10T16:34:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.189:6789/0 2024-09-10T16:34:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 1 -- 172.21.15.81:0/3445100839 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d5809fff0 con 0x7f2d580a3a40 2024-09-10T16:34:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient: _finish_auth 0 2024-09-10T16:34:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient: _check_auth_tickets 2024-09-10T16:34:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 1 -- 172.21.15.81:0/3445100839 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2d50001b60 con 0x7f2d580a3a40 2024-09-10T16:34:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-10T16:34:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient: dump: 2024-09-10T16:34:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.046 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:34.047 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:34.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 5 monclient: authenticate success, global_id 6031 2024-09-10T16:34:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 1 -- 172.21.15.81:0/3445100839 <== mon.1 v1:172.21.15.189:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2d50001d00 con 0x7f2d580a3a40 2024-09-10T16:34:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 1 -- 172.21.15.81:0/3445100839 <== mon.1 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2d50003980 con 0x7f2d580a3a40 2024-09-10T16:34:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:34:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d567fc640 10 monclient: dump: 2024-09-10T16:34:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:34.048 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 4 set_mon_vals no callback set 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 10 monclient: shutdown 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:34.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3445100839 >> v1:172.21.15.189:6789/0 conn(0x7f2d580a3a40 legacy=0x7f2d5813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3445100839 shutdown_connections 2024-09-10T16:34:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3445100839 >> 172.21.15.81:0/3445100839 conn(0x7f2d580a3fd0 msgr2=0x7f2d580a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3445100839 shutdown_connections 2024-09-10T16:34:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.032+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3445100839 wait complete. 2024-09-10T16:34:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 monclient: build_initial_monmap 2024-09-10T16:34:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 monclient: monmap: 2024-09-10T16:34:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:34.050 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:34.051 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 1 Processor -- start 2024-09-10T16:34:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 1 -- start start 2024-09-10T16:34:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 monclient: init 2024-09-10T16:34:34.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 monclient: _add_conns ranks=[0,5,8,3,2,4,6,7,1] 2024-09-10T16:34:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 monclient(hunting): picked mon.noname-a con 0x7f2d580a0a90 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 monclient(hunting): picked mon.noname-h con 0x7f2d580a35f0 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 monclient(hunting): picked mon.noname-e con 0x7f2d580a3a40 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d58098db0 con 0x7f2d580a0a90 2024-09-10T16:34:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5809c2f0 con 0x7f2d580a35f0 2024-09-10T16:34:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d5809cdd0 con 0x7f2d580a3a40 2024-09-10T16:34:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 monclient(hunting): authenticate will time out at 1241.437519s 2024-09-10T16:34:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d577fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f2d580a0a90 0x7f2d5809b4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53238/0 (socket says 172.21.15.81:53238) 2024-09-10T16:34:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d577fe640 1 -- 172.21.15.81:0/3059204294 learned_addr learned my addr 172.21.15.81:0/3059204294 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d577fe640 1 -- 172.21.15.81:0/3059204294 >> v1:172.21.15.81:6789/0 conn(0x7f2d580a0a90 legacy=0x7f2d5809b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-10T16:34:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d577fe640 1 -- 172.21.15.81:0/3059204294 >> v1:172.21.15.81:6789/0 conn(0x7f2d580a0a90 legacy=0x7f2d5809b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T16:34:34.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d577fe640 1 --1- 172.21.15.81:0/3059204294 >> v1:172.21.15.81:6789/0 conn(0x7f2d580a0a90 0x7f2d5809b4d0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).handle_connect_reply_1 read connect reply failed 2024-09-10T16:34:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d577fe640 1 --1- 172.21.15.81:0/3059204294 >> v1:172.21.15.81:6789/0 conn(0x7f2d580a0a90 0x7f2d5809b4d0 :-1 s=CONNECTING_SEND_CONNECT_MSG pgs=0 cs=0 l=1).fault on lossy channel, failing 2024-09-10T16:34:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient(hunting): ms_handle_reset hunted mon v1:172.21.15.81:6789/0 2024-09-10T16:34:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2723944179 0 0) 0x7f2d5809cdd0 con 0x7f2d580a3a40 2024-09-10T16:34:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient(hunting): my global_id is 5894 2024-09-10T16:34:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d44003530 con 0x7f2d580a3a40 2024-09-10T16:34:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3070934872 0 0) 0x7f2d44003530 con 0x7f2d580a3a40 2024-09-10T16:34:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d5809cdd0 con 0x7f2d580a3a40 2024-09-10T16:34:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2d50001b20 con 0x7f2d580a3a40 2024-09-10T16:34:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:34.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:34:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient(hunting): dump: 2024-09-10T16:34:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:34.054 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:34.055 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1819324261 0 0) 0x7f2d5809c2f0 con 0x7f2d580a35f0 2024-09-10T16:34:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient(hunting): my global_id is 5819 2024-09-10T16:34:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d44003530 con 0x7f2d580a35f0 2024-09-10T16:34:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3586145242 0 0) 0x7f2d5809cdd0 con 0x7f2d580a3a40 2024-09-10T16:34:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 >> v1:172.21.15.189:6791/0 conn(0x7f2d580a35f0 legacy=0x7f2d5809bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 >> v1:172.21.15.81:6789/0 conn(0x7f2d580a0a90 legacy=0x7f2d5809b4d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:34.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient: _finish_hunting 0 2024-09-10T16:34:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 monclient: found mon.e 2024-09-10T16:34:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d580a6b00 con 0x7f2d580a3a40 2024-09-10T16:34:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient: _finish_auth 0 2024-09-10T16:34:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient: _check_auth_tickets 2024-09-10T16:34:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 5 monclient: authenticate success, global_id 5894 2024-09-10T16:34:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 monclient: _renew_subs 2024-09-10T16:34:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3059204294 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f2d58073e90 con 0x7f2d580a3a40 2024-09-10T16:34:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 monclient: _renew_subs 2024-09-10T16:34:34.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3059204294 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f2d5809ac70 con 0x7f2d580a3a40 2024-09-10T16:34:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f2d50003cb0 con 0x7f2d580a3a40 2024-09-10T16:34:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2d50004220 con 0x7f2d580a3a40 2024-09-10T16:34:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d55ffb640 4 set_mon_vals no callback set 2024-09-10T16:34:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 10 monclient: dump: 2024-09-10T16:34:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:34.057 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:34.058 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f2d50004440 con 0x7f2d580a3a40 2024-09-10T16:34:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3059204294 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2d580008e0 con 0x7f2d5808efb0 2024-09-10T16:34:34.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(225..225 src has 121..225) ==== 3506+0+0 (unknown 2064295275 0 0) 0x7f2d50049e40 con 0x7f2d580a3a40 2024-09-10T16:34:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.036+0000 7f2d56ffd640 10 monclient: get_auth_request con 0x7f2d4403d0a0 auth_method 0 2024-09-10T16:34:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3267087845 0 0) 0x7f2d580008e0 con 0x7f2d5808efb0 2024-09-10T16:34:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 10 monclient(hunting): my global_id is 144187 2024-09-10T16:34:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d5809cdd0 con 0x7f2d5808efb0 2024-09-10T16:34:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2031593651 0 0) 0x7f2d5809cdd0 con 0x7f2d5808efb0 2024-09-10T16:34:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d580008e0 con 0x7f2d5808efb0 2024-09-10T16:34:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2d4c0015a0 con 0x7f2d5808efb0 2024-09-10T16:34:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:34:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 10 monclient: dump: 2024-09-10T16:34:34.059 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:34.060 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:34.061 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2000461371 0 0) 0x7f2d580008e0 con 0x7f2d5808efb0 2024-09-10T16:34:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 --> v1:172.21.15.189:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d5808faa0 con 0x7f2d5808efb0 2024-09-10T16:34:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.7 v1:172.21.15.189:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f2d4c001800 con 0x7f2d5808efb0 2024-09-10T16:34:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 >> v1:172.21.15.189:6792/0 conn(0x7f2d5808efb0 legacy=0x7f2d5808f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.040+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 >> v1:172.21.15.189:6792/0 conn(0x7f2d5808efb0 legacy=0x7f2d5808f390 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.044+0000 7f2d5dd23640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.044+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3059204294 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f2d5802e460 con 0x7f2d5808fc50 2024-09-10T16:34:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 221242435 0 0) 0x7f2d5802e460 con 0x7f2d5808fc50 2024-09-10T16:34:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:34.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 10 monclient(hunting): my global_id is 144196 2024-09-10T16:34:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d580008e0 con 0x7f2d5808fc50 2024-09-10T16:34:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2546143929 0 0) 0x7f2d580008e0 con 0x7f2d5808fc50 2024-09-10T16:34:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f2d5802e460 con 0x7f2d5808fc50 2024-09-10T16:34:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f2d4c004db0 con 0x7f2d5808fc50 2024-09-10T16:34:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:34:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 10 monclient: dump: 2024-09-10T16:34:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:34.063 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:34.064 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3204257097 0 0) 0x7f2d5802e460 con 0x7f2d5808fc50 2024-09-10T16:34:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 --> v1:172.21.15.189:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f2d581de9b0 con 0x7f2d5808fc50 2024-09-10T16:34:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 <== mon.7 v1:172.21.15.189:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 2344483624) 0x7f2d4c0062a0 con 0x7f2d5808fc50 2024-09-10T16:34:34.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:34.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:34.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 >> v1:172.21.15.189:6792/0 conn(0x7f2d5808fc50 legacy=0x7f2d581db100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d3ffff640 1 -- 172.21.15.81:0/3059204294 >> v1:172.21.15.189:6792/0 conn(0x7f2d5808fc50 legacy=0x7f2d581db100 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:34.065 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 16879, 2024-09-10T16:34:34.065 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:34:34.066 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:34.067 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:34.068 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:34.069 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:34.070 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:34.071 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:34.072 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.073 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:34.074 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:34.075 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:34.076 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:34.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.079 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:34.080 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:34.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.082 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.083 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:34:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:34.084 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:34.085 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:34.085 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:34.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3059204294 >> v1:172.21.15.189:6812/1108603242 conn(0x7f2d4403d0a0 legacy=0x7f2d4403f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d5dd23640 10 monclient: shutdown 2024-09-10T16:34:34.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d5dd23640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:34.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3059204294 >> v1:172.21.15.81:6793/0 conn(0x7f2d580a3a40 legacy=0x7f2d581d59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d57fff640 1 -- 172.21.15.81:0/3059204294 reap_dead start 2024-09-10T16:34:34.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d57fff640 1 -- 172.21.15.81:0/3059204294 reap_dead start 2024-09-10T16:34:34.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3059204294 shutdown_connections 2024-09-10T16:34:34.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3059204294 >> 172.21.15.81:0/3059204294 conn(0x7f2d580a3fd0 msgr2=0x7f2d580727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:34.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3059204294 shutdown_connections 2024-09-10T16:34:34.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.048+0000 7f2d5dd23640 1 -- 172.21.15.81:0/3059204294 wait complete. 2024-09-10T16:34:34.087 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:34.087 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T16:34:34.087 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T16:34:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.196+0000 7fd91a274640 10 monclient: get_monmap_and_config 2024-09-10T16:34:34.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.196+0000 7fd91a274640 10 monclient: build_initial_monmap 2024-09-10T16:34:34.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.196+0000 7fd91a274640 10 monclient: monmap: 2024-09-10T16:34:34.201 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:34.201 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:34.201 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:34.201202+0000 2024-09-10T16:34:34.205 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:34.201202+0000 2024-09-10T16:34:34.205 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:34.205 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:34.205 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:34.205 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:34.205 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:34.205 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:34.206 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:34.206 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:34.206 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:34.206 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:34.206 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:34.206 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.196+0000 7fd91a274640 1 Processor -- start 2024-09-10T16:34:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 1 -- start start 2024-09-10T16:34:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 10 monclient: init 2024-09-10T16:34:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 10 monclient: _add_conns ranks=[0,1,8,3,7,2,4,5,6] 2024-09-10T16:34:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 10 monclient(hunting): picked mon.noname-a con 0x7fd91409d440 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 10 monclient(hunting): picked mon.noname-f con 0x7fd9140a39e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 10 monclient(hunting): picked mon.noname-e con 0x7fd9140a0900 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9140a37a0 con 0x7fd91409d440 2024-09-10T16:34:34.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd914074d30 con 0x7fd9140a39e0 2024-09-10T16:34:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd91409d820 con 0x7fd9140a0900 2024-09-10T16:34:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 10 monclient(hunting): authenticate will time out at 1241.600918s 2024-09-10T16:34:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd913fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fd91409d440 0x7fd91409fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53240/0 (socket says 172.21.15.81:53240) 2024-09-10T16:34:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd913fff640 1 -- 172.21.15.81:0/3105770896 learned_addr learned my addr 172.21.15.81:0/3105770896 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 1 -- 172.21.15.81:0/3105770896 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 193631827 0 0) 0x7fd9140a37a0 con 0x7fd91409d440 2024-09-10T16:34:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient(hunting): my global_id is 5778 2024-09-10T16:34:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 1 -- 172.21.15.81:0/3105770896 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd900003530 con 0x7fd91409d440 2024-09-10T16:34:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 1 -- 172.21.15.81:0/3105770896 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 233963087 0 0) 0x7fd91409d820 con 0x7fd9140a0900 2024-09-10T16:34:34.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient(hunting): my global_id is 5903 2024-09-10T16:34:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 1 -- 172.21.15.81:0/3105770896 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9140a37a0 con 0x7fd9140a0900 2024-09-10T16:34:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 1 -- 172.21.15.81:0/3105770896 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3559925981 0 0) 0x7fd900003530 con 0x7fd91409d440 2024-09-10T16:34:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 1 -- 172.21.15.81:0/3105770896 >> v1:172.21.15.81:6793/0 conn(0x7fd9140a0900 legacy=0x7fd91413e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 1 -- 172.21.15.81:0/3105770896 >> v1:172.21.15.189:6789/0 conn(0x7fd9140a39e0 legacy=0x7fd9140a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:34:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 1 monclient: found mon.noname-a 2024-09-10T16:34:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:34:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 1 -- 172.21.15.81:0/3105770896 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd91409e1c0 con 0x7fd91409d440 2024-09-10T16:34:34.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient: _finish_auth 0 2024-09-10T16:34:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:34:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 1 -- 172.21.15.81:0/3105770896 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd8fc001860 con 0x7fd91409d440 2024-09-10T16:34:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:34:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient: dump: 2024-09-10T16:34:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:34.214 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 5 monclient: authenticate success, global_id 5778 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 1 -- 172.21.15.81:0/3105770896 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd8fc001a80 con 0x7fd91409d440 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd912ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:34.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 4 set_mon_vals no callback set 2024-09-10T16:34:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 10 monclient: shutdown 2024-09-10T16:34:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.200+0000 7fd91a274640 1 -- 172.21.15.81:0/3105770896 >> v1:172.21.15.81:6789/0 conn(0x7fd91409d440 legacy=0x7fd91409fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 1 -- 172.21.15.81:0/3105770896 shutdown_connections 2024-09-10T16:34:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 1 -- 172.21.15.81:0/3105770896 >> 172.21.15.81:0/3105770896 conn(0x7fd9140a3fd0 msgr2=0x7fd9140a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 1 -- 172.21.15.81:0/3105770896 shutdown_connections 2024-09-10T16:34:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 1 -- 172.21.15.81:0/3105770896 wait complete. 2024-09-10T16:34:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 10 monclient: build_initial_monmap 2024-09-10T16:34:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 10 monclient: monmap: 2024-09-10T16:34:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:34.216 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:34.217 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:34.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 1 Processor -- start 2024-09-10T16:34:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 1 -- start start 2024-09-10T16:34:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 10 monclient: init 2024-09-10T16:34:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 10 monclient: _add_conns ranks=[0,7,6,4,8,5,1,2,3] 2024-09-10T16:34:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 10 monclient(hunting): picked mon.noname-a con 0x7fd91409d440 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 10 monclient(hunting): picked mon.noname-i con 0x7fd9140a0900 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 10 monclient(hunting): picked mon.noname-d con 0x7fd9140a39e0 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd914094440 con 0x7fd91409d440 2024-09-10T16:34:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd914070630 con 0x7fd9140a39e0 2024-09-10T16:34:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd914094720 con 0x7fd9140a0900 2024-09-10T16:34:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd91a274640 10 monclient(hunting): authenticate will time out at 1241.607639s 2024-09-10T16:34:34.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd918811640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fd9140a39e0 0x7fd9141d6020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:52430/0 (socket says 172.21.15.81:52430) 2024-09-10T16:34:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.204+0000 7fd918811640 1 -- 172.21.15.81:0/3366538953 learned_addr learned my addr 172.21.15.81:0/3366538953 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2907447454 0 0) 0x7fd914070630 con 0x7fd9140a39e0 2024-09-10T16:34:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): my global_id is 144204 2024-09-10T16:34:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8f4003530 con 0x7fd9140a39e0 2024-09-10T16:34:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3976154249 0 0) 0x7fd914094440 con 0x7fd91409d440 2024-09-10T16:34:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): my global_id is 5787 2024-09-10T16:34:34.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd914070630 con 0x7fd91409d440 2024-09-10T16:34:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4255318059 0 0) 0x7fd914070630 con 0x7fd91409d440 2024-09-10T16:34:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd914094440 con 0x7fd91409d440 2024-09-10T16:34:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3992238978 0 0) 0x7fd8f4003530 con 0x7fd9140a39e0 2024-09-10T16:34:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd914070630 con 0x7fd9140a39e0 2024-09-10T16:34:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd8fc001050 con 0x7fd91409d440 2024-09-10T16:34:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:34:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): dump: 2024-09-10T16:34:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.220 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:34.221 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:34.221 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:34.221 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:34.221 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:34.221 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:34.221 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:34.221 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:34.221 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:34.221 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:34.221 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:34.221 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:34.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:34.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2928383909 0 0) 0x7fd914094720 con 0x7fd9140a0900 2024-09-10T16:34:34.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): my global_id is 144205 2024-09-10T16:34:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd8f4003530 con 0x7fd9140a0900 2024-09-10T16:34:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd904001b20 con 0x7fd9140a39e0 2024-09-10T16:34:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient(hunting): dump: 2024-09-10T16:34:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.222 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:34.223 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1541176757 0 0) 0x7fd914094440 con 0x7fd91409d440 2024-09-10T16:34:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 >> v1:172.21.15.189:6792/0 conn(0x7fd9140a0900 legacy=0x7fd91406ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 >> v1:172.21.15.81:6792/0 conn(0x7fd9140a39e0 legacy=0x7fd9141d6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:34:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 monclient: found mon.a 2024-09-10T16:34:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:34:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd914073e70 con 0x7fd91409d440 2024-09-10T16:34:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient: _finish_auth 0 2024-09-10T16:34:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:34:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd91a274640 5 monclient: authenticate success, global_id 5787 2024-09-10T16:34:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd91a274640 10 monclient: _renew_subs 2024-09-10T16:34:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd91a274640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:34:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd91a274640 1 -- 172.21.15.81:0/3366538953 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd914073a40 con 0x7fd91409d440 2024-09-10T16:34:34.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd91a274640 10 monclient: _renew_subs 2024-09-10T16:34:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd91a274640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:34:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd91a274640 1 -- 172.21.15.81:0/3366538953 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd91413f830 con 0x7fd91409d440 2024-09-10T16:34:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd8fc001840 con 0x7fd91409d440 2024-09-10T16:34:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd8fc001d30 con 0x7fd91409d440 2024-09-10T16:34:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd9127fc640 4 set_mon_vals no callback set 2024-09-10T16:34:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:34:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 10 monclient: dump: 2024-09-10T16:34:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.225 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:34.226 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:34.226 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd91a274640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd91a274640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd91a274640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:34:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd91a274640 1 -- 172.21.15.81:0/3366538953 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8f8005090 con 0x7fd91409d440 2024-09-10T16:34:34.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fd8fc010fd0 con 0x7fd91409d440 2024-09-10T16:34:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(225..225 src has 121..225) ==== 3506+0+0 (unknown 2064295275 0 0) 0x7fd8fc04ac00 con 0x7fd91409d440 2024-09-10T16:34:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.208+0000 7fd9137fe640 10 monclient: get_auth_request con 0x7fd8f403d820 auth_method 0 2024-09-10T16:34:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.216+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7fd8fc016b80 con 0x7fd91409d440 2024-09-10T16:34:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.216+0000 7fd910ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:34.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.216+0000 7fd910ff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:34.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.448+0000 7fd91a274640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-10T16:34:34.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.448+0000 7fd91a274640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-10T16:34:34.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.448+0000 7fd91a274640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:34:34.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.448+0000 7fd91a274640 1 -- 172.21.15.81:0/3366538953 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fd8f8005c50 con 0x7fd91409d440 2024-09-10T16:34:34.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.448+0000 7fd910ff9640 1 -- 172.21.15.81:0/3366538953 <== mon.0 v1:172.21.15.81:6789/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fd8fc01f8f0 con 0x7fd91409d440 2024-09-10T16:34:34.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.448+0000 7fd910ff9640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-10T16:34:34.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.448+0000 7fd910ff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:34.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=10,kv=11,logm=55} crc {auth=2492244855,config=1097430493,health=1190732421,kv=4196750685,logm=1284935429}) 2024-09-10T16:34:34.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=21,config=2,health=12,kv=13,logm=52} crc {auth=3160320914,config=4178277379,health=3850331155,kv=3059684873,logm=345764103}) 2024-09-10T16:34:34.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=10,kv=11,logm=55} crc {auth=2492244855,config=1097430493,health=1190732421,kv=4196750685,logm=1284935429}) 2024-09-10T16:34:34.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=21,config=2,health=12,kv=13,logm=52} crc {auth=3637475947,config=1097430493,health=2285170433,kv=3059684873,logm=1728330030}) 2024-09-10T16:34:34.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=10,kv=11,logm=55} crc {auth=2492244855,config=1097430493,health=1190732421,kv=4196750685,logm=1284935429}) 2024-09-10T16:34:34.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=21,config=2,health=12,kv=12,logm=53} crc {auth=616982361,config=1097430493,health=2271079722,kv=984658299,logm=3631232446}) 2024-09-10T16:34:34.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=10,kv=11,logm=55} crc {auth=2492244855,config=1097430493,health=1190732421,kv=4196750685,logm=1284935429}) 2024-09-10T16:34:34.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=22,config=2,health=11,kv=12,logm=53} crc {auth=2334635211,config=1097430493,health=528143091,kv=419719020,logm=3836544777}) 2024-09-10T16:34:34.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=10,kv=11,logm=55} crc {auth=2492244855,config=1097430493,health=1190732421,kv=4196750685,logm=1284935429}) 2024-09-10T16:34:34.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=19,config=2,health=12,kv=12,logm=55} crc {auth=1957157485,config=1097430493,health=3494129806,kv=3876122904,logm=1183481533}) 2024-09-10T16:34:34.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=10,kv=11,logm=55} crc {auth=2492244855,config=1097430493,health=1190732421,kv=4196750685,logm=1284935429}) 2024-09-10T16:34:34.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=22,config=2,health=12,kv=13,logm=51} crc {auth=2492244855,config=1097430493,health=2271079722,kv=3059684873,logm=3281243412}) 2024-09-10T16:34:34.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=10,kv=11,logm=55} crc {auth=2492244855,config=1097430493,health=1190732421,kv=4196750685,logm=1284935429}) 2024-09-10T16:34:34.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=22,config=2,health=10,kv=11,logm=55} crc {auth=2492244855,config=1097430493,health=2060601875,kv=1295830902,logm=3952838938}) 2024-09-10T16:34:34.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=10,kv=11,logm=55} crc {auth=2492244855,config=1097430493,health=1190732421,kv=4196750685,logm=1284935429}) 2024-09-10T16:34:34.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.452+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=20,config=2,health=12,kv=13,logm=53} crc {auth=1348516646,config=1097430493,health=2271079722,kv=3059684873,logm=2929784266}) 2024-09-10T16:34:34.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.452+0000 7fd91a274640 1 -- 172.21.15.81:0/3366538953 >> v1:172.21.15.189:6812/1108603242 conn(0x7fd8f403d820 legacy=0x7fd8f403fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.452+0000 7fd91a274640 10 monclient: shutdown 2024-09-10T16:34:34.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.452+0000 7fd91a274640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:34.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.452+0000 7fd91a274640 1 -- 172.21.15.81:0/3366538953 >> v1:172.21.15.81:6789/0 conn(0x7fd91409d440 legacy=0x7fd91406f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:34.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.452+0000 7fd91a274640 1 -- 172.21.15.81:0/3366538953 shutdown_connections 2024-09-10T16:34:34.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.452+0000 7fd91a274640 1 -- 172.21.15.81:0/3366538953 >> 172.21.15.81:0/3366538953 conn(0x7fd9140a3fd0 msgr2=0x7fd9140a5a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:34.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.452+0000 7fd91a274640 1 -- 172.21.15.81:0/3366538953 shutdown_connections 2024-09-10T16:34:34.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:34.452+0000 7fd91a274640 1 -- 172.21.15.81:0/3366538953 wait complete. 2024-09-10T16:34:34.460 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.460 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675442737}) 2024-09-10T16:34:34.460 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3823148926}) 2024-09-10T16:34:34.460 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.460 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675442737}) 2024-09-10T16:34:34.460 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2526870731}) 2024-09-10T16:34:34.460 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.460 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675442737}) 2024-09-10T16:34:34.460 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4103680101}) 2024-09-10T16:34:34.460 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.460 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675442737}) 2024-09-10T16:34:34.460 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2355682697}) 2024-09-10T16:34:34.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675442737}) 2024-09-10T16:34:34.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1031370926}) 2024-09-10T16:34:34.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675442737}) 2024-09-10T16:34:34.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2134941586}) 2024-09-10T16:34:34.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675442737}) 2024-09-10T16:34:34.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1466683431}) 2024-09-10T16:34:34.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=675442737}) 2024-09-10T16:34:34.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.456+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3828719555}) 2024-09-10T16:34:34.466 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.466 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3991445190}) 2024-09-10T16:34:34.466 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3932950943}) 2024-09-10T16:34:34.466 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.466 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3991445190}) 2024-09-10T16:34:34.466 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=661674217}) 2024-09-10T16:34:34.466 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.466 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3991445190}) 2024-09-10T16:34:34.466 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2340335443}) 2024-09-10T16:34:34.466 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.467 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3991445190}) 2024-09-10T16:34:34.467 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2018528327}) 2024-09-10T16:34:34.467 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.467 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3991445190}) 2024-09-10T16:34:34.467 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2746579221}) 2024-09-10T16:34:34.467 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.467 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3991445190}) 2024-09-10T16:34:34.467 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=346182935}) 2024-09-10T16:34:34.467 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.467 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3991445190}) 2024-09-10T16:34:34.467 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3621578828}) 2024-09-10T16:34:34.467 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.467 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3991445190}) 2024-09-10T16:34:34.467 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.460+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=788216269}) 2024-09-10T16:34:34.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4223559543}) 2024-09-10T16:34:34.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=808945880}) 2024-09-10T16:34:34.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4223559543}) 2024-09-10T16:34:34.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=93221450}) 2024-09-10T16:34:34.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4223559543}) 2024-09-10T16:34:34.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3529860967}) 2024-09-10T16:34:34.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4223559543}) 2024-09-10T16:34:34.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2922464563}) 2024-09-10T16:34:34.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4223559543}) 2024-09-10T16:34:34.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=748748419}) 2024-09-10T16:34:34.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4223559543}) 2024-09-10T16:34:34.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1523274405}) 2024-09-10T16:34:34.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4223559543}) 2024-09-10T16:34:34.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2969417975}) 2024-09-10T16:34:34.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4223559543}) 2024-09-10T16:34:34.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.464+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4270868775}) 2024-09-10T16:34:34.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584494486}) 2024-09-10T16:34:34.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1614075623}) 2024-09-10T16:34:34.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584494486}) 2024-09-10T16:34:34.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3207906880}) 2024-09-10T16:34:34.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584494486}) 2024-09-10T16:34:34.474 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-10T16:34:34.474 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3341103202}) 2024-09-10T16:34:34.474 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.474 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584494486}) 2024-09-10T16:34:34.474 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2590863510}) 2024-09-10T16:34:34.475 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.475 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584494486}) 2024-09-10T16:34:34.475 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3613351320}) 2024-09-10T16:34:34.475 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.475 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584494486}) 2024-09-10T16:34:34.475 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=218227736}) 2024-09-10T16:34:34.475 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.475 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584494486}) 2024-09-10T16:34:34.475 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1525487434}) 2024-09-10T16:34:34.475 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.475 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=584494486}) 2024-09-10T16:34:34.475 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.468+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1227580476}) 2024-09-10T16:34:34.478 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.478 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092526269}) 2024-09-10T16:34:34.478 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=304953906}) 2024-09-10T16:34:34.478 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.478 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092526269}) 2024-09-10T16:34:34.478 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4069697186}) 2024-09-10T16:34:34.478 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.478 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092526269}) 2024-09-10T16:34:34.478 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3576449661}) 2024-09-10T16:34:34.478 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.478 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092526269}) 2024-09-10T16:34:34.479 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=408424624}) 2024-09-10T16:34:34.479 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.479 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092526269}) 2024-09-10T16:34:34.479 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3451709840}) 2024-09-10T16:34:34.479 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.479 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092526269}) 2024-09-10T16:34:34.479 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2765972610}) 2024-09-10T16:34:34.479 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.479 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092526269}) 2024-09-10T16:34:34.479 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4126738375}) 2024-09-10T16:34:34.479 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.479 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4092526269}) 2024-09-10T16:34:34.479 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.472+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2159570256}) 2024-09-10T16:34:34.482 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.482 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=38348761}) 2024-09-10T16:34:34.482 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2015078290}) 2024-09-10T16:34:34.482 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.482 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=38348761}) 2024-09-10T16:34:34.482 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2048375089}) 2024-09-10T16:34:34.482 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.482 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=38348761}) 2024-09-10T16:34:34.482 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2944674648}) 2024-09-10T16:34:34.482 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.482 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=38348761}) 2024-09-10T16:34:34.483 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2145933569}) 2024-09-10T16:34:34.483 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.483 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=38348761}) 2024-09-10T16:34:34.483 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3496630833}) 2024-09-10T16:34:34.483 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.483 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=38348761}) 2024-09-10T16:34:34.483 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3903840638}) 2024-09-10T16:34:34.483 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.483 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=38348761}) 2024-09-10T16:34:34.483 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2432083454}) 2024-09-10T16:34:34.483 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.483 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=38348761}) 2024-09-10T16:34:34.483 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.476+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2366052216}) 2024-09-10T16:34:34.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195309159}) 2024-09-10T16:34:34.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=849889740}) 2024-09-10T16:34:34.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195309159}) 2024-09-10T16:34:34.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2360582748}) 2024-09-10T16:34:34.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195309159}) 2024-09-10T16:34:34.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=665752191}) 2024-09-10T16:34:34.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195309159}) 2024-09-10T16:34:34.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4122083094}) 2024-09-10T16:34:34.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195309159}) 2024-09-10T16:34:34.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4282675591}) 2024-09-10T16:34:34.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195309159}) 2024-09-10T16:34:34.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1240000731}) 2024-09-10T16:34:34.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195309159}) 2024-09-10T16:34:34.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=65754940}) 2024-09-10T16:34:34.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=4195309159}) 2024-09-10T16:34:34.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.480+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2433750438}) 2024-09-10T16:34:34.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726811913}) 2024-09-10T16:34:34.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2738108134}) 2024-09-10T16:34:34.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726811913}) 2024-09-10T16:34:34.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4102367182}) 2024-09-10T16:34:34.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726811913}) 2024-09-10T16:34:34.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=467598157}) 2024-09-10T16:34:34.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726811913}) 2024-09-10T16:34:34.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1927937070}) 2024-09-10T16:34:34.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726811913}) 2024-09-10T16:34:34.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2861191314}) 2024-09-10T16:34:34.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726811913}) 2024-09-10T16:34:34.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1036874188}) 2024-09-10T16:34:34.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726811913}) 2024-09-10T16:34:34.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3811452975}) 2024-09-10T16:34:34.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2726811913}) 2024-09-10T16:34:34.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1950670841}) 2024-09-10T16:34:34.495 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.496 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722204628}) 2024-09-10T16:34:34.496 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4162044493}) 2024-09-10T16:34:34.496 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.496 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722204628}) 2024-09-10T16:34:34.496 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3870922212}) 2024-09-10T16:34:34.496 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.496 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722204628}) 2024-09-10T16:34:34.496 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=688601697}) 2024-09-10T16:34:34.496 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.496 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722204628}) 2024-09-10T16:34:34.496 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1080517884}) 2024-09-10T16:34:34.496 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.497 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722204628}) 2024-09-10T16:34:34.497 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1218477838}) 2024-09-10T16:34:34.497 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.497 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722204628}) 2024-09-10T16:34:34.497 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.484+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3799995016}) 2024-09-10T16:34:34.497 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.497 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722204628}) 2024-09-10T16:34:34.497 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=299348859}) 2024-09-10T16:34:34.497 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.497 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1722204628}) 2024-09-10T16:34:34.497 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1586045756}) 2024-09-10T16:34:34.497 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.497 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3720377160}) 2024-09-10T16:34:34.497 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1367925073}) 2024-09-10T16:34:34.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3720377160}) 2024-09-10T16:34:34.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3683089367}) 2024-09-10T16:34:34.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3720377160}) 2024-09-10T16:34:34.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2466050078}) 2024-09-10T16:34:34.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3720377160}) 2024-09-10T16:34:34.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2202621431}) 2024-09-10T16:34:34.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3720377160}) 2024-09-10T16:34:34.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=893882534}) 2024-09-10T16:34:34.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.498 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3720377160}) 2024-09-10T16:34:34.499 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2325600432}) 2024-09-10T16:34:34.499 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.499 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3720377160}) 2024-09-10T16:34:34.499 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1542597060}) 2024-09-10T16:34:34.499 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.499 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3720377160}) 2024-09-10T16:34:34.499 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.488+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1561942269}) 2024-09-10T16:34:34.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1763361245}) 2024-09-10T16:34:34.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=4194344581}) 2024-09-10T16:34:34.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1763361245}) 2024-09-10T16:34:34.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2352913061}) 2024-09-10T16:34:34.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1763361245}) 2024-09-10T16:34:34.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4279188082}) 2024-09-10T16:34:34.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1763361245}) 2024-09-10T16:34:34.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1111761397}) 2024-09-10T16:34:34.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1763361245}) 2024-09-10T16:34:34.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=335126228}) 2024-09-10T16:34:34.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1763361245}) 2024-09-10T16:34:34.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3990344805}) 2024-09-10T16:34:34.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1763361245}) 2024-09-10T16:34:34.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2725014342}) 2024-09-10T16:34:34.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1763361245}) 2024-09-10T16:34:34.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.492+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2132612941}) 2024-09-10T16:34:34.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2664745141}) 2024-09-10T16:34:34.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2203820805}) 2024-09-10T16:34:34.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2664745141}) 2024-09-10T16:34:34.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2862512036}) 2024-09-10T16:34:34.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2664745141}) 2024-09-10T16:34:34.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1156114427}) 2024-09-10T16:34:34.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2664745141}) 2024-09-10T16:34:34.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3511964356}) 2024-09-10T16:34:34.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.509 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2664745141}) 2024-09-10T16:34:34.509 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3366940186}) 2024-09-10T16:34:34.509 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.509 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2664745141}) 2024-09-10T16:34:34.509 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=608751511}) 2024-09-10T16:34:34.509 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.509 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2664745141}) 2024-09-10T16:34:34.509 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3169911227}) 2024-09-10T16:34:34.509 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.509 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2664745141}) 2024-09-10T16:34:34.509 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.496+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2352527405}) 2024-09-10T16:34:34.509 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.509 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1428640171}) 2024-09-10T16:34:34.509 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1020198333}) 2024-09-10T16:34:34.510 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.510 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1428640171}) 2024-09-10T16:34:34.510 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1766485842}) 2024-09-10T16:34:34.510 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.510 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1428640171}) 2024-09-10T16:34:34.510 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3835405826}) 2024-09-10T16:34:34.510 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.510 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1428640171}) 2024-09-10T16:34:34.510 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2348536177}) 2024-09-10T16:34:34.510 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.510 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1428640171}) 2024-09-10T16:34:34.510 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3848883703}) 2024-09-10T16:34:34.510 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.511 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1428640171}) 2024-09-10T16:34:34.511 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1159161805}) 2024-09-10T16:34:34.511 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.511 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1428640171}) 2024-09-10T16:34:34.511 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2386846221}) 2024-09-10T16:34:34.511 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.511 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1428640171}) 2024-09-10T16:34:34.511 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.500+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3577719848}) 2024-09-10T16:34:34.517 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.518 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1} crc {logm=3424819969,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=2949333569,mon_config_key=1805310909,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=1979513003}) 2024-09-10T16:34:34.518 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=48,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=19,monmap=2,nvmeofgw=3,osd_metadata=2} crc {logm=1997662240,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3053906090,mon_config_key=4125933087,monmap=508883831,nvmeofgw=598337686,osd_metadata=320935774}) 2024-09-10T16:34:34.518 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.518 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1} crc {logm=3424819969,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=2949333569,mon_config_key=1805310909,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=1979513003}) 2024-09-10T16:34:34.518 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=49,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=20,monmap=1,nvmeofgw=3,osd_metadata=2} crc {logm=60599169,mdsmap=4195066828,mgr=1052353260,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3053906090,mon_config_key=1767330934,monmap=1228700967,nvmeofgw=598337686,osd_metadata=320935774}) 2024-09-10T16:34:34.518 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.518 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1} crc {logm=3424819969,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=2949333569,mon_config_key=1805310909,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=1979513003}) 2024-09-10T16:34:34.518 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=50,mdsmap=2,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=20,monmap=3,nvmeofgw=2} crc {logm=2943004925,mdsmap=3140514009,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3053906090,mon_config_key=1767330934,monmap=65596682,nvmeofgw=1596038039}) 2024-09-10T16:34:34.518 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.518 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1} crc {logm=3424819969,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=2949333569,mon_config_key=1805310909,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=1979513003}) 2024-09-10T16:34:34.518 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=49,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=20,monmap=2,nvmeofgw=3,osd_metadata=1} crc {logm=3462173124,mdsmap=4195066828,mgr=4187094213,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3053906090,mon_config_key=1767330934,monmap=3306189854,nvmeofgw=598337686,osd_metadata=412438659}) 2024-09-10T16:34:34.518 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.519 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1} crc {logm=3424819969,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=2949333569,mon_config_key=1805310909,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=1979513003}) 2024-09-10T16:34:34.519 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=51,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=19,monmap=3,nvmeofgw=3} crc {logm=2089537656,mdsmap=4195066828,mgr=3893960851,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1097889,mon_config_key=3109537617,monmap=65596682,nvmeofgw=598337686}) 2024-09-10T16:34:34.519 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.519 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1} crc {logm=3424819969,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=2949333569,mon_config_key=1805310909,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=1979513003}) 2024-09-10T16:34:34.519 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=51,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=18,monmap=3,nvmeofgw=3,osd_metadata=1} crc {logm=2276150907,mdsmap=4195066828,mgr=3374101859,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=2546410399,mon_config_key=1263633781,monmap=65596682,nvmeofgw=598337686,osd_metadata=412438659}) 2024-09-10T16:34:34.519 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.519 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1} crc {logm=3424819969,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=2949333569,mon_config_key=1805310909,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=1979513003}) 2024-09-10T16:34:34.519 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.504+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=50,mdsmap=3,mgr=8,mgr_metadata=1,mgrstat=12,mon_config_key=19,monmap=3,nvmeofgw=3,osd_metadata=1} crc {logm=16295795,mdsmap=4195066828,mgr=531137713,mgr_metadata=1162624872,mgrstat=2310848045,mon_config_key=2844333537,monmap=65596682,nvmeofgw=598337686,osd_metadata=405527046}) 2024-09-10T16:34:34.519 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.519 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=50,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=8,mon_config_key=16,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1} crc {logm=3424819969,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=2949333569,mon_config_key=1805310909,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=1979513003}) 2024-09-10T16:34:34.519 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=49,mdsmap=3,mgr=6,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=19,monmap=3,nvmeofgw=3,osd_metadata=4} crc {logm=3939202169,mdsmap=4195066828,mgr=1197994242,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1746755341,mon_config_key=4123125367,monmap=65596682,nvmeofgw=598337686,osd_metadata=956469704}) 2024-09-10T16:34:34.519 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.519 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=2,osdmap=98} crc {osd_snap=4133920409,osdmap=2209279361}) 2024-09-10T16:34:34.520 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osd_snap=2,osdmap=98} crc {osd_snap=4133920409,osdmap=3973022394}) 2024-09-10T16:34:34.520 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.520 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=2,osdmap=98} crc {osd_snap=4133920409,osdmap=2209279361}) 2024-09-10T16:34:34.520 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osd_snap=2,osdmap=98} crc {osd_snap=4133920409,osdmap=2738775347}) 2024-09-10T16:34:34.520 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.520 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=2,osdmap=98} crc {osd_snap=4133920409,osdmap=2209279361}) 2024-09-10T16:34:34.520 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osd_snap=2,osdmap=98} crc {osd_snap=4133920409,osdmap=3738418797}) 2024-09-10T16:34:34.520 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.520 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=2,osdmap=98} crc {osd_snap=4133920409,osdmap=2209279361}) 2024-09-10T16:34:34.520 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osd_snap=2,osdmap=98} crc {osd_snap=4133920409,osdmap=2880878039}) 2024-09-10T16:34:34.520 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.520 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=2,osdmap=98} crc {osd_snap=4133920409,osdmap=2209279361}) 2024-09-10T16:34:34.520 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osd_snap=1,osdmap=99} crc {osd_snap=1914091868,osdmap=3931914862}) 2024-09-10T16:34:34.521 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.521 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=2,osdmap=98} crc {osd_snap=4133920409,osdmap=2209279361}) 2024-09-10T16:34:34.521 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osd_snap=2,osdmap=98} crc {osd_snap=4133920409,osdmap=2169550144}) 2024-09-10T16:34:34.521 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.521 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=2,osdmap=98} crc {osd_snap=4133920409,osdmap=2209279361}) 2024-09-10T16:34:34.521 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osd_snap=1,osdmap=99} crc {osd_snap=3823785925,osdmap=250058567}) 2024-09-10T16:34:34.521 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.521 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osd_snap=2,osdmap=98} crc {osd_snap=4133920409,osdmap=2209279361}) 2024-09-10T16:34:34.521 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.508+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osd_snap=2,osdmap=98} crc {osd_snap=4133920409,osdmap=1743451072}) 2024-09-10T16:34:34.521 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.521 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=70} crc {osdmap=90022457}) 2024-09-10T16:34:34.521 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=70} crc {osdmap=3424042987}) 2024-09-10T16:34:34.521 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.522 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=70} crc {osdmap=90022457}) 2024-09-10T16:34:34.522 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=72} crc {osdmap=1373550505}) 2024-09-10T16:34:34.522 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.522 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=70} crc {osdmap=90022457}) 2024-09-10T16:34:34.522 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=70} crc {osdmap=1683355116}) 2024-09-10T16:34:34.522 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.522 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=70} crc {osdmap=90022457}) 2024-09-10T16:34:34.522 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=68} crc {osdmap=3689354982}) 2024-09-10T16:34:34.522 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.522 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=70} crc {osdmap=90022457}) 2024-09-10T16:34:34.522 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=69} crc {osdmap=144847615}) 2024-09-10T16:34:34.522 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.522 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=70} crc {osdmap=90022457}) 2024-09-10T16:34:34.522 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=68} crc {osdmap=490252837}) 2024-09-10T16:34:34.523 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.523 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=70} crc {osdmap=90022457}) 2024-09-10T16:34:34.523 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=69} crc {osdmap=2968094016}) 2024-09-10T16:34:34.523 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:34:34.523 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=70} crc {osdmap=90022457}) 2024-09-10T16:34:34.523 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:34:34.512+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=71} crc {osdmap=1107885221}) 2024-09-10T16:34:35.329 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:35.329 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31304]: starting. 2024-09-10T16:34:35.329 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31304]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31269 2024-09-10T16:34:35.329 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31304]: created object 0... 2024-09-10T16:34:35.329 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31304]: created object 25... 2024-09-10T16:34:35.329 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31304]: created object 49... 2024-09-10T16:34:35.329 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31304]: finishing. 2024-09-10T16:34:35.329 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31304]: shutting down. 2024-09-10T16:34:35.352 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:35.353 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31306]: starting. 2024-09-10T16:34:35.353 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31306]: listing objects. 2024-09-10T16:34:35.353 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31306]: listed object 0... 2024-09-10T16:34:35.353 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31306]: listed object 25... 2024-09-10T16:34:35.353 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31306]: saw 50 objects 2024-09-10T16:34:35.353 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31306]: shutting down. 2024-09-10T16:34:35.475 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-10T16:34:35.475 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T16:34:35.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 10 monclient: get_monmap_and_config 2024-09-10T16:34:35.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 10 monclient: build_initial_monmap 2024-09-10T16:34:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 10 monclient: monmap: 2024-09-10T16:34:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:35.599140+0000 2024-09-10T16:34:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:35.599140+0000 2024-09-10T16:34:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:35.599 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:35.600 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:35.600 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:35.600 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 1 Processor -- start 2024-09-10T16:34:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 1 -- start start 2024-09-10T16:34:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 10 monclient: init 2024-09-10T16:34:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 10 monclient: _add_conns ranks=[1,2,8,0,5,3,6,7,4] 2024-09-10T16:34:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 10 monclient(hunting): picked mon.noname-f con 0x7fd7640a0a90 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 10 monclient(hunting): picked mon.noname-b con 0x7fd7640a35f0 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 10 monclient(hunting): picked mon.noname-e con 0x7fd7640a3a40 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd76409df70 con 0x7fd7640a0a90 2024-09-10T16:34:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd76409fa30 con 0x7fd7640a35f0 2024-09-10T16:34:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd76409fd10 con 0x7fd7640a3a40 2024-09-10T16:34:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 10 monclient(hunting): authenticate will time out at 1242.998760s 2024-09-10T16:34:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd763fff640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fd7640a35f0 0x7fd76413c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:33260/0 (socket says 172.21.15.81:33260) 2024-09-10T16:34:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7696b6640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fd7640a3a40 0x7fd76413fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:59150/0 (socket says 172.21.15.81:59150) 2024-09-10T16:34:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd763fff640 1 -- 172.21.15.81:0/276075176 learned_addr learned my addr 172.21.15.81:0/276075176 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 1 -- 172.21.15.81:0/276075176 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 469847909 0 0) 0x7fd76409fd10 con 0x7fd7640a3a40 2024-09-10T16:34:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient(hunting): my global_id is 5912 2024-09-10T16:34:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 1 -- 172.21.15.81:0/276075176 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd74c003530 con 0x7fd7640a3a40 2024-09-10T16:34:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 1 -- 172.21.15.81:0/276075176 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043917075 0 0) 0x7fd76409fa30 con 0x7fd7640a35f0 2024-09-10T16:34:35.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient(hunting): my global_id is 144227 2024-09-10T16:34:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 1 -- 172.21.15.81:0/276075176 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd76409fd10 con 0x7fd7640a35f0 2024-09-10T16:34:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 1 -- 172.21.15.81:0/276075176 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2078364411 0 0) 0x7fd74c003530 con 0x7fd7640a3a40 2024-09-10T16:34:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 1 -- 172.21.15.81:0/276075176 >> v1:172.21.15.81:6790/0 conn(0x7fd7640a35f0 legacy=0x7fd76413c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 1 -- 172.21.15.81:0/276075176 >> v1:172.21.15.189:6789/0 conn(0x7fd7640a0a90 legacy=0x7fd7640a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient: _finish_hunting 0 2024-09-10T16:34:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 1 monclient: found mon.noname-e 2024-09-10T16:34:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:34:35.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 1 -- 172.21.15.81:0/276075176 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd76409fff0 con 0x7fd7640a3a40 2024-09-10T16:34:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient: _finish_auth 0 2024-09-10T16:34:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient: _check_auth_tickets 2024-09-10T16:34:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 1 -- 172.21.15.81:0/276075176 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd75c001bc0 con 0x7fd7640a3a40 2024-09-10T16:34:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 5 monclient: authenticate success, global_id 5912 2024-09-10T16:34:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:34:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient: dump: 2024-09-10T16:34:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:35.609 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:35.610 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:35.611 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 1 -- 172.21.15.81:0/276075176 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd75c001de0 con 0x7fd7640a3a40 2024-09-10T16:34:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd76b119640 4 set_mon_vals no callback set 2024-09-10T16:34:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 1 -- 172.21.15.81:0/276075176 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd75c004eb0 con 0x7fd7640a3a40 2024-09-10T16:34:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.596+0000 7fd7637fe640 10 monclient: dump: 2024-09-10T16:34:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:35.611 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:35.612 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:35.613 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient: shutdown 2024-09-10T16:34:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 1 -- 172.21.15.81:0/276075176 >> v1:172.21.15.81:6793/0 conn(0x7fd7640a3a40 legacy=0x7fd76413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 1 -- 172.21.15.81:0/276075176 shutdown_connections 2024-09-10T16:34:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 1 -- 172.21.15.81:0/276075176 >> 172.21.15.81:0/276075176 conn(0x7fd7640a3fd0 msgr2=0x7fd7640a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 1 -- 172.21.15.81:0/276075176 shutdown_connections 2024-09-10T16:34:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 1 -- 172.21.15.81:0/276075176 wait complete. 2024-09-10T16:34:35.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient: build_initial_monmap 2024-09-10T16:34:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient: monmap: 2024-09-10T16:34:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:35.614 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:35.615 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 1 Processor -- start 2024-09-10T16:34:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 1 -- start start 2024-09-10T16:34:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient: init 2024-09-10T16:34:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient: _add_conns ranks=[4,5,1,0,8,7,6,2,3] 2024-09-10T16:34:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient(hunting): picked mon.noname-c con 0x7fd7640a0a90 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient(hunting): picked mon.noname-h con 0x7fd7640a35f0 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient(hunting): picked mon.noname-f con 0x7fd7640a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7640a6280 con 0x7fd7640a3a40 2024-09-10T16:34:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd764098d00 con 0x7fd7640a0a90 2024-09-10T16:34:35.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd764098fe0 con 0x7fd7640a35f0 2024-09-10T16:34:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient(hunting): authenticate will time out at 1243.001851s 2024-09-10T16:34:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd768eb5640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fd7640a0a90 0x7fd76409a510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:41740/0 (socket says 172.21.15.81:41740) 2024-09-10T16:34:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd768eb5640 1 -- 172.21.15.81:0/3721709414 learned_addr learned my addr 172.21.15.81:0/3721709414 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2630941044 0 0) 0x7fd764098d00 con 0x7fd7640a0a90 2024-09-10T16:34:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): my global_id is 144229 2024-09-10T16:34:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd750003530 con 0x7fd7640a0a90 2024-09-10T16:34:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3170445955 0 0) 0x7fd750003530 con 0x7fd7640a0a90 2024-09-10T16:34:35.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd764098d00 con 0x7fd7640a0a90 2024-09-10T16:34:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd758001b80 con 0x7fd7640a0a90 2024-09-10T16:34:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:34:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): dump: 2024-09-10T16:34:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:35.617 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:35.618 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3966324807 0 0) 0x7fd7640a6280 con 0x7fd7640a3a40 2024-09-10T16:34:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:35.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): my global_id is 6058 2024-09-10T16:34:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd750003530 con 0x7fd7640a3a40 2024-09-10T16:34:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 852716240 0 0) 0x7fd764098fe0 con 0x7fd7640a35f0 2024-09-10T16:34:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient(hunting): my global_id is 5828 2024-09-10T16:34:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd7640a6280 con 0x7fd7640a35f0 2024-09-10T16:34:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3484434800 0 0) 0x7fd764098d00 con 0x7fd7640a0a90 2024-09-10T16:34:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 >> v1:172.21.15.189:6791/0 conn(0x7fd7640a35f0 legacy=0x7fd7641d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 >> v1:172.21.15.189:6789/0 conn(0x7fd7640a3a40 legacy=0x7fd7641d62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:35.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient: _finish_hunting 0 2024-09-10T16:34:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 monclient: found mon.c 2024-09-10T16:34:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7640a6c00 con 0x7fd7640a0a90 2024-09-10T16:34:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient: _finish_auth 0 2024-09-10T16:34:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient: _check_auth_tickets 2024-09-10T16:34:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 5 monclient: authenticate success, global_id 144229 2024-09-10T16:34:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient: _renew_subs 2024-09-10T16:34:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 1 -- 172.21.15.81:0/3721709414 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd76409cf80 con 0x7fd7640a0a90 2024-09-10T16:34:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient: _renew_subs 2024-09-10T16:34:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 1 -- 172.21.15.81:0/3721709414 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fd764098740 con 0x7fd7640a0a90 2024-09-10T16:34:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd7580038d0 con 0x7fd7640a0a90 2024-09-10T16:34:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd758003f00 con 0x7fd7640a0a90 2024-09-10T16:34:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 10 monclient: dump: 2024-09-10T16:34:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:35.622 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7627fc640 4 set_mon_vals no callback set 2024-09-10T16:34:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fd758004120 con 0x7fd7640a0a90 2024-09-10T16:34:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.600+0000 7fd76b119640 1 -- 172.21.15.81:0/3721709414 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd744005090 con 0x7fd7640a0a90 2024-09-10T16:34:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.604+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(227..227 src has 121..227) ==== 3898+0+0 (unknown 3608654155 0 0) 0x7fd75804add0 con 0x7fd7640a0a90 2024-09-10T16:34:35.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.604+0000 7fd763fff640 10 monclient: get_auth_request con 0x7fd75003d230 auth_method 0 2024-09-10T16:34:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.608+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7fd758016cb0 con 0x7fd7640a0a90 2024-09-10T16:34:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.608+0000 7fd7617fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.608+0000 7fd7617fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:35.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.840+0000 7fd76b119640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-10T16:34:35.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.840+0000 7fd76b119640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-10T16:34:35.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.840+0000 7fd76b119640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:35.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.840+0000 7fd76b119640 1 -- 172.21.15.81:0/3721709414 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fd744005380 con 0x7fd7640a0a90 2024-09-10T16:34:35.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.840+0000 7fd7617fa640 1 -- 172.21.15.81:0/3721709414 <== mon.4 v1:172.21.15.81:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 3760075700) 0x7fd7580165b0 con 0x7fd7640a0a90 2024-09-10T16:34:35.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.840+0000 7fd7617fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-10T16:34:35.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.840+0000 7fd7617fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:35.845 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":36,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":3,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","modified":"2024-09-10T16:29:22.909160Z","created":"2024-09-10T16:29:22.909160Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6790","nonce":0}]},"addr":"172.21.15.189:6790/0","public_addr":"172.21.15.189:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6791","nonce":0}]},"addr":"172.21.15.81:6791/0","public_addr":"172.21.15.81:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6791","nonce":0}]},"addr":"172.21.15.189:6791/0","public_addr":"172.21.15.189:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6792","nonce":0}]},"addr":"172.21.15.81:6792/0","public_addr":"172.21.15.81:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6792","nonce":0}]},"addr":"172.21.15.189:6792/0","public_addr":"172.21.15.189:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6793","nonce":0}]},"addr":"172.21.15.81:6793/0","public_addr":"172.21.15.81:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T16:34:35.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.844+0000 7fd76b119640 1 -- 172.21.15.81:0/3721709414 >> v1:172.21.15.189:6812/1108603242 conn(0x7fd75003d230 legacy=0x7fd75003f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:35.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.844+0000 7fd76b119640 10 monclient: shutdown 2024-09-10T16:34:35.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.844+0000 7fd76b119640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.844+0000 7fd76b119640 1 -- 172.21.15.81:0/3721709414 >> v1:172.21.15.81:6791/0 conn(0x7fd7640a0a90 legacy=0x7fd76409a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.844+0000 7fd76b119640 1 -- 172.21.15.81:0/3721709414 shutdown_connections 2024-09-10T16:34:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.844+0000 7fd76b119640 1 -- 172.21.15.81:0/3721709414 >> 172.21.15.81:0/3721709414 conn(0x7fd7640a3fd0 msgr2=0x7fd7640728c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.844+0000 7fd76b119640 1 -- 172.21.15.81:0/3721709414 shutdown_connections 2024-09-10T16:34:35.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.844+0000 7fd76b119640 1 -- 172.21.15.81:0/3721709414 wait complete. 2024-09-10T16:34:35.864 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-10T16:34:35.864 INFO:tasks.mon_thrash.mon_thrasher:making sure all monitors are in the quorum 2024-09-10T16:34:35.864 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-10T16:34:35.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T16:34:35.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 10 monclient: get_monmap_and_config 2024-09-10T16:34:35.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 10 monclient: build_initial_monmap 2024-09-10T16:34:35.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 10 monclient: monmap: 2024-09-10T16:34:35.979 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:35.979 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:35.979 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:35.979476+0000 2024-09-10T16:34:35.979 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:35.979476+0000 2024-09-10T16:34:35.979 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:35.979 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:35.979 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:35.979 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:35.980 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:35.980 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 1 Processor -- start 2024-09-10T16:34:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 1 -- start start 2024-09-10T16:34:35.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 10 monclient: init 2024-09-10T16:34:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 10 monclient: _add_conns ranks=[8,1,2,4,5,3,0,7,6] 2024-09-10T16:34:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 10 monclient(hunting): picked mon.noname-e con 0x7ff8980a0a90 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 10 monclient(hunting): picked mon.noname-f con 0x7ff8980a35f0 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 10 monclient(hunting): picked mon.noname-b con 0x7ff8980a3a40 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff89809df70 con 0x7ff8980a35f0 2024-09-10T16:34:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff89809fa30 con 0x7ff8980a3a40 2024-09-10T16:34:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff89809fd10 con 0x7ff8980a0a90 2024-09-10T16:34:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 10 monclient(hunting): authenticate will time out at 1243.378986s 2024-09-10T16:34:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff896d9d640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7ff8980a3a40 0x7ff89813fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:33270/0 (socket says 172.21.15.81:33270) 2024-09-10T16:34:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89659c640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7ff8980a0a90 0x7ff8980a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:59156/0 (socket says 172.21.15.81:59156) 2024-09-10T16:34:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff896d9d640 1 -- 172.21.15.81:0/2824194510 learned_addr learned my addr 172.21.15.81:0/2824194510 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 1 -- 172.21.15.81:0/2824194510 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 52148122 0 0) 0x7ff89809fd10 con 0x7ff8980a0a90 2024-09-10T16:34:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient(hunting): _negotiate 2024-09-10T16:34:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient(hunting): my global_id is 5921 2024-09-10T16:34:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 1 -- 172.21.15.81:0/2824194510 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff880003530 con 0x7ff8980a0a90 2024-09-10T16:34:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 1 -- 172.21.15.81:0/2824194510 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2165242178 0 0) 0x7ff89809fa30 con 0x7ff8980a3a40 2024-09-10T16:34:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient(hunting): _negotiate 2024-09-10T16:34:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient(hunting): my global_id is 144236 2024-09-10T16:34:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 1 -- 172.21.15.81:0/2824194510 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff89809fd10 con 0x7ff8980a3a40 2024-09-10T16:34:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 1 -- 172.21.15.81:0/2824194510 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3374305956 0 0) 0x7ff89809fd10 con 0x7ff8980a3a40 2024-09-10T16:34:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 1 -- 172.21.15.81:0/2824194510 >> v1:172.21.15.81:6793/0 conn(0x7ff8980a0a90 legacy=0x7ff8980a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 1 -- 172.21.15.81:0/2824194510 >> v1:172.21.15.189:6789/0 conn(0x7ff8980a35f0 legacy=0x7ff89813c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient: _finish_hunting 0 2024-09-10T16:34:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 1 monclient: found mon.noname-b 2024-09-10T16:34:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:34:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 1 -- 172.21.15.81:0/2824194510 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff89809fff0 con 0x7ff8980a3a40 2024-09-10T16:34:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient: _finish_auth 0 2024-09-10T16:34:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient: _check_auth_tickets 2024-09-10T16:34:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 5 monclient: authenticate success, global_id 144236 2024-09-10T16:34:35.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 1 -- 172.21.15.81:0/2824194510 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff8880016d0 con 0x7ff8980a3a40 2024-09-10T16:34:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89ce68640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.976+0000 7ff89559a640 10 monclient: dump: 2024-09-10T16:34:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:35.991 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:35.992 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89559a640 1 -- 172.21.15.81:0/2824194510 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff8880018f0 con 0x7ff8980a3a40 2024-09-10T16:34:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89559a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89559a640 1 -- 172.21.15.81:0/2824194510 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff8880048b0 con 0x7ff8980a3a40 2024-09-10T16:34:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89559a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:35.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89559a640 10 monclient: dump: 2024-09-10T16:34:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:35.993 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:35.994 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 4 set_mon_vals no callback set 2024-09-10T16:34:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient: shutdown 2024-09-10T16:34:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 1 -- 172.21.15.81:0/2824194510 >> v1:172.21.15.81:6790/0 conn(0x7ff8980a3a40 legacy=0x7ff89813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 1 -- 172.21.15.81:0/2824194510 shutdown_connections 2024-09-10T16:34:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 1 -- 172.21.15.81:0/2824194510 >> 172.21.15.81:0/2824194510 conn(0x7ff8980a3fd0 msgr2=0x7ff8980a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 1 -- 172.21.15.81:0/2824194510 shutdown_connections 2024-09-10T16:34:35.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 1 -- 172.21.15.81:0/2824194510 wait complete. 2024-09-10T16:34:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient: build_initial_monmap 2024-09-10T16:34:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient: monmap: 2024-09-10T16:34:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:35.995 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:35.996 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 1 Processor -- start 2024-09-10T16:34:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 1 -- start start 2024-09-10T16:34:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient: init 2024-09-10T16:34:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient: _add_conns ranks=[5,8,7,1,0,2,4,6,3] 2024-09-10T16:34:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient(hunting): picked mon.noname-h con 0x7ff8980a0a90 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient(hunting): picked mon.noname-e con 0x7ff8980a35f0 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient(hunting): picked mon.noname-i con 0x7ff8980a3a40 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:35.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8981b5980 con 0x7ff8980a0a90 2024-09-10T16:34:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8981b4520 con 0x7ff8980a3a40 2024-09-10T16:34:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8981b3850 con 0x7ff8980a35f0 2024-09-10T16:34:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient(hunting): authenticate will time out at 1243.382209s 2024-09-10T16:34:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff895d9b640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7ff8980a35f0 0x7ff8981b3140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:59166/0 (socket says 172.21.15.81:59166) 2024-09-10T16:34:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff895d9b640 1 -- 172.21.15.81:0/244685941 learned_addr learned my addr 172.21.15.81:0/244685941 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2745696338 0 0) 0x7ff8981b3850 con 0x7ff8980a35f0 2024-09-10T16:34:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:35.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient(hunting): my global_id is 5930 2024-09-10T16:34:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff878003530 con 0x7ff8980a35f0 2024-09-10T16:34:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2697602105 0 0) 0x7ff878003530 con 0x7ff8980a35f0 2024-09-10T16:34:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff8981b3850 con 0x7ff8980a35f0 2024-09-10T16:34:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff88c001b60 con 0x7ff8980a35f0 2024-09-10T16:34:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:34:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient(hunting): dump: 2024-09-10T16:34:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:35.998 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:35.999 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:35.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 678925324 0 0) 0x7ff8981b3850 con 0x7ff8980a35f0 2024-09-10T16:34:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 >> v1:172.21.15.189:6792/0 conn(0x7ff8980a3a40 legacy=0x7ff8981d3790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 >> v1:172.21.15.189:6791/0 conn(0x7ff8980a0a90 legacy=0x7ff8981b2a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:34:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 1 monclient: found mon.e 2024-09-10T16:34:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8981b6880 con 0x7ff8980a35f0 2024-09-10T16:34:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient: _finish_auth 0 2024-09-10T16:34:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:34:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 5 monclient: authenticate success, global_id 5930 2024-09-10T16:34:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient: _renew_subs 2024-09-10T16:34:36.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 1 -- 172.21.15.81:0/244685941 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff8981b5fe0 con 0x7ff8980a35f0 2024-09-10T16:34:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient: _renew_subs 2024-09-10T16:34:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 1 -- 172.21.15.81:0/244685941 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7ff8981b5340 con 0x7ff8980a35f0 2024-09-10T16:34:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff88c0038d0 con 0x7ff8980a35f0 2024-09-10T16:34:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff88c003e00 con 0x7ff8980a35f0 2024-09-10T16:34:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff894d99640 4 set_mon_vals no callback set 2024-09-10T16:34:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 10 monclient: dump: 2024-09-10T16:34:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.001 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.002 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.002 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.002 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.002 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.002 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.002 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.002 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.002 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.002 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.002 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.002 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.002 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.002 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff89ce68640 1 -- 172.21.15.81:0/244685941 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff87c0065d0 con 0x7ff87c002870 2024-09-10T16:34:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.980+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7ff88c003fa0 con 0x7ff8980a35f0 2024-09-10T16:34:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(227..227 src has 121..227) ==== 3898+0+0 (unknown 3608654155 0 0) 0x7ff88c04b0d0 con 0x7ff8980a35f0 2024-09-10T16:34:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3177915452 0 0) 0x7ff87c0065d0 con 0x7ff87c002870 2024-09-10T16:34:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 10 monclient(hunting): my global_id is 5796 2024-09-10T16:34:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff8981b3850 con 0x7ff87c002870 2024-09-10T16:34:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff896d9d640 10 monclient: get_auth_request con 0x7ff87803cfa0 auth_method 0 2024-09-10T16:34:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4034563733 0 0) 0x7ff8981b3850 con 0x7ff87c002870 2024-09-10T16:34:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff87c0065d0 con 0x7ff87c002870 2024-09-10T16:34:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff8900016f0 con 0x7ff87c002870 2024-09-10T16:34:36.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:34:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 10 monclient: dump: 2024-09-10T16:34:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.004 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.005 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1069211319 0 0) 0x7ff87c0065d0 con 0x7ff87c002870 2024-09-10T16:34:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 --> v1:172.21.15.81:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff87c00a170 con 0x7ff87c002870 2024-09-10T16:34:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff890001a60 con 0x7ff87c002870 2024-09-10T16:34:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 >> v1:172.21.15.81:6789/0 conn(0x7ff87c002870 legacy=0x7ff87c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.984+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 >> v1:172.21.15.81:6789/0 conn(0x7ff87c002870 legacy=0x7ff87c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:36.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff89ce68640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff89ce68640 1 -- 172.21.15.81:0/244685941 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff87c009e80 con 0x7ff87c009140 2024-09-10T16:34:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3135536049 0 0) 0x7ff87c009e80 con 0x7ff87c009140 2024-09-10T16:34:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff886ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff886ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff886ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff886ffd640 10 monclient(hunting): my global_id is 5805 2024-09-10T16:34:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff87c0065d0 con 0x7ff87c009140 2024-09-10T16:34:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3220391363 0 0) 0x7ff87c0065d0 con 0x7ff87c009140 2024-09-10T16:34:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff87c009e80 con 0x7ff87c009140 2024-09-10T16:34:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff8900050a0 con 0x7ff87c009140 2024-09-10T16:34:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff886ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff886ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:34:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff886ffd640 10 monclient: dump: 2024-09-10T16:34:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.008 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.009 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1256094180 0 0) 0x7ff87c009e80 con 0x7ff87c009140 2024-09-10T16:34:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.988+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 --> v1:172.21.15.81:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff87c00c420 con 0x7ff87c009140 2024-09-10T16:34:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7713 (unknown 0 0 948097744) 0x7ff890007340 con 0x7ff87c009140 2024-09-10T16:34:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff886ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff886ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 >> v1:172.21.15.81:6789/0 conn(0x7ff87c009140 legacy=0x7ff87c0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff886ffd640 1 -- 172.21.15.81:0/244685941 >> v1:172.21.15.81:6789/0 conn(0x7ff87c009140 legacy=0x7ff87c0095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:36.009 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:36.010 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:36.010 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:36.010 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-09-10T16:34:36.010 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:36.010 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 285941, 2024-09-10T16:34:36.010 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:36.010 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:36.010 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:36.010 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:36.010 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:36.010 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:36.010 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:36.011 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:36.011 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:36.011 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:36.011 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.011 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-09-10T16:34:36.011 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:36.011 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:36.011 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:36.011 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.011 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.011 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.011 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.011 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.012 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.012 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.012 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.012 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.012 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.012 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.012 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.012 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:36.012 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:36.012 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.012 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.012 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.012 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.013 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.013 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.013 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.013 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.013 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.013 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.013 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.013 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.013 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:36.013 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:36.013 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:36.013 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:36.013 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:36.014 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:36.014 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:36.014 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:36.014 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:36.014 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:36.014 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:36.014 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:36.014 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:36.014 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:36.014 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:36.014 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:36.014 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:36.014 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.015 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.015 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.015 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.015 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.015 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.015 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.015 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.015 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.015 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.015 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.015 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.015 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:36.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.015 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:36.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.016 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:36.016 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:36.016 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.016 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:36.016 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.016 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.016 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.016 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:36.017 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:36.017 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.017 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.017 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.017 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:36.017 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:36.017 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.017 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.017 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.017 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:36.017 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.018 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.018 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.018 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:36.018 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:36.018 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.018 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.018 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.018 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.018 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:36.018 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:36.018 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.019 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.019 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.019 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.019 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:36.019 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.019 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.019 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.019 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:36.019 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:36.019 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.019 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.019 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.019 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.020 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:36.020 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:36.020 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.020 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.020 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.020 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:36.020 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.020 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.020 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.020 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:36.021 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:36.021 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.021 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.021 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.021 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:36.021 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:36.021 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.021 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.021 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:36.022 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.022 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.022 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.022 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:36.022 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:36.022 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.022 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.022 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.022 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.022 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.022 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:36.022 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:36.022 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.023 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:36.023 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.023 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.023 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.023 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:36.023 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:36.023 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.023 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.024 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.024 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:36.024 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:36.024 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.024 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.024 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:36.024 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.024 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.025 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:36.025 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:36.025 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.025 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.025 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.025 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.025 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:36.025 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:36.025 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.025 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:36.026 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.026 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.026 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.026 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:36.026 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:36.026 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.026 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.026 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.026 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.027 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:36.027 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:36.027 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:36.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:36.027 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:36.027 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.028 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:34:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:34:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.029 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.030 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:36.030 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff89ce68640 1 -- 172.21.15.81:0/244685941 >> v1:172.21.15.189:6812/1108603242 conn(0x7ff87803cfa0 legacy=0x7ff87803f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff89ce68640 10 monclient: shutdown 2024-09-10T16:34:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff89ce68640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff89ce68640 1 -- 172.21.15.81:0/244685941 >> v1:172.21.15.81:6793/0 conn(0x7ff8980a35f0 legacy=0x7ff8981b3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff896d9d640 1 -- 172.21.15.81:0/244685941 reap_dead start 2024-09-10T16:34:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff896d9d640 1 -- 172.21.15.81:0/244685941 reap_dead start 2024-09-10T16:34:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff89ce68640 1 -- 172.21.15.81:0/244685941 shutdown_connections 2024-09-10T16:34:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff89ce68640 1 -- 172.21.15.81:0/244685941 >> 172.21.15.81:0/244685941 conn(0x7ff8980a3fd0 msgr2=0x7ff8981bb4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff89ce68640 1 -- 172.21.15.81:0/244685941 shutdown_connections 2024-09-10T16:34:36.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:35.992+0000 7ff89ce68640 1 -- 172.21.15.81:0/244685941 wait complete. 2024-09-10T16:34:36.032 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:36.032 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-10T16:34:36.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T16:34:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 10 monclient: get_monmap_and_config 2024-09-10T16:34:36.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 10 monclient: build_initial_monmap 2024-09-10T16:34:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 10 monclient: monmap: 2024-09-10T16:34:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:36.147217+0000 2024-09-10T16:34:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:36.147217+0000 2024-09-10T16:34:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:36.147 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:36.148 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:36.148 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:36.148 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:36.148 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 1 Processor -- start 2024-09-10T16:34:36.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 1 -- start start 2024-09-10T16:34:36.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 10 monclient: init 2024-09-10T16:34:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 10 monclient: _add_conns ranks=[5,2,7,1,3,0,8,6,4] 2024-09-10T16:34:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 10 monclient(hunting): picked mon.noname-h con 0x7fca24068960 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 10 monclient(hunting): picked mon.noname-b con 0x7fca240a26e0 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 10 monclient(hunting): picked mon.noname-i con 0x7fca2413f6a0 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca240a0610 con 0x7fca240a26e0 2024-09-10T16:34:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca240a3d00 con 0x7fca24068960 2024-09-10T16:34:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca240696f0 con 0x7fca2413f6a0 2024-09-10T16:34:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca298d2640 10 monclient(hunting): authenticate will time out at 1243.547527s 2024-09-10T16:34:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca227fc640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fca240a26e0 0x7fca240a35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:33282/0 (socket says 172.21.15.81:33282) 2024-09-10T16:34:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.144+0000 7fca227fc640 1 -- 172.21.15.81:0/4232281684 learned_addr learned my addr 172.21.15.81:0/4232281684 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:36.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 1 -- 172.21.15.81:0/4232281684 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3840521865 0 0) 0x7fca240a0610 con 0x7fca240a26e0 2024-09-10T16:34:36.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient(hunting): my global_id is 144245 2024-09-10T16:34:36.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 1 -- 172.21.15.81:0/4232281684 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca10003530 con 0x7fca240a26e0 2024-09-10T16:34:36.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 1 -- 172.21.15.81:0/4232281684 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4245670085 0 0) 0x7fca240696f0 con 0x7fca2413f6a0 2024-09-10T16:34:36.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient(hunting): my global_id is 144223 2024-09-10T16:34:36.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 1 -- 172.21.15.81:0/4232281684 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca240a0610 con 0x7fca2413f6a0 2024-09-10T16:34:36.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 1 -- 172.21.15.81:0/4232281684 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1281770750 0 0) 0x7fca10003530 con 0x7fca240a26e0 2024-09-10T16:34:36.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 1 -- 172.21.15.81:0/4232281684 >> v1:172.21.15.189:6792/0 conn(0x7fca2413f6a0 legacy=0x7fca24141a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 1 -- 172.21.15.81:0/4232281684 >> v1:172.21.15.189:6791/0 conn(0x7fca24068960 legacy=0x7fca240a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:34:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 1 monclient: found mon.noname-b 2024-09-10T16:34:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:34:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 1 -- 172.21.15.81:0/4232281684 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca240a3fd0 con 0x7fca240a26e0 2024-09-10T16:34:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient: _finish_auth 0 2024-09-10T16:34:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:34:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 1 -- 172.21.15.81:0/4232281684 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fca0c001840 con 0x7fca240a26e0 2024-09-10T16:34:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient: dump: 2024-09-10T16:34:36.153 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.154 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.155 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 5 monclient: authenticate success, global_id 144245 2024-09-10T16:34:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 1 -- 172.21.15.81:0/4232281684 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca0c0019e0 con 0x7fca240a26e0 2024-09-10T16:34:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 4 set_mon_vals no callback set 2024-09-10T16:34:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 1 -- 172.21.15.81:0/4232281684 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fca0c004bf0 con 0x7fca240a26e0 2024-09-10T16:34:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca21ffb640 10 monclient: dump: 2024-09-10T16:34:36.155 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.156 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 10 monclient: shutdown 2024-09-10T16:34:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 1 -- 172.21.15.81:0/4232281684 >> v1:172.21.15.81:6790/0 conn(0x7fca240a26e0 legacy=0x7fca240a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 1 -- 172.21.15.81:0/4232281684 shutdown_connections 2024-09-10T16:34:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 1 -- 172.21.15.81:0/4232281684 >> 172.21.15.81:0/4232281684 conn(0x7fca240a86b0 msgr2=0x7fca240a8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 1 -- 172.21.15.81:0/4232281684 shutdown_connections 2024-09-10T16:34:36.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 1 -- 172.21.15.81:0/4232281684 wait complete. 2024-09-10T16:34:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 10 monclient: build_initial_monmap 2024-09-10T16:34:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 10 monclient: monmap: 2024-09-10T16:34:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:36.161 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:36.162 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 1 Processor -- start 2024-09-10T16:34:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 1 -- start start 2024-09-10T16:34:36.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 10 monclient: init 2024-09-10T16:34:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 10 monclient: _add_conns ranks=[8,6,7,4,2,0,5,3,1] 2024-09-10T16:34:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 10 monclient(hunting): picked mon.noname-e con 0x7fca24068960 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 10 monclient(hunting): picked mon.noname-d con 0x7fca240a26e0 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 10 monclient(hunting): picked mon.noname-i con 0x7fca2413f6a0 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca24073a30 con 0x7fca240a26e0 2024-09-10T16:34:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca24072290 con 0x7fca2413f6a0 2024-09-10T16:34:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca24071ee0 con 0x7fca24068960 2024-09-10T16:34:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 10 monclient(hunting): authenticate will time out at 1243.550919s 2024-09-10T16:34:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca227fc640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fca240a26e0 0x7fca240717d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:52432/0 (socket says 172.21.15.81:52432) 2024-09-10T16:34:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca227fc640 1 -- 172.21.15.81:0/3743697068 learned_addr learned my addr 172.21.15.81:0/3743697068 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1613483704 0 0) 0x7fca24073a30 con 0x7fca240a26e0 2024-09-10T16:34:36.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): my global_id is 144213 2024-09-10T16:34:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca04003560 con 0x7fca240a26e0 2024-09-10T16:34:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3824531406 0 0) 0x7fca24071ee0 con 0x7fca24068960 2024-09-10T16:34:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): my global_id is 5939 2024-09-10T16:34:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca24073a30 con 0x7fca24068960 2024-09-10T16:34:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1304988856 0 0) 0x7fca24073a30 con 0x7fca24068960 2024-09-10T16:34:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca24071ee0 con 0x7fca24068960 2024-09-10T16:34:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fca14001dd0 con 0x7fca24068960 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): dump: 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.166 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.166 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.166 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.166 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:36.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2584798473 0 0) 0x7fca24072290 con 0x7fca2413f6a0 2024-09-10T16:34:36.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): my global_id is 144232 2024-09-10T16:34:36.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca24073a30 con 0x7fca2413f6a0 2024-09-10T16:34:36.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 145915780 0 0) 0x7fca04003560 con 0x7fca240a26e0 2024-09-10T16:34:36.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca24072290 con 0x7fca240a26e0 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fca0c004b30 con 0x7fca240a26e0 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient(hunting): dump: 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.167 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.168 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.168 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.168 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.168 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.168 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4018230415 0 0) 0x7fca24071ee0 con 0x7fca24068960 2024-09-10T16:34:36.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 >> v1:172.21.15.189:6792/0 conn(0x7fca2413f6a0 legacy=0x7fca241d5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 >> v1:172.21.15.81:6792/0 conn(0x7fca240a26e0 legacy=0x7fca240717d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient: _finish_hunting 0 2024-09-10T16:34:36.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 monclient: found mon.e 2024-09-10T16:34:36.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:36.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:36.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2413ba20 con 0x7fca24068960 2024-09-10T16:34:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient: _finish_auth 0 2024-09-10T16:34:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 10 monclient: _check_auth_tickets 2024-09-10T16:34:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca1bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 5 monclient: authenticate success, global_id 5939 2024-09-10T16:34:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 10 monclient: _renew_subs 2024-09-10T16:34:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.148+0000 7fca298d2640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fca240a6870 con 0x7fca24068960 2024-09-10T16:34:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca298d2640 10 monclient: _renew_subs 2024-09-10T16:34:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca298d2640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca298d2640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7fca2409e7b0 con 0x7fca24068960 2024-09-10T16:34:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca14003c30 con 0x7fca24068960 2024-09-10T16:34:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fca140020d0 con 0x7fca24068960 2024-09-10T16:34:36.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca217fa640 4 set_mon_vals no callback set 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 10 monclient: dump: 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.170 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.171 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca298d2640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca298d2640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fca080065d0 con 0x7fca08002870 2024-09-10T16:34:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fca140041e0 con 0x7fca24068960 2024-09-10T16:34:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(227..227 src has 121..227) ==== 3898+0+0 (unknown 3608654155 0 0) 0x7fca14049ee0 con 0x7fca24068960 2024-09-10T16:34:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2801047620 0 0) 0x7fca080065d0 con 0x7fca08002870 2024-09-10T16:34:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 10 monclient(hunting): my global_id is 144254 2024-09-10T16:34:36.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca24071ee0 con 0x7fca08002870 2024-09-10T16:34:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3044434826 0 0) 0x7fca24071ee0 con 0x7fca08002870 2024-09-10T16:34:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca080065d0 con 0x7fca08002870 2024-09-10T16:34:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fca0c004eb0 con 0x7fca08002870 2024-09-10T16:34:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 10 monclient: dump: 2024-09-10T16:34:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.172 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.173 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca237fe640 10 monclient: get_auth_request con 0x7fca0403d890 auth_method 0 2024-09-10T16:34:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 116655719 0 0) 0x7fca080065d0 con 0x7fca08002870 2024-09-10T16:34:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca0800a170 con 0x7fca08002870 2024-09-10T16:34:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fca0c007480 con 0x7fca08002870 2024-09-10T16:34:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:36.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:36.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 >> v1:172.21.15.81:6790/0 conn(0x7fca08002870 legacy=0x7fca08004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.152+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 >> v1:172.21.15.81:6790/0 conn(0x7fca08002870 legacy=0x7fca08004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:36.174 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:36.174 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31305]: starting. 2024-09-10T16:34:36.174 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31305]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31269 2024-09-10T16:34:36.175 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31305]: shutting down. 2024-09-10T16:34:36.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca298d2640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca298d2640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fca08009e10 con 0x7fca080090f0 2024-09-10T16:34:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2966365750 0 0) 0x7fca08009e10 con 0x7fca080090f0 2024-09-10T16:34:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 10 monclient(hunting): my global_id is 144263 2024-09-10T16:34:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca080065d0 con 0x7fca080090f0 2024-09-10T16:34:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2851199895 0 0) 0x7fca080065d0 con 0x7fca080090f0 2024-09-10T16:34:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca08009e10 con 0x7fca080090f0 2024-09-10T16:34:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fca0c005640 con 0x7fca080090f0 2024-09-10T16:34:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 10 monclient: dump: 2024-09-10T16:34:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.177 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.178 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1232560895 0 0) 0x7fca08009e10 con 0x7fca080090f0 2024-09-10T16:34:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 --> v1:172.21.15.81:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fca0800c3b0 con 0x7fca080090f0 2024-09-10T16:34:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 1898369558) 0x7fca0c006bf0 con 0x7fca080090f0 2024-09-10T16:34:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 >> v1:172.21.15.81:6790/0 conn(0x7fca080090f0 legacy=0x7fca08009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca1bfff640 1 -- 172.21.15.81:0/3743697068 >> v1:172.21.15.81:6790/0 conn(0x7fca080090f0 legacy=0x7fca08009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:36.179 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 19003, 2024-09-10T16:34:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:36.179 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-09-10T16:34:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.180 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.181 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:36.182 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.183 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:36.184 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:36.187 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.188 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.189 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:36.191 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.192 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.193 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:36.194 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.195 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.196 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.197 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.198 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:36.198 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:36.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca298d2640 1 -- 172.21.15.81:0/3743697068 >> v1:172.21.15.189:6812/1108603242 conn(0x7fca0403d890 legacy=0x7fca0403fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca298d2640 10 monclient: shutdown 2024-09-10T16:34:36.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca298d2640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:36.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca298d2640 1 -- 172.21.15.81:0/3743697068 >> v1:172.21.15.81:6793/0 conn(0x7fca24068960 legacy=0x7fca240710c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca237fe640 1 -- 172.21.15.81:0/3743697068 reap_dead start 2024-09-10T16:34:36.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca237fe640 1 -- 172.21.15.81:0/3743697068 reap_dead start 2024-09-10T16:34:36.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca298d2640 1 -- 172.21.15.81:0/3743697068 shutdown_connections 2024-09-10T16:34:36.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca298d2640 1 -- 172.21.15.81:0/3743697068 >> 172.21.15.81:0/3743697068 conn(0x7fca240a86b0 msgr2=0x7fca240a6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:36.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca298d2640 1 -- 172.21.15.81:0/3743697068 shutdown_connections 2024-09-10T16:34:36.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.164+0000 7fca298d2640 1 -- 172.21.15.81:0/3743697068 wait complete. 2024-09-10T16:34:36.200 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:36.200 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-10T16:34:36.200 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T16:34:36.201 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:36.201 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:36.201 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:34:36.202 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:34:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient: get_monmap_and_config 2024-09-10T16:34:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient: build_initial_monmap 2024-09-10T16:34:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient: monmap: 2024-09-10T16:34:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:36.318279+0000 2024-09-10T16:34:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:36.318279+0000 2024-09-10T16:34:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:36.319 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 1 Processor -- start 2024-09-10T16:34:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 1 -- start start 2024-09-10T16:34:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient: init 2024-09-10T16:34:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient: _add_conns ranks=[2,5,0,4,8,3,7,6,1] 2024-09-10T16:34:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient(hunting): picked mon.noname-b con 0x7f62c40a3ef0 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient(hunting): picked mon.noname-h con 0x7f62c4073d20 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient(hunting): picked mon.noname-a con 0x7f62c40a49e0 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c4073870 con 0x7f62c40a49e0 2024-09-10T16:34:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c40a5630 con 0x7f62c40a3ef0 2024-09-10T16:34:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c4073590 con 0x7f62c4073d20 2024-09-10T16:34:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient(hunting): authenticate will time out at 1243.717666s 2024-09-10T16:34:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c2ffd640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f62c40a3ef0 0x7f62c40a42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:33322/0 (socket says 172.21.15.81:33322) 2024-09-10T16:34:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c2ffd640 1 -- 172.21.15.81:0/465736807 learned_addr learned my addr 172.21.15.81:0/465736807 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 1 -- 172.21.15.81:0/465736807 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3858659761 0 0) 0x7f62c4073870 con 0x7f62c40a49e0 2024-09-10T16:34:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient(hunting): my global_id is 5841 2024-09-10T16:34:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 1 -- 172.21.15.81:0/465736807 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62b0003530 con 0x7f62c40a49e0 2024-09-10T16:34:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 1 -- 172.21.15.81:0/465736807 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3302282362 0 0) 0x7f62c40a5630 con 0x7f62c40a3ef0 2024-09-10T16:34:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient(hunting): my global_id is 144290 2024-09-10T16:34:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 1 -- 172.21.15.81:0/465736807 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62c4073870 con 0x7f62c40a3ef0 2024-09-10T16:34:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 1 -- 172.21.15.81:0/465736807 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1047469915 0 0) 0x7f62c4073870 con 0x7f62c40a3ef0 2024-09-10T16:34:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 1 -- 172.21.15.81:0/465736807 >> v1:172.21.15.189:6791/0 conn(0x7f62c4073d20 legacy=0x7f62c413c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 1 -- 172.21.15.81:0/465736807 >> v1:172.21.15.81:6789/0 conn(0x7f62c40a49e0 legacy=0x7f62c413f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:34:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 1 monclient: found mon.noname-b 2024-09-10T16:34:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:34:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 1 -- 172.21.15.81:0/465736807 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c40a5870 con 0x7f62c40a3ef0 2024-09-10T16:34:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient: _finish_auth 0 2024-09-10T16:34:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:34:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 1 -- 172.21.15.81:0/465736807 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f62ac001820 con 0x7f62c40a3ef0 2024-09-10T16:34:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient: dump: 2024-09-10T16:34:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.330 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 5 monclient: authenticate success, global_id 144290 2024-09-10T16:34:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:36.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 1 -- 172.21.15.81:0/465736807 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62ac001a40 con 0x7f62c40a3ef0 2024-09-10T16:34:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 1 -- 172.21.15.81:0/465736807 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f62ac004bf0 con 0x7f62c40a3ef0 2024-09-10T16:34:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 4 set_mon_vals no callback set 2024-09-10T16:34:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c1ffb640 10 monclient: dump: 2024-09-10T16:34:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.331 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.332 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient: shutdown 2024-09-10T16:34:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 1 -- 172.21.15.81:0/465736807 >> v1:172.21.15.81:6790/0 conn(0x7f62c40a3ef0 legacy=0x7f62c40a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 1 -- 172.21.15.81:0/465736807 shutdown_connections 2024-09-10T16:34:36.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 1 -- 172.21.15.81:0/465736807 >> 172.21.15.81:0/465736807 conn(0x7f62c40a94f0 msgr2=0x7f62c40a9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 1 -- 172.21.15.81:0/465736807 shutdown_connections 2024-09-10T16:34:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 1 -- 172.21.15.81:0/465736807 wait complete. 2024-09-10T16:34:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient: build_initial_monmap 2024-09-10T16:34:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.316+0000 7f62c9a38640 10 monclient: monmap: 2024-09-10T16:34:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:36.333 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:36.334 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 1 Processor -- start 2024-09-10T16:34:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 1 -- start start 2024-09-10T16:34:36.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 10 monclient: init 2024-09-10T16:34:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 10 monclient: _add_conns ranks=[3,6,5,7,2,0,8,4,1] 2024-09-10T16:34:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 10 monclient(hunting): picked mon.noname-g con 0x7f62c4073d20 addr v1:172.21.15.189:6790/0 2024-09-10T16:34:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 10 monclient(hunting): picked mon.noname-d con 0x7f62c40a3ef0 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 10 monclient(hunting): picked mon.noname-h con 0x7f62c40a49e0 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c413ff40 con 0x7f62c4073d20 2024-09-10T16:34:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c409fd10 con 0x7f62c40a49e0 2024-09-10T16:34:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62c40a68d0 con 0x7f62c40a3ef0 2024-09-10T16:34:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 10 monclient(hunting): authenticate will time out at 1243.720734s 2024-09-10T16:34:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c27fc640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f62c40a3ef0 0x7f62c41d09f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:52440/0 (socket says 172.21.15.81:52440) 2024-09-10T16:34:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c27fc640 1 -- 172.21.15.81:0/1813560770 learned_addr learned my addr 172.21.15.81:0/1813560770 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2688406182 0 0) 0x7f62c40a68d0 con 0x7f62c40a3ef0 2024-09-10T16:34:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient(hunting): my global_id is 144231 2024-09-10T16:34:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62a4003530 con 0x7f62c40a3ef0 2024-09-10T16:34:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3974975541 0 0) 0x7f62a4003530 con 0x7f62c40a3ef0 2024-09-10T16:34:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62c40a68d0 con 0x7f62c40a3ef0 2024-09-10T16:34:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f62b4001be0 con 0x7f62c40a3ef0 2024-09-10T16:34:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:34:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient(hunting): dump: 2024-09-10T16:34:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.337 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.338 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2889422706 0 0) 0x7f62c40a68d0 con 0x7f62c40a3ef0 2024-09-10T16:34:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 >> v1:172.21.15.189:6791/0 conn(0x7f62c40a49e0 legacy=0x7f62c41d4120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 >> v1:172.21.15.189:6790/0 conn(0x7f62c4073d20 legacy=0x7f62c413f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient: _finish_hunting 0 2024-09-10T16:34:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 monclient: found mon.d 2024-09-10T16:34:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62c4124e30 con 0x7f62c40a3ef0 2024-09-10T16:34:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient: _finish_auth 0 2024-09-10T16:34:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient: _check_auth_tickets 2024-09-10T16:34:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 5 monclient: authenticate success, global_id 144231 2024-09-10T16:34:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 10 monclient: _renew_subs 2024-09-10T16:34:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 1 -- 172.21.15.81:0/1813560770 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f62c4126eb0 con 0x7f62c40a3ef0 2024-09-10T16:34:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 10 monclient: _renew_subs 2024-09-10T16:34:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 1 -- 172.21.15.81:0/1813560770 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f62c4125d60 con 0x7f62c40a3ef0 2024-09-10T16:34:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f62b40038d0 con 0x7f62c40a3ef0 2024-09-10T16:34:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f62b4003ec0 con 0x7f62c40a3ef0 2024-09-10T16:34:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c17fa640 4 set_mon_vals no callback set 2024-09-10T16:34:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient: dump: 2024-09-10T16:34:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.341 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c9a38640 1 -- 172.21.15.81:0/1813560770 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f62a80065d0 con 0x7f62a8002870 2024-09-10T16:34:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f62b4004060 con 0x7f62c40a3ef0 2024-09-10T16:34:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(228..228 src has 121..228) ==== 3506+0+0 (unknown 3835984861 0 0) 0x7f62b404aef0 con 0x7f62c40a3ef0 2024-09-10T16:34:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1927623703 0 0) 0x7f62a80065d0 con 0x7f62a8002870 2024-09-10T16:34:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient(hunting): my global_id is 144238 2024-09-10T16:34:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62c40a68d0 con 0x7f62a8002870 2024-09-10T16:34:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62c37fe640 10 monclient: get_auth_request con 0x7f62a403d040 auth_method 0 2024-09-10T16:34:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2027618236 0 0) 0x7f62c40a68d0 con 0x7f62a8002870 2024-09-10T16:34:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62a80065d0 con 0x7f62a8002870 2024-09-10T16:34:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f62ac004b30 con 0x7f62a8002870 2024-09-10T16:34:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:36.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient: dump: 2024-09-10T16:34:36.343 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.343 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.343 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.343 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.343 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.343 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.343 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.343 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.343 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.343 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.343 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.343 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.343 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.344 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.344 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.344 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2897318649 0 0) 0x7f62a80065d0 con 0x7f62a8002870 2024-09-10T16:34:36.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 --> v1:172.21.15.81:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f62a800a170 con 0x7f62a8002870 2024-09-10T16:34:36.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f62ac001530 con 0x7f62a8002870 2024-09-10T16:34:36.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:36.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:36.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 >> v1:172.21.15.81:6791/0 conn(0x7f62a8002870 legacy=0x7f62a8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.320+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 >> v1:172.21.15.81:6791/0 conn(0x7f62a8002870 legacy=0x7f62a8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:36.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62c9a38640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:36.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62c9a38640 1 -- 172.21.15.81:0/1813560770 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f62a8009e80 con 0x7f62a8009140 2024-09-10T16:34:36.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 448890327 0 0) 0x7f62a8009e80 con 0x7f62a8009140 2024-09-10T16:34:36.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 10 monclient(hunting): my global_id is 144247 2024-09-10T16:34:36.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f62a80065d0 con 0x7f62a8009140 2024-09-10T16:34:36.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 286971554 0 0) 0x7f62a80065d0 con 0x7f62a8009140 2024-09-10T16:34:36.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f62a8009e80 con 0x7f62a8009140 2024-09-10T16:34:36.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f62ac001c90 con 0x7f62a8009140 2024-09-10T16:34:36.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 10 monclient: dump: 2024-09-10T16:34:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.348 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.348 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.348 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.348 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 611758389 0 0) 0x7f62a8009e80 con 0x7f62a8009140 2024-09-10T16:34:36.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 --> v1:172.21.15.81:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f62a800c420 con 0x7f62a8009140 2024-09-10T16:34:36.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 4054441146) 0x7f62ac007080 con 0x7f62a8009140 2024-09-10T16:34:36.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:36.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:36.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 >> v1:172.21.15.81:6791/0 conn(0x7f62a8009140 legacy=0x7f62a80095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62bbfff640 1 -- 172.21.15.81:0/1813560770 >> v1:172.21.15.81:6791/0 conn(0x7f62a8009140 legacy=0x7f62a80095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:36.349 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 19175, 2024-09-10T16:34:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:36.349 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-09-10T16:34:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.350 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.351 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:36.352 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:36.353 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.354 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.357 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.358 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.360 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.361 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:36.362 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.363 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:36.366 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:36.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.368 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:36.368 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62c9a38640 1 -- 172.21.15.81:0/1813560770 >> v1:172.21.15.189:6812/1108603242 conn(0x7f62a403d040 legacy=0x7f62a403f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62c9a38640 10 monclient: shutdown 2024-09-10T16:34:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62c9a38640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62c9a38640 1 -- 172.21.15.81:0/1813560770 >> v1:172.21.15.81:6792/0 conn(0x7f62c40a3ef0 legacy=0x7f62c41d09f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62c37fe640 1 -- 172.21.15.81:0/1813560770 reap_dead start 2024-09-10T16:34:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62c37fe640 1 -- 172.21.15.81:0/1813560770 reap_dead start 2024-09-10T16:34:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62c9a38640 1 -- 172.21.15.81:0/1813560770 shutdown_connections 2024-09-10T16:34:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62c9a38640 1 -- 172.21.15.81:0/1813560770 >> 172.21.15.81:0/1813560770 conn(0x7f62c40a94f0 msgr2=0x7f62c4140520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62c9a38640 1 -- 172.21.15.81:0/1813560770 shutdown_connections 2024-09-10T16:34:36.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.328+0000 7f62c9a38640 1 -- 172.21.15.81:0/1813560770 wait complete. 2024-09-10T16:34:36.371 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:36.371 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-10T16:34:36.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-10T16:34:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient: get_monmap_and_config 2024-09-10T16:34:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient: build_initial_monmap 2024-09-10T16:34:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient: monmap: 2024-09-10T16:34:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:36.486107+0000 2024-09-10T16:34:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:36.486107+0000 2024-09-10T16:34:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:36.487 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 1 Processor -- start 2024-09-10T16:34:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 1 -- start start 2024-09-10T16:34:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient: init 2024-09-10T16:34:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient: _add_conns ranks=[5,7,2,3,8,0,1,4,6] 2024-09-10T16:34:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient(hunting): picked mon.noname-h con 0x7f0bf409ca10 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient(hunting): picked mon.noname-i con 0x7f0bf40a56e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient(hunting): picked mon.noname-b con 0x7f0bf40a5b00 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf41362b0 con 0x7f0bf40a5b00 2024-09-10T16:34:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf40a80b0 con 0x7f0bf409ca10 2024-09-10T16:34:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf409de70 con 0x7f0bf40a56e0 2024-09-10T16:34:36.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient(hunting): authenticate will time out at 1243.885479s 2024-09-10T16:34:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf3fff640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f0bf40a5b00 0x7f0bf4141650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:33336/0 (socket says 172.21.15.81:33336) 2024-09-10T16:34:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf3fff640 1 -- 172.21.15.81:0/2936934743 learned_addr learned my addr 172.21.15.81:0/2936934743 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 1 -- 172.21.15.81:0/2936934743 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1552365078 0 0) 0x7f0bf41362b0 con 0x7f0bf40a5b00 2024-09-10T16:34:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient(hunting): my global_id is 144299 2024-09-10T16:34:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 1 -- 172.21.15.81:0/2936934743 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0be0003530 con 0x7f0bf40a5b00 2024-09-10T16:34:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 1 -- 172.21.15.81:0/2936934743 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1466525151 0 0) 0x7f0bf40a80b0 con 0x7f0bf409ca10 2024-09-10T16:34:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient(hunting): my global_id is 5873 2024-09-10T16:34:36.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 1 -- 172.21.15.81:0/2936934743 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bf41362b0 con 0x7f0bf409ca10 2024-09-10T16:34:36.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 1 -- 172.21.15.81:0/2936934743 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3510078167 0 0) 0x7f0be0003530 con 0x7f0bf40a5b00 2024-09-10T16:34:36.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 1 -- 172.21.15.81:0/2936934743 >> v1:172.21.15.189:6792/0 conn(0x7f0bf40a56e0 legacy=0x7f0bf413df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 1 -- 172.21.15.81:0/2936934743 >> v1:172.21.15.189:6791/0 conn(0x7f0bf409ca10 legacy=0x7f0bf4135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient: _finish_hunting 0 2024-09-10T16:34:36.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 1 monclient: found mon.noname-b 2024-09-10T16:34:36.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:36.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:34:36.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 1 -- 172.21.15.81:0/2936934743 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf409e150 con 0x7f0bf40a5b00 2024-09-10T16:34:36.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient: _finish_auth 0 2024-09-10T16:34:36.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient: _check_auth_tickets 2024-09-10T16:34:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 1 -- 172.21.15.81:0/2936934743 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0be4001840 con 0x7f0bf40a5b00 2024-09-10T16:34:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient: dump: 2024-09-10T16:34:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.497 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.498 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 5 monclient: authenticate success, global_id 144299 2024-09-10T16:34:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 1 -- 172.21.15.81:0/2936934743 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0be4001a60 con 0x7f0bf40a5b00 2024-09-10T16:34:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:36.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 4 set_mon_vals no callback set 2024-09-10T16:34:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 1 -- 172.21.15.81:0/2936934743 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0be4004bf0 con 0x7f0bf40a5b00 2024-09-10T16:34:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bf27fc640 10 monclient: dump: 2024-09-10T16:34:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.499 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.500 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient: shutdown 2024-09-10T16:34:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 1 -- 172.21.15.81:0/2936934743 >> v1:172.21.15.81:6790/0 conn(0x7f0bf40a5b00 legacy=0x7f0bf4141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 1 -- 172.21.15.81:0/2936934743 shutdown_connections 2024-09-10T16:34:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 1 -- 172.21.15.81:0/2936934743 >> 172.21.15.81:0/2936934743 conn(0x7f0bf406dc90 msgr2=0x7f0bf40ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 1 -- 172.21.15.81:0/2936934743 shutdown_connections 2024-09-10T16:34:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 1 -- 172.21.15.81:0/2936934743 wait complete. 2024-09-10T16:34:36.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient: build_initial_monmap 2024-09-10T16:34:36.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.484+0000 7f0bfa198640 10 monclient: monmap: 2024-09-10T16:34:36.501 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:36.501 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:36.501 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:36.501 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:36.501 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:36.501 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:36.501 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:36.501 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:36.501 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:36.501 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:36.501 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:36.501 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:36.502 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 1 Processor -- start 2024-09-10T16:34:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 1 -- start start 2024-09-10T16:34:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 10 monclient: init 2024-09-10T16:34:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 10 monclient: _add_conns ranks=[6,4,2,7,0,3,1,5,8] 2024-09-10T16:34:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 10 monclient(hunting): picked mon.noname-d con 0x7f0bf409ca10 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 10 monclient(hunting): picked mon.noname-c con 0x7f0bf40a56e0 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 10 monclient(hunting): picked mon.noname-b con 0x7f0bf40a5b00 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:36.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf41300d0 con 0x7f0bf40a5b00 2024-09-10T16:34:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf4131b90 con 0x7f0bf40a56e0 2024-09-10T16:34:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0bf412f610 con 0x7f0bf409ca10 2024-09-10T16:34:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 10 monclient(hunting): authenticate will time out at 1243.888640s 2024-09-10T16:34:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bf37fe640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f0bf409ca10 0x7f0bf412e7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:52450/0 (socket says 172.21.15.81:52450) 2024-09-10T16:34:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bf2ffd640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f0bf40a56e0 0x7f0bf412ef00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:41764/0 (socket says 172.21.15.81:41764) 2024-09-10T16:34:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bf37fe640 1 -- 172.21.15.81:0/3137612883 learned_addr learned my addr 172.21.15.81:0/3137612883 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 493910062 0 0) 0x7f0bf41300d0 con 0x7f0bf40a5b00 2024-09-10T16:34:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): my global_id is 144308 2024-09-10T16:34:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bd4003530 con 0x7f0bf40a5b00 2024-09-10T16:34:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 117418831 0 0) 0x7f0bf4131b90 con 0x7f0bf40a56e0 2024-09-10T16:34:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): my global_id is 144256 2024-09-10T16:34:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bf41300d0 con 0x7f0bf40a56e0 2024-09-10T16:34:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2089079770 0 0) 0x7f0bf412f610 con 0x7f0bf409ca10 2024-09-10T16:34:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): my global_id is 144240 2024-09-10T16:34:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bf4131b90 con 0x7f0bf409ca10 2024-09-10T16:34:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2598220347 0 0) 0x7f0bf41300d0 con 0x7f0bf40a56e0 2024-09-10T16:34:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0bf412f610 con 0x7f0bf40a56e0 2024-09-10T16:34:36.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1306569671 0 0) 0x7f0bd4003530 con 0x7f0bf40a5b00 2024-09-10T16:34:36.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0bf41300d0 con 0x7f0bf40a5b00 2024-09-10T16:34:36.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2865998877 0 0) 0x7f0bf4131b90 con 0x7f0bf409ca10 2024-09-10T16:34:36.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0bd4003530 con 0x7f0bf409ca10 2024-09-10T16:34:36.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0bdc001a60 con 0x7f0bf40a56e0 2024-09-10T16:34:36.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:36.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:34:36.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): dump: 2024-09-10T16:34:36.505 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.505 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.505 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.505 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.505 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.505 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.506 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0be4001090 con 0x7f0bf40a5b00 2024-09-10T16:34:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:36.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): dump: 2024-09-10T16:34:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.508 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0bec001de0 con 0x7f0bf409ca10 2024-09-10T16:34:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): dump: 2024-09-10T16:34:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.509 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 340923592 0 0) 0x7f0bf412f610 con 0x7f0bf40a56e0 2024-09-10T16:34:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 >> v1:172.21.15.81:6792/0 conn(0x7f0bf409ca10 legacy=0x7f0bf412e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 >> v1:172.21.15.81:6790/0 conn(0x7f0bf40a5b00 legacy=0x7f0bf41d5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient: _finish_hunting 0 2024-09-10T16:34:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 monclient: found mon.c 2024-09-10T16:34:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bf4131e70 con 0x7f0bf40a56e0 2024-09-10T16:34:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient: _finish_auth 0 2024-09-10T16:34:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient: _check_auth_tickets 2024-09-10T16:34:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 5 monclient: authenticate success, global_id 144256 2024-09-10T16:34:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 10 monclient: _renew_subs 2024-09-10T16:34:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0bf4132150 con 0x7f0bf40a56e0 2024-09-10T16:34:36.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0bdc0038d0 con 0x7f0bf40a56e0 2024-09-10T16:34:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0bdc003e40 con 0x7f0bf40a56e0 2024-09-10T16:34:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bf17fa640 4 set_mon_vals no callback set 2024-09-10T16:34:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient: dump: 2024-09-10T16:34:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.511 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.512 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 10 monclient: _renew_subs 2024-09-10T16:34:36.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f0bf4130980 con 0x7f0bf40a56e0 2024-09-10T16:34:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f0bdc001c00 con 0x7f0bf40a56e0 2024-09-10T16:34:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bfa198640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0bf40008e0 con 0x7f0bf4142d70 2024-09-10T16:34:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(228..228 src has 121..228) ==== 3506+0+0 (unknown 3835984861 0 0) 0x7f0bdc04ab70 con 0x7f0bf40a56e0 2024-09-10T16:34:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1154712126 0 0) 0x7f0bf40008e0 con 0x7f0bf4142d70 2024-09-10T16:34:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient(hunting): my global_id is 144249 2024-09-10T16:34:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bf412f610 con 0x7f0bf4142d70 2024-09-10T16:34:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bf37fe640 10 monclient: get_auth_request con 0x7f0bd403d990 auth_method 0 2024-09-10T16:34:36.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3325149947 0 0) 0x7f0bf412f610 con 0x7f0bf4142d70 2024-09-10T16:34:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0bf40008e0 con 0x7f0bf4142d70 2024-09-10T16:34:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0be4004e70 con 0x7f0bf4142d70 2024-09-10T16:34:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient: dump: 2024-09-10T16:34:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.515 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2819763249 0 0) 0x7f0bf40008e0 con 0x7f0bf4142d70 2024-09-10T16:34:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0bf40aaa60 con 0x7f0bf4142d70 2024-09-10T16:34:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0be4007190 con 0x7f0bf4142d70 2024-09-10T16:34:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 >> v1:172.21.15.81:6792/0 conn(0x7f0bf4142d70 legacy=0x7f0bf4136730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.488+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 >> v1:172.21.15.81:6792/0 conn(0x7f0bf4142d70 legacy=0x7f0bf4136730 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:36.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bfa198640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:36.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bfa198640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f0bf4132c30 con 0x7f0bf4132850 2024-09-10T16:34:36.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3675869371 0 0) 0x7f0bf4132c30 con 0x7f0bf4132850 2024-09-10T16:34:36.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 10 monclient(hunting): my global_id is 144258 2024-09-10T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0bf40008e0 con 0x7f0bf4132850 2024-09-10T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2109261458 0 0) 0x7f0bf40008e0 con 0x7f0bf4132850 2024-09-10T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0bf4132c30 con 0x7f0bf4132850 2024-09-10T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0be4005800 con 0x7f0bf4132850 2024-09-10T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 10 monclient: dump: 2024-09-10T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.518 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3804573825 0 0) 0x7f0bf4132c30 con 0x7f0bf4132850 2024-09-10T16:34:36.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 --> v1:172.21.15.81:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f0bf4137550 con 0x7f0bf4132850 2024-09-10T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7710 (unknown 0 0 2419236389) 0x7f0be400a1a0 con 0x7f0bf4132850 2024-09-10T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 >> v1:172.21.15.81:6792/0 conn(0x7f0bf4132850 legacy=0x7f0bf4136e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bebfff640 1 -- 172.21.15.81:0/3137612883 >> v1:172.21.15.81:6792/0 conn(0x7f0bf4132850 legacy=0x7f0bf4136e40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:36.520 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 19343, 2024-09-10T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.521 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-09-10T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.522 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.523 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:36.524 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.525 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:36.526 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.527 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.528 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.530 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:36.531 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:36.532 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:36.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.534 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:36.535 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:36.536 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.537 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:36.539 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:36.540 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-09-10T16:34:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.541 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:36.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.543 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:36.543 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:36.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bfa198640 1 -- 172.21.15.81:0/3137612883 >> v1:172.21.15.189:6812/1108603242 conn(0x7f0bd403d990 legacy=0x7f0bd403fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bfa198640 10 monclient: shutdown 2024-09-10T16:34:36.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bfa198640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bfa198640 1 -- 172.21.15.81:0/3137612883 >> v1:172.21.15.81:6791/0 conn(0x7f0bf40a56e0 legacy=0x7f0bf412ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bf3fff640 1 -- 172.21.15.81:0/3137612883 reap_dead start 2024-09-10T16:34:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bfa198640 1 -- 172.21.15.81:0/3137612883 shutdown_connections 2024-09-10T16:34:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bfa198640 1 -- 172.21.15.81:0/3137612883 >> 172.21.15.81:0/3137612883 conn(0x7f0bf406dc90 msgr2=0x7f0bf40a82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bfa198640 1 -- 172.21.15.81:0/3137612883 shutdown_connections 2024-09-10T16:34:36.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.496+0000 7f0bfa198640 1 -- 172.21.15.81:0/3137612883 wait complete. 2024-09-10T16:34:36.545 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:36.546 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-10T16:34:36.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-10T16:34:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.660+0000 7f5f2c2ce640 10 monclient: get_monmap_and_config 2024-09-10T16:34:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.660+0000 7f5f2c2ce640 10 monclient: build_initial_monmap 2024-09-10T16:34:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.660+0000 7f5f2c2ce640 10 monclient: monmap: 2024-09-10T16:34:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:36.665642+0000 2024-09-10T16:34:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:36.665642+0000 2024-09-10T16:34:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:36.666 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 1 Processor -- start 2024-09-10T16:34:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 1 -- start start 2024-09-10T16:34:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 10 monclient: init 2024-09-10T16:34:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 10 monclient: _add_conns ranks=[6,1,4,5,3,2,8,7,0] 2024-09-10T16:34:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 10 monclient(hunting): picked mon.noname-d con 0x7f5f2409d440 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 10 monclient(hunting): picked mon.noname-f con 0x7f5f240a39e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 10 monclient(hunting): picked mon.noname-c con 0x7f5f240a0900 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:36.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f240a37a0 con 0x7f5f240a39e0 2024-09-10T16:34:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f24074d30 con 0x7f5f240a0900 2024-09-10T16:34:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f2409d820 con 0x7f5f2409d440 2024-09-10T16:34:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 10 monclient(hunting): authenticate will time out at 1244.065309s 2024-09-10T16:34:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2a06a640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f5f2409d440 0x7f5f2409fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:52486/0 (socket says 172.21.15.81:52486) 2024-09-10T16:34:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2a06a640 1 -- 172.21.15.81:0/1939564617 learned_addr learned my addr 172.21.15.81:0/1939564617 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 1 -- 172.21.15.81:0/1939564617 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2071795562 0 0) 0x7f5f2409d820 con 0x7f5f2409d440 2024-09-10T16:34:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient(hunting): my global_id is 144267 2024-09-10T16:34:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 1 -- 172.21.15.81:0/1939564617 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f10003530 con 0x7f5f2409d440 2024-09-10T16:34:36.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 1 -- 172.21.15.81:0/1939564617 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339063848 0 0) 0x7f5f24074d30 con 0x7f5f240a0900 2024-09-10T16:34:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient(hunting): my global_id is 144265 2024-09-10T16:34:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 1 -- 172.21.15.81:0/1939564617 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f2409d820 con 0x7f5f240a0900 2024-09-10T16:34:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 1 -- 172.21.15.81:0/1939564617 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1067485614 0 0) 0x7f5f10003530 con 0x7f5f2409d440 2024-09-10T16:34:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 1 -- 172.21.15.81:0/1939564617 >> v1:172.21.15.81:6791/0 conn(0x7f5f240a0900 legacy=0x7f5f2413e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 1 -- 172.21.15.81:0/1939564617 >> v1:172.21.15.189:6789/0 conn(0x7f5f240a39e0 legacy=0x7f5f240a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient: _finish_hunting 0 2024-09-10T16:34:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 1 monclient: found mon.noname-d 2024-09-10T16:34:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:34:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 1 -- 172.21.15.81:0/1939564617 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f2409e1c0 con 0x7f5f2409d440 2024-09-10T16:34:36.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient: _finish_auth 0 2024-09-10T16:34:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient: _check_auth_tickets 2024-09-10T16:34:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 1 -- 172.21.15.81:0/1939564617 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5f14001840 con 0x7f5f2409d440 2024-09-10T16:34:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:34:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient: dump: 2024-09-10T16:34:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.677 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.678 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 5 monclient: authenticate success, global_id 144267 2024-09-10T16:34:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 1 -- 172.21.15.81:0/1939564617 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f140019e0 con 0x7f5f2409d440 2024-09-10T16:34:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:36.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 1 -- 172.21.15.81:0/1939564617 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5f14004bf0 con 0x7f5f2409d440 2024-09-10T16:34:36.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:36.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f29068640 10 monclient: dump: 2024-09-10T16:34:36.679 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.679 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.679 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.679 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.679 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.679 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.679 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.679 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.679 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.679 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.679 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.680 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.680 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.680 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.680 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.680 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:36.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 4 set_mon_vals no callback set 2024-09-10T16:34:36.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 10 monclient: shutdown 2024-09-10T16:34:36.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:36.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1939564617 >> v1:172.21.15.81:6792/0 conn(0x7f5f2409d440 legacy=0x7f5f2409fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1939564617 shutdown_connections 2024-09-10T16:34:36.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1939564617 >> 172.21.15.81:0/1939564617 conn(0x7f5f240a3fd0 msgr2=0x7f5f240a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:36.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1939564617 shutdown_connections 2024-09-10T16:34:36.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1939564617 wait complete. 2024-09-10T16:34:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 10 monclient: build_initial_monmap 2024-09-10T16:34:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 10 monclient: monmap: 2024-09-10T16:34:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:36.681 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:36.682 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 1 Processor -- start 2024-09-10T16:34:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 1 -- start start 2024-09-10T16:34:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.664+0000 7f5f2c2ce640 10 monclient: init 2024-09-10T16:34:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 10 monclient: _add_conns ranks=[3,1,7,5,8,0,6,2,4] 2024-09-10T16:34:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 10 monclient(hunting): picked mon.noname-g con 0x7f5f2409d440 addr v1:172.21.15.189:6790/0 2024-09-10T16:34:36.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 10 monclient(hunting): picked mon.noname-f con 0x7f5f240a0900 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:36.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 10 monclient(hunting): picked mon.noname-i con 0x7f5f240a39e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:36.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f24094720 con 0x7f5f240a0900 2024-09-10T16:34:36.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f2409ead0 con 0x7f5f2409d440 2024-09-10T16:34:36.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5f2409f000 con 0x7f5f240a39e0 2024-09-10T16:34:36.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:36.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 10 monclient(hunting): authenticate will time out at 1244.068240s 2024-09-10T16:34:36.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f29869640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7f5f240a0900 0x7f5f24093600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.81:33318/0 (socket says 172.21.15.81:33318) 2024-09-10T16:34:36.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2a06a640 1 --1- >> v1:172.21.15.189:6790/0 conn(0x7f5f2409d440 0x7f5f24092ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6790/0 says I am v1:172.21.15.81:50682/0 (socket says 172.21.15.81:50682) 2024-09-10T16:34:36.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f29869640 1 -- 172.21.15.81:0/1908743438 learned_addr learned my addr 172.21.15.81:0/1908743438 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:36.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2344317143 0 0) 0x7f5f2409ead0 con 0x7f5f2409d440 2024-09-10T16:34:36.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): my global_id is 134922 2024-09-10T16:34:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f08003530 con 0x7f5f2409d440 2024-09-10T16:34:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3172718795 0 0) 0x7f5f24094720 con 0x7f5f240a0900 2024-09-10T16:34:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): my global_id is 6103 2024-09-10T16:34:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f2409ead0 con 0x7f5f240a0900 2024-09-10T16:34:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3863394317 0 0) 0x7f5f2409f000 con 0x7f5f240a39e0 2024-09-10T16:34:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): my global_id is 144268 2024-09-10T16:34:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f24094720 con 0x7f5f240a39e0 2024-09-10T16:34:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3403514740 0 0) 0x7f5f08003530 con 0x7f5f2409d440 2024-09-10T16:34:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f2409f000 con 0x7f5f2409d440 2024-09-10T16:34:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3746306731 0 0) 0x7f5f2409ead0 con 0x7f5f240a0900 2024-09-10T16:34:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f08003530 con 0x7f5f240a0900 2024-09-10T16:34:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5f20001a90 con 0x7f5f240a0900 2024-09-10T16:34:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): got monmap 1 from mon.noname-f (according to old e1) 2024-09-10T16:34:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): dump: 2024-09-10T16:34:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.685 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.686 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5f140017c0 con 0x7f5f2409d440 2024-09-10T16:34:36.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): got monmap 1 from mon.g (according to old e1) 2024-09-10T16:34:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): dump: 2024-09-10T16:34:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.687 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.688 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3999660186 0 0) 0x7f5f24094720 con 0x7f5f240a39e0 2024-09-10T16:34:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f2409ead0 con 0x7f5f240a39e0 2024-09-10T16:34:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5f1c0018e0 con 0x7f5f240a39e0 2024-09-10T16:34:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): got monmap 1 from mon.i (according to old e1) 2024-09-10T16:34:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): dump: 2024-09-10T16:34:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.688 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.689 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2924555890 0 0) 0x7f5f2409f000 con 0x7f5f2409d440 2024-09-10T16:34:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 >> v1:172.21.15.189:6792/0 conn(0x7f5f240a39e0 legacy=0x7f5f241d3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 >> v1:172.21.15.189:6789/0 conn(0x7f5f240a0900 legacy=0x7f5f24093600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient: _finish_hunting 0 2024-09-10T16:34:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 monclient: found mon.g 2024-09-10T16:34:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:34:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f24096a80 con 0x7f5f2409d440 2024-09-10T16:34:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient: _finish_auth 0 2024-09-10T16:34:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient: _check_auth_tickets 2024-09-10T16:34:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 5 monclient: authenticate success, global_id 134922 2024-09-10T16:34:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 10 monclient: _renew_subs 2024-09-10T16:34:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:34:36.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f5f24095280 con 0x7f5f2409d440 2024-09-10T16:34:36.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 10 monclient: _renew_subs 2024-09-10T16:34:36.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:34:36.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f5f24097100 con 0x7f5f2409d440 2024-09-10T16:34:36.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.3 v1:172.21.15.189:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5f14001960 con 0x7f5f2409d440 2024-09-10T16:34:36.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:36.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.3 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5f14004bc0 con 0x7f5f2409d440 2024-09-10T16:34:36.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f28867640 4 set_mon_vals no callback set 2024-09-10T16:34:36.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:34:36.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient: dump: 2024-09-10T16:34:36.691 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.691 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.692 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.692 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.692 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.692 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.692 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.692 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.692 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.692 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.692 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.692 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.692 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.692 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.692 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.693 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5f0c0065d0 con 0x7f5f0c002870 2024-09-10T16:34:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3952636954 0 0) 0x7f5f0c0065d0 con 0x7f5f0c002870 2024-09-10T16:34:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient(hunting): my global_id is 5957 2024-09-10T16:34:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f2409f000 con 0x7f5f0c002870 2024-09-10T16:34:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 613228464 0 0) 0x7f5f2409f000 con 0x7f5f0c002870 2024-09-10T16:34:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f0c0065d0 con 0x7f5f0c002870 2024-09-10T16:34:36.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5f20003940 con 0x7f5f0c002870 2024-09-10T16:34:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 10 monclient: dump: 2024-09-10T16:34:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.694 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.695 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.695 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.695 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.695 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.695 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 725776622 0 0) 0x7f5f0c0065d0 con 0x7f5f0c002870 2024-09-10T16:34:36.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.81:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5f0c00a170 con 0x7f5f0c002870 2024-09-10T16:34:36.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.3 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f5f14010f60 con 0x7f5f2409d440 2024-09-10T16:34:36.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.668+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.3 v1:172.21.15.189:6790/0 8 ==== osd_map(228..228 src has 121..228) ==== 3506+0+0 (unknown 3835984861 0 0) 0x7f5f1404ab00 con 0x7f5f2409d440 2024-09-10T16:34:36.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.672+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f5f20003e50 con 0x7f5f0c002870 2024-09-10T16:34:36.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.672+0000 7f5f1affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:36.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.672+0000 7f5f1affd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:36.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.672+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 >> v1:172.21.15.81:6793/0 conn(0x7f5f0c002870 legacy=0x7f5f0c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.672+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 >> v1:172.21.15.81:6793/0 conn(0x7f5f0c002870 legacy=0x7f5f0c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:36.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.672+0000 7f5f2a86b640 10 monclient: get_auth_request con 0x7f5f0803db60 auth_method 0 2024-09-10T16:34:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f2c2ce640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f5f0c009e90 con 0x7f5f0c009150 2024-09-10T16:34:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4112309552 0 0) 0x7f5f0c009e90 con 0x7f5f0c009150 2024-09-10T16:34:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 10 monclient(hunting): my global_id is 5966 2024-09-10T16:34:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5f0c0065d0 con 0x7f5f0c009150 2024-09-10T16:34:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2903620690 0 0) 0x7f5f0c0065d0 con 0x7f5f0c009150 2024-09-10T16:34:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f5f0c009e90 con 0x7f5f0c009150 2024-09-10T16:34:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5f200057d0 con 0x7f5f0c009150 2024-09-10T16:34:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 10 monclient: dump: 2024-09-10T16:34:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.698 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.699 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.699 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 159784207 0 0) 0x7f5f0c009e90 con 0x7f5f0c009150 2024-09-10T16:34:36.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 --> v1:172.21.15.81:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f5f0c00c420 con 0x7f5f0c009150 2024-09-10T16:34:36.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 2110311464) 0x7f5f20007a70 con 0x7f5f0c009150 2024-09-10T16:34:36.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:36.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:36.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 >> v1:172.21.15.81:6793/0 conn(0x7f5f0c009150 legacy=0x7f5f0c0095e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f1affd640 1 -- 172.21.15.81:0/1908743438 >> v1:172.21.15.81:6793/0 conn(0x7f5f0c009150 legacy=0x7f5f0c0095e0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:36.700 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:36.700 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 286637, 2024-09-10T16:34:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:36.701 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-09-10T16:34:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.702 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.703 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:36.704 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:36.705 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.706 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.707 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.708 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:36.710 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:36.711 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:36.712 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.713 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.715 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.716 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.717 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.718 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.719 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:34:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:34:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.720 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:34:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.721 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:36.721 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:36.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1908743438 >> v1:172.21.15.189:6812/1108603242 conn(0x7f5f0803db60 legacy=0x7f5f08040020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f2c2ce640 10 monclient: shutdown 2024-09-10T16:34:36.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f2c2ce640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:36.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1908743438 >> v1:172.21.15.189:6790/0 conn(0x7f5f2409d440 legacy=0x7f5f24092ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f2a86b640 1 -- 172.21.15.81:0/1908743438 reap_dead start 2024-09-10T16:34:36.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f2a86b640 1 -- 172.21.15.81:0/1908743438 reap_dead start 2024-09-10T16:34:36.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1908743438 shutdown_connections 2024-09-10T16:34:36.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1908743438 >> 172.21.15.81:0/1908743438 conn(0x7f5f240a3fd0 msgr2=0x7f5f240a5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:36.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1908743438 shutdown_connections 2024-09-10T16:34:36.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.676+0000 7f5f2c2ce640 1 -- 172.21.15.81:0/1908743438 wait complete. 2024-09-10T16:34:36.725 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:36.725 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-10T16:34:36.725 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-10T16:34:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient: get_monmap_and_config 2024-09-10T16:34:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient: build_initial_monmap 2024-09-10T16:34:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient: monmap: 2024-09-10T16:34:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:36.838277+0000 2024-09-10T16:34:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:36.838277+0000 2024-09-10T16:34:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:36.839 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:36.839 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 1 Processor -- start 2024-09-10T16:34:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 1 -- start start 2024-09-10T16:34:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient: init 2024-09-10T16:34:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:36.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient: _add_conns ranks=[1,3,2,7,4,6,5,0,8] 2024-09-10T16:34:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient(hunting): picked mon.noname-f con 0x7f4e08135610 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient(hunting): picked mon.noname-g con 0x7f4e080a5c60 addr v1:172.21.15.189:6790/0 2024-09-10T16:34:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient(hunting): picked mon.noname-b con 0x7f4e0813f5b0 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e08136240 con 0x7f4e08135610 2024-09-10T16:34:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e0809cba0 con 0x7f4e0813f5b0 2024-09-10T16:34:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e0809d720 con 0x7f4e080a5c60 2024-09-10T16:34:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient(hunting): authenticate will time out at 1244.237691s 2024-09-10T16:34:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0ecaa640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f4e0813f5b0 0x7f4e081419a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:33356/0 (socket says 172.21.15.81:33356) 2024-09-10T16:34:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0ecaa640 1 -- 172.21.15.81:0/985053852 learned_addr learned my addr 172.21.15.81:0/985053852 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 1 -- 172.21.15.81:0/985053852 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3550202826 0 0) 0x7f4e0809cba0 con 0x7f4e0813f5b0 2024-09-10T16:34:36.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient(hunting): my global_id is 144317 2024-09-10T16:34:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 1 -- 172.21.15.81:0/985053852 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4df0003530 con 0x7f4e0813f5b0 2024-09-10T16:34:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 1 -- 172.21.15.81:0/985053852 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3476750147 0 0) 0x7f4df0003530 con 0x7f4e0813f5b0 2024-09-10T16:34:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 1 -- 172.21.15.81:0/985053852 >> v1:172.21.15.189:6790/0 conn(0x7f4e080a5c60 legacy=0x7f4e0813de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 1 -- 172.21.15.81:0/985053852 >> v1:172.21.15.189:6789/0 conn(0x7f4e08135610 legacy=0x7f4e080a5550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient: _finish_hunting 0 2024-09-10T16:34:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 1 monclient: found mon.noname-b 2024-09-10T16:34:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:34:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 1 -- 172.21.15.81:0/985053852 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0809da00 con 0x7f4e0813f5b0 2024-09-10T16:34:36.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient: _finish_auth 0 2024-09-10T16:34:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient: _check_auth_tickets 2024-09-10T16:34:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 5 monclient: authenticate success, global_id 144317 2024-09-10T16:34:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 1 -- 172.21.15.81:0/985053852 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4df8001840 con 0x7f4e0813f5b0 2024-09-10T16:34:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient: dump: 2024-09-10T16:34:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.848 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.849 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:36.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 1 -- 172.21.15.81:0/985053852 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4df80019e0 con 0x7f4e0813f5b0 2024-09-10T16:34:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 1 -- 172.21.15.81:0/985053852 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4df8004bf0 con 0x7f4e0813f5b0 2024-09-10T16:34:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 4 set_mon_vals no callback set 2024-09-10T16:34:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e0d4a7640 10 monclient: dump: 2024-09-10T16:34:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.850 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.851 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient: shutdown 2024-09-10T16:34:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 1 -- 172.21.15.81:0/985053852 >> v1:172.21.15.81:6790/0 conn(0x7f4e0813f5b0 legacy=0x7f4e081419a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 1 -- 172.21.15.81:0/985053852 shutdown_connections 2024-09-10T16:34:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 1 -- 172.21.15.81:0/985053852 >> 172.21.15.81:0/985053852 conn(0x7f4e0806db50 msgr2=0x7f4e080ab9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 1 -- 172.21.15.81:0/985053852 shutdown_connections 2024-09-10T16:34:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 1 -- 172.21.15.81:0/985053852 wait complete. 2024-09-10T16:34:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient: build_initial_monmap 2024-09-10T16:34:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.836+0000 7f4e1070d640 10 monclient: monmap: 2024-09-10T16:34:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:36.852 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:36.853 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 1 Processor -- start 2024-09-10T16:34:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 1 -- start start 2024-09-10T16:34:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 10 monclient: init 2024-09-10T16:34:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 10 monclient: _add_conns ranks=[2,3,1,5,4,7,0,6,8] 2024-09-10T16:34:36.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 10 monclient(hunting): picked mon.noname-b con 0x7f4e080a5c60 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:36.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 10 monclient(hunting): picked mon.noname-g con 0x7f4e08135610 addr v1:172.21.15.189:6790/0 2024-09-10T16:34:36.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 10 monclient(hunting): picked mon.noname-f con 0x7f4e0813f5b0 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:36.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e080a58e0 con 0x7f4e0813f5b0 2024-09-10T16:34:36.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e0813dcc0 con 0x7f4e080a5c60 2024-09-10T16:34:36.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e0813c6c0 con 0x7f4e08135610 2024-09-10T16:34:36.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:36.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 10 monclient(hunting): authenticate will time out at 1244.240781s 2024-09-10T16:34:36.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e0e4a9640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f4e080a5c60 0x7f4e081324d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:33368/0 (socket says 172.21.15.81:33368) 2024-09-10T16:34:36.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e0e4a9640 1 -- 172.21.15.81:0/3669422347 learned_addr learned my addr 172.21.15.81:0/3669422347 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:36.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2485566309 0 0) 0x7f4e0813dcc0 con 0x7f4e080a5c60 2024-09-10T16:34:36.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient(hunting): my global_id is 144326 2024-09-10T16:34:36.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4df4003530 con 0x7f4e080a5c60 2024-09-10T16:34:36.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3414442740 0 0) 0x7f4df4003530 con 0x7f4e080a5c60 2024-09-10T16:34:36.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4e0813dcc0 con 0x7f4e080a5c60 2024-09-10T16:34:36.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4e00001f00 con 0x7f4e080a5c60 2024-09-10T16:34:36.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:36.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:36.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient(hunting): dump: 2024-09-10T16:34:36.855 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.855 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.855 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.856 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.856 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2906403427 0 0) 0x7f4e0813dcc0 con 0x7f4e080a5c60 2024-09-10T16:34:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 >> v1:172.21.15.189:6790/0 conn(0x7f4e08135610 legacy=0x7f4e081d27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 >> v1:172.21.15.189:6789/0 conn(0x7f4e0813f5b0 legacy=0x7f4e081d5f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:34:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 monclient: found mon.b 2024-09-10T16:34:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e0813e420 con 0x7f4e080a5c60 2024-09-10T16:34:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient: _finish_auth 0 2024-09-10T16:34:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:34:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:36.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 5 monclient: authenticate success, global_id 144326 2024-09-10T16:34:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 10 monclient: _renew_subs 2024-09-10T16:34:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 1 -- 172.21.15.81:0/3669422347 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4e08139ef0 con 0x7f4e080a5c60 2024-09-10T16:34:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 10 monclient: _renew_subs 2024-09-10T16:34:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 1 -- 172.21.15.81:0/3669422347 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f4e08132db0 con 0x7f4e080a5c60 2024-09-10T16:34:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4e00003c50 con 0x7f4e080a5c60 2024-09-10T16:34:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4e00004240 con 0x7f4e080a5c60 2024-09-10T16:34:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e0cca6640 4 set_mon_vals no callback set 2024-09-10T16:34:36.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient: dump: 2024-09-10T16:34:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.859 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.860 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.860 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.860 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:36.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e1070d640 1 -- 172.21.15.81:0/3669422347 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4de80065d0 con 0x7f4de8002870 2024-09-10T16:34:36.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f4e000043e0 con 0x7f4e080a5c60 2024-09-10T16:34:36.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(228..228 src has 121..228) ==== 3506+0+0 (unknown 3835984861 0 0) 0x7f4e0004b280 con 0x7f4e080a5c60 2024-09-10T16:34:36.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e0ecaa640 10 monclient: get_auth_request con 0x7f4df403d040 auth_method 0 2024-09-10T16:34:36.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1678486988 0 0) 0x7f4de80065d0 con 0x7f4de8002870 2024-09-10T16:34:36.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient(hunting): my global_id is 6130 2024-09-10T16:34:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4e0813dcc0 con 0x7f4de8002870 2024-09-10T16:34:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1539081193 0 0) 0x7f4e0813dcc0 con 0x7f4de8002870 2024-09-10T16:34:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4de80065d0 con 0x7f4de8002870 2024-09-10T16:34:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4dfc001760 con 0x7f4de8002870 2024-09-10T16:34:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:34:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 10 monclient: dump: 2024-09-10T16:34:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.861 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.862 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 705236411 0 0) 0x7f4de80065d0 con 0x7f4de8002870 2024-09-10T16:34:36.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.840+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 --> v1:172.21.15.189:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4de800a170 con 0x7f4de8002870 2024-09-10T16:34:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.844+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4dfc001a90 con 0x7f4de8002870 2024-09-10T16:34:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.844+0000 7f4e06ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.844+0000 7f4e06ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:36.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.844+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 >> v1:172.21.15.189:6789/0 conn(0x7f4de8002870 legacy=0x7f4de8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.844+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 >> v1:172.21.15.189:6789/0 conn(0x7f4de8002870 legacy=0x7f4de8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.848+0000 7f4e1070d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.848+0000 7f4e1070d640 1 -- 172.21.15.81:0/3669422347 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4de8009e80 con 0x7f4de8009140 2024-09-10T16:34:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.848+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3820682566 0 0) 0x7f4de8009e80 con 0x7f4de8009140 2024-09-10T16:34:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.848+0000 7f4e06ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.848+0000 7f4e06ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.848+0000 7f4e06ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.848+0000 7f4e06ffd640 10 monclient(hunting): my global_id is 6139 2024-09-10T16:34:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.848+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4de80065d0 con 0x7f4de8009140 2024-09-10T16:34:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.848+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 996397166 0 0) 0x7f4de80065d0 con 0x7f4de8009140 2024-09-10T16:34:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4de8009e80 con 0x7f4de8009140 2024-09-10T16:34:36.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4dfc003960 con 0x7f4de8009140 2024-09-10T16:34:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e06ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e06ffd640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:34:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e06ffd640 10 monclient: dump: 2024-09-10T16:34:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:36.867 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:36.868 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2465042333 0 0) 0x7f4de8009e80 con 0x7f4de8009140 2024-09-10T16:34:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 --> v1:172.21.15.189:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4de800c420 con 0x7f4de8009140 2024-09-10T16:34:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 3524472332) 0x7f4dfc005be0 con 0x7f4de8009140 2024-09-10T16:34:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e06ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e06ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 >> v1:172.21.15.189:6789/0 conn(0x7f4de8009140 legacy=0x7f4de80095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e06ffd640 1 -- 172.21.15.81:0/3669422347 >> v1:172.21.15.189:6789/0 conn(0x7f4de8009140 legacy=0x7f4de80095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:36.869 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 286764, 2024-09-10T16:34:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:36.869 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-09-10T16:34:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:36.870 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:36.871 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.872 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:36.873 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:36.874 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.875 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.877 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:36.878 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:36.879 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.880 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.882 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.883 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.884 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:36.885 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:36.886 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:36.887 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:36.888 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:34:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:36.889 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:36.889 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:36.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e1070d640 1 -- 172.21.15.81:0/3669422347 >> v1:172.21.15.189:6812/1108603242 conn(0x7f4df403d040 legacy=0x7f4df403f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e1070d640 10 monclient: shutdown 2024-09-10T16:34:36.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e1070d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:36.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e1070d640 1 -- 172.21.15.81:0/3669422347 >> v1:172.21.15.81:6790/0 conn(0x7f4e080a5c60 legacy=0x7f4e081324d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:36.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e0ecaa640 1 -- 172.21.15.81:0/3669422347 reap_dead start 2024-09-10T16:34:36.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e0ecaa640 1 -- 172.21.15.81:0/3669422347 reap_dead start 2024-09-10T16:34:36.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e1070d640 1 -- 172.21.15.81:0/3669422347 shutdown_connections 2024-09-10T16:34:36.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e1070d640 1 -- 172.21.15.81:0/3669422347 >> 172.21.15.81:0/3669422347 conn(0x7f4e0806db50 msgr2=0x7f4e08133510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:36.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e1070d640 1 -- 172.21.15.81:0/3669422347 shutdown_connections 2024-09-10T16:34:36.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:36.852+0000 7f4e1070d640 1 -- 172.21.15.81:0/3669422347 wait complete. 2024-09-10T16:34:36.891 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:36.892 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-10T16:34:36.892 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-10T16:34:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 10 monclient: get_monmap_and_config 2024-09-10T16:34:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 10 monclient: build_initial_monmap 2024-09-10T16:34:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 10 monclient: monmap: 2024-09-10T16:34:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:37.007380+0000 2024-09-10T16:34:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:37.007380+0000 2024-09-10T16:34:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:37.008 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 1 Processor -- start 2024-09-10T16:34:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 1 -- start start 2024-09-10T16:34:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 10 monclient: init 2024-09-10T16:34:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 10 monclient: _add_conns ranks=[2,7,1,0,6,3,4,8,5] 2024-09-10T16:34:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 10 monclient(hunting): picked mon.noname-b con 0x7ff51c0a0a90 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 10 monclient(hunting): picked mon.noname-i con 0x7ff51c0a35f0 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 10 monclient(hunting): picked mon.noname-f con 0x7ff51c0a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff51c09df70 con 0x7ff51c0a3a40 2024-09-10T16:34:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff51c09fa30 con 0x7ff51c0a0a90 2024-09-10T16:34:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff51c09fd10 con 0x7ff51c0a35f0 2024-09-10T16:34:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 10 monclient(hunting): authenticate will time out at 1244.406867s 2024-09-10T16:34:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51a59c640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7ff51c0a0a90 0x7ff51c0a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:33370/0 (socket says 172.21.15.81:33370) 2024-09-10T16:34:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51a59c640 1 -- 172.21.15.81:0/2794728298 learned_addr learned my addr 172.21.15.81:0/2794728298 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 1 -- 172.21.15.81:0/2794728298 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3712255912 0 0) 0x7ff51c09fa30 con 0x7ff51c0a0a90 2024-09-10T16:34:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient(hunting): my global_id is 144335 2024-09-10T16:34:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 1 -- 172.21.15.81:0/2794728298 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff508003530 con 0x7ff51c0a0a90 2024-09-10T16:34:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 1 -- 172.21.15.81:0/2794728298 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 301988759 0 0) 0x7ff508003530 con 0x7ff51c0a0a90 2024-09-10T16:34:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 1 -- 172.21.15.81:0/2794728298 >> v1:172.21.15.189:6792/0 conn(0x7ff51c0a35f0 legacy=0x7ff51c13c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 1 -- 172.21.15.81:0/2794728298 >> v1:172.21.15.189:6789/0 conn(0x7ff51c0a3a40 legacy=0x7ff51c13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient: _finish_hunting 0 2024-09-10T16:34:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 1 monclient: found mon.noname-b 2024-09-10T16:34:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:34:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 1 -- 172.21.15.81:0/2794728298 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c09fff0 con 0x7ff51c0a0a90 2024-09-10T16:34:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient: _finish_auth 0 2024-09-10T16:34:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient: _check_auth_tickets 2024-09-10T16:34:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 1 -- 172.21.15.81:0/2794728298 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff514001bc0 con 0x7ff51c0a0a90 2024-09-10T16:34:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 5 monclient: authenticate success, global_id 144335 2024-09-10T16:34:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient: dump: 2024-09-10T16:34:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.020 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 1 -- 172.21.15.81:0/2794728298 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff514001de0 con 0x7ff51c0a0a90 2024-09-10T16:34:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff520f27640 4 set_mon_vals no callback set 2024-09-10T16:34:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 1 -- 172.21.15.81:0/2794728298 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff514004f70 con 0x7ff51c0a0a90 2024-09-10T16:34:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.004+0000 7ff51959a640 10 monclient: dump: 2024-09-10T16:34:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.021 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.022 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient: shutdown 2024-09-10T16:34:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 1 -- 172.21.15.81:0/2794728298 >> v1:172.21.15.81:6790/0 conn(0x7ff51c0a0a90 legacy=0x7ff51c0a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 1 -- 172.21.15.81:0/2794728298 shutdown_connections 2024-09-10T16:34:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 1 -- 172.21.15.81:0/2794728298 >> 172.21.15.81:0/2794728298 conn(0x7ff51c0a3fd0 msgr2=0x7ff51c0a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 1 -- 172.21.15.81:0/2794728298 shutdown_connections 2024-09-10T16:34:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 1 -- 172.21.15.81:0/2794728298 wait complete. 2024-09-10T16:34:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient: build_initial_monmap 2024-09-10T16:34:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient: monmap: 2024-09-10T16:34:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:37.022 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:37.023 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:37.023 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 1 Processor -- start 2024-09-10T16:34:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 1 -- start start 2024-09-10T16:34:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient: init 2024-09-10T16:34:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient: _add_conns ranks=[8,6,1,4,5,7,3,2,0] 2024-09-10T16:34:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient(hunting): picked mon.noname-e con 0x7ff51c0a0a90 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient(hunting): picked mon.noname-d con 0x7ff51c0a35f0 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient(hunting): picked mon.noname-f con 0x7ff51c0a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff51c0984f0 con 0x7ff51c0a3a40 2024-09-10T16:34:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff51c0987d0 con 0x7ff51c0a35f0 2024-09-10T16:34:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff51c098d90 con 0x7ff51c0a0a90 2024-09-10T16:34:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:37.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient(hunting): authenticate will time out at 1244.410031s 2024-09-10T16:34:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff51a59c640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7ff51c0a0a90 0x7ff51c1bf580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:59218/0 (socket says 172.21.15.81:59218) 2024-09-10T16:34:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff51a59c640 1 -- 172.21.15.81:0/1602470104 learned_addr learned my addr 172.21.15.81:0/1602470104 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff519d9b640 1 --1- 172.21.15.81:0/1602470104 >> v1:172.21.15.81:6792/0 conn(0x7ff51c0a35f0 0x7ff51c1d2d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:52490/0 (socket says 172.21.15.81:52490) 2024-09-10T16:34:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 448817386 0 0) 0x7ff51c098d90 con 0x7ff51c0a0a90 2024-09-10T16:34:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): my global_id is 5975 2024-09-10T16:34:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff4fc003530 con 0x7ff51c0a0a90 2024-09-10T16:34:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3159244855 0 0) 0x7ff51c0987d0 con 0x7ff51c0a35f0 2024-09-10T16:34:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): my global_id is 144276 2024-09-10T16:34:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff51c098d90 con 0x7ff51c0a35f0 2024-09-10T16:34:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3627026031 0 0) 0x7ff4fc003530 con 0x7ff51c0a0a90 2024-09-10T16:34:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff51c0987d0 con 0x7ff51c0a0a90 2024-09-10T16:34:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2060033562 0 0) 0x7ff51c098d90 con 0x7ff51c0a35f0 2024-09-10T16:34:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff4fc003530 con 0x7ff51c0a35f0 2024-09-10T16:34:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2749625399 0 0) 0x7ff51c0984f0 con 0x7ff51c0a3a40 2024-09-10T16:34:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): my global_id is 6157 2024-09-10T16:34:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff51c098d90 con 0x7ff51c0a3a40 2024-09-10T16:34:37.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff514004eb0 con 0x7ff51c0a0a90 2024-09-10T16:34:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:34:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): dump: 2024-09-10T16:34:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.028 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff50c001a80 con 0x7ff51c0a35f0 2024-09-10T16:34:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient(hunting): dump: 2024-09-10T16:34:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.029 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.029 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1998288489 0 0) 0x7ff51c0987d0 con 0x7ff51c0a0a90 2024-09-10T16:34:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 >> v1:172.21.15.81:6792/0 conn(0x7ff51c0a35f0 legacy=0x7ff51c1d2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 >> v1:172.21.15.189:6789/0 conn(0x7ff51c0a3a40 legacy=0x7ff51c1d6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:34:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 monclient: found mon.e 2024-09-10T16:34:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff51c0a6bb0 con 0x7ff51c0a0a90 2024-09-10T16:34:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient: _finish_auth 0 2024-09-10T16:34:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:34:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 5 monclient: authenticate success, global_id 5975 2024-09-10T16:34:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient: _renew_subs 2024-09-10T16:34:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7ff51c074030 con 0x7ff51c0a0a90 2024-09-10T16:34:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient: _renew_subs 2024-09-10T16:34:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7ff51c09abc0 con 0x7ff51c0a0a90 2024-09-10T16:34:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7ff514001540 con 0x7ff51c0a0a90 2024-09-10T16:34:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff514001ca0 con 0x7ff51c0a0a90 2024-09-10T16:34:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff518d99640 4 set_mon_vals no callback set 2024-09-10T16:34:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff512ffd640 10 monclient: dump: 2024-09-10T16:34:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.033 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.008+0000 7ff520f27640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff5000065d0 con 0x7ff500002870 2024-09-10T16:34:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7ff5140112e0 con 0x7ff51c0a0a90 2024-09-10T16:34:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(228..228 src has 121..228) ==== 3506+0+0 (unknown 3835984861 0 0) 0x7ff51404b230 con 0x7ff51c0a0a90 2024-09-10T16:34:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2545692485 0 0) 0x7ff5000065d0 con 0x7ff500002870 2024-09-10T16:34:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 10 monclient(hunting): my global_id is 134949 2024-09-10T16:34:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff51c0987d0 con 0x7ff500002870 2024-09-10T16:34:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff51ad9d640 10 monclient: get_auth_request con 0x7ff4fc03d7b0 auth_method 0 2024-09-10T16:34:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1590181069 0 0) 0x7ff51c0987d0 con 0x7ff500002870 2024-09-10T16:34:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff5000065d0 con 0x7ff500002870 2024-09-10T16:34:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff50c001c20 con 0x7ff500002870 2024-09-10T16:34:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:34:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 10 monclient: dump: 2024-09-10T16:34:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.035 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1365551117 0 0) 0x7ff5000065d0 con 0x7ff500002870 2024-09-10T16:34:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.189:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff50000a170 con 0x7ff500002870 2024-09-10T16:34:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.3 v1:172.21.15.189:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7ff50c0057d0 con 0x7ff500002870 2024-09-10T16:34:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:37.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 >> v1:172.21.15.189:6790/0 conn(0x7ff500002870 legacy=0x7ff500004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.012+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 >> v1:172.21.15.189:6790/0 conn(0x7ff500002870 legacy=0x7ff500004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff520f27640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff520f27640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7ff500009e10 con 0x7ff5000090f0 2024-09-10T16:34:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3539820941 0 0) 0x7ff500009e10 con 0x7ff5000090f0 2024-09-10T16:34:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 10 monclient(hunting): my global_id is 134958 2024-09-10T16:34:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5000065d0 con 0x7ff5000090f0 2024-09-10T16:34:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4063610891 0 0) 0x7ff5000065d0 con 0x7ff5000090f0 2024-09-10T16:34:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7ff500009e10 con 0x7ff5000090f0 2024-09-10T16:34:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7ff50c0042b0 con 0x7ff5000090f0 2024-09-10T16:34:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:34:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 10 monclient: dump: 2024-09-10T16:34:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.038 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.039 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1582561169 0 0) 0x7ff500009e10 con 0x7ff5000090f0 2024-09-10T16:34:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 --> v1:172.21.15.189:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7ff50000c3b0 con 0x7ff5000090f0 2024-09-10T16:34:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 <== mon.3 v1:172.21.15.189:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7544 (unknown 0 0 2795609621) 0x7ff50c005980 con 0x7ff5000090f0 2024-09-10T16:34:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 >> v1:172.21.15.189:6790/0 conn(0x7ff5000090f0 legacy=0x7ff500009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff512ffd640 1 -- 172.21.15.81:0/1602470104 >> v1:172.21.15.189:6790/0 conn(0x7ff5000090f0 legacy=0x7ff500009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:37.040 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:37.041 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:37.041 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:37.041 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 146740, 2024-09-10T16:34:37.041 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:37.041 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:37.041 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:37.041 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:37.041 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:37.041 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:37.041 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:37.041 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:37.041 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:37.041 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:37.042 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:37.042 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-09-10T16:34:37.042 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:37.042 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:37.042 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:37.042 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:37.042 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:37.042 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:37.042 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:37.042 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:37.042 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:37.042 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:37.042 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:37.043 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:37.043 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:37.043 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:37.043 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:37.043 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:37.043 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:37.043 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:37.043 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:37.043 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:37.043 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:37.043 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:37.043 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:37.043 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:37.044 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:37.044 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:37.044 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:37.044 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:37.044 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.044 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:37.044 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:37.044 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:37.044 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:37.044 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:37.045 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:37.045 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:37.045 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:37.045 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:37.045 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:37.045 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:37.045 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:37.045 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:37.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:37.046 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:37.046 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:37.046 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:37.046 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:37.046 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:37.046 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:37.046 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:37.046 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:37.046 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:37.046 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:37.046 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:37.047 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:37.047 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:37.047 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:37.047 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:37.047 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:37.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.047 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:37.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.047 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:37.047 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:37.047 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.047 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.047 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.048 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:37.048 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.048 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.048 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:37.048 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:37.048 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.048 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.048 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.048 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.048 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.048 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:37.049 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:37.049 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.049 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.049 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:37.049 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.049 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.049 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.049 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:37.049 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:37.049 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.050 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.050 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.050 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:37.050 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:37.050 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.050 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.050 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.050 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:37.050 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.050 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.051 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.051 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:37.051 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:37.051 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.051 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.051 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.051 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.051 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:37.051 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:37.051 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.051 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.052 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.052 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:37.052 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.052 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.052 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.052 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.052 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:37.052 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:37.052 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.052 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.052 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.053 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:37.053 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:37.053 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.053 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.053 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.053 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:37.053 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.053 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.053 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.054 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:37.054 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:37.054 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.054 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.054 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.054 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:37.054 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:37.054 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.054 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.054 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.054 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.055 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.056 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.057 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.058 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:37.059 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.060 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:37.061 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:37.061 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.061 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:37.061 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:37.061 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:34:37.061 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.061 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.061 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:37.061 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:37.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff520f27640 1 -- 172.21.15.81:0/1602470104 >> v1:172.21.15.189:6812/1108603242 conn(0x7ff4fc03d7b0 legacy=0x7ff4fc03fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff520f27640 10 monclient: shutdown 2024-09-10T16:34:37.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff520f27640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:37.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff520f27640 1 -- 172.21.15.81:0/1602470104 >> v1:172.21.15.81:6793/0 conn(0x7ff51c0a0a90 legacy=0x7ff51c1bf580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff51ad9d640 1 -- 172.21.15.81:0/1602470104 reap_dead start 2024-09-10T16:34:37.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff51ad9d640 1 -- 172.21.15.81:0/1602470104 reap_dead start 2024-09-10T16:34:37.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff520f27640 1 -- 172.21.15.81:0/1602470104 shutdown_connections 2024-09-10T16:34:37.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff520f27640 1 -- 172.21.15.81:0/1602470104 >> 172.21.15.81:0/1602470104 conn(0x7ff51c0a3fd0 msgr2=0x7ff51c074240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:37.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff520f27640 1 -- 172.21.15.81:0/1602470104 shutdown_connections 2024-09-10T16:34:37.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.020+0000 7ff520f27640 1 -- 172.21.15.81:0/1602470104 wait complete. 2024-09-10T16:34:37.063 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:37.064 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-10T16:34:37.064 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-10T16:34:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 10 monclient: get_monmap_and_config 2024-09-10T16:34:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 10 monclient: build_initial_monmap 2024-09-10T16:34:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 10 monclient: monmap: 2024-09-10T16:34:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:37.186 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:37.187010+0000 2024-09-10T16:34:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:37.187010+0000 2024-09-10T16:34:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:37.187 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:37.187 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 1 Processor -- start 2024-09-10T16:34:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 1 -- start start 2024-09-10T16:34:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 10 monclient: init 2024-09-10T16:34:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 10 monclient: _add_conns ranks=[4,5,0,6,1,8,7,2,3] 2024-09-10T16:34:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 10 monclient(hunting): picked mon.noname-c con 0x7f0674024860 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 10 monclient(hunting): picked mon.noname-h con 0x7f06740b9240 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 10 monclient(hunting): picked mon.noname-a con 0x7f0674024c40 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f067401fee0 con 0x7f0674024c40 2024-09-10T16:34:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06740216a0 con 0x7f0674024860 2024-09-10T16:34:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0674021980 con 0x7f06740b9240 2024-09-10T16:34:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0681de8640 10 monclient(hunting): authenticate will time out at 1244.587422s 2024-09-10T16:34:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0680de6640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f0674024860 0x7f067401f0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:41792/0 (socket says 172.21.15.81:41792) 2024-09-10T16:34:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f0680de6640 1 -- 172.21.15.81:0/227759222 learned_addr learned my addr 172.21.15.81:0/227759222 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f067b7fe640 1 -- 172.21.15.81:0/227759222 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1274922185 0 0) 0x7f06740216a0 con 0x7f0674024860 2024-09-10T16:34:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f067b7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f067b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f067b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f067b7fe640 10 monclient(hunting): my global_id is 144274 2024-09-10T16:34:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f067b7fe640 1 -- 172.21.15.81:0/227759222 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f066c005740 con 0x7f0674024860 2024-09-10T16:34:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f067b7fe640 1 -- 172.21.15.81:0/227759222 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2407257678 0 0) 0x7f067401fee0 con 0x7f0674024c40 2024-09-10T16:34:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f067b7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f067b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f067b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f067b7fe640 10 monclient(hunting): my global_id is 5850 2024-09-10T16:34:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.184+0000 7f067b7fe640 1 -- 172.21.15.81:0/227759222 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06740216a0 con 0x7f0674024c40 2024-09-10T16:34:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 1 -- 172.21.15.81:0/227759222 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4142135200 0 0) 0x7f066c005740 con 0x7f0674024860 2024-09-10T16:34:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 1 -- 172.21.15.81:0/227759222 >> v1:172.21.15.189:6791/0 conn(0x7f06740b9240 legacy=0x7f067401f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 1 -- 172.21.15.81:0/227759222 >> v1:172.21.15.81:6789/0 conn(0x7f0674024c40 legacy=0x7f06740c20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:34:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 1 monclient: found mon.noname-c 2024-09-10T16:34:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:34:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 1 -- 172.21.15.81:0/227759222 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0674021c60 con 0x7f0674024860 2024-09-10T16:34:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 10 monclient: _finish_auth 0 2024-09-10T16:34:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:34:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 1 -- 172.21.15.81:0/227759222 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0670001840 con 0x7f0674024860 2024-09-10T16:34:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 5 monclient: authenticate success, global_id 144274 2024-09-10T16:34:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:34:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 10 monclient: dump: 2024-09-10T16:34:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.195 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.196 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 1 -- 172.21.15.81:0/227759222 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0670001a60 con 0x7f0674024860 2024-09-10T16:34:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 4 set_mon_vals no callback set 2024-09-10T16:34:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 1 -- 172.21.15.81:0/227759222 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0670004bf0 con 0x7f0674024860 2024-09-10T16:34:37.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067b7fe640 10 monclient: dump: 2024-09-10T16:34:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.197 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.198 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient: shutdown 2024-09-10T16:34:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 1 -- 172.21.15.81:0/227759222 >> v1:172.21.15.81:6791/0 conn(0x7f0674024860 legacy=0x7f067401f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 1 -- 172.21.15.81:0/227759222 shutdown_connections 2024-09-10T16:34:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 1 -- 172.21.15.81:0/227759222 >> 172.21.15.81:0/227759222 conn(0x7f0674007d80 msgr2=0x7f0674008190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 1 -- 172.21.15.81:0/227759222 shutdown_connections 2024-09-10T16:34:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 1 -- 172.21.15.81:0/227759222 wait complete. 2024-09-10T16:34:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient: build_initial_monmap 2024-09-10T16:34:37.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient: monmap: 2024-09-10T16:34:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:37.199 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:37.200 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 1 Processor -- start 2024-09-10T16:34:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 1 -- start start 2024-09-10T16:34:37.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient: init 2024-09-10T16:34:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient: _add_conns ranks=[8,7,3,5,4,0,2,1,6] 2024-09-10T16:34:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient(hunting): picked mon.noname-e con 0x7f0674024860 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient(hunting): picked mon.noname-i con 0x7f0674024c40 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient(hunting): picked mon.noname-g con 0x7f06740b9240 addr v1:172.21.15.189:6790/0 2024-09-10T16:34:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f067414d9e0 con 0x7f06740b9240 2024-09-10T16:34:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06740a2fd0 con 0x7f0674024c40 2024-09-10T16:34:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06740a1ae0 con 0x7f0674024860 2024-09-10T16:34:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient(hunting): authenticate will time out at 1244.590574s 2024-09-10T16:34:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0680de6640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f0674024860 0x7f067414cbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:59220/0 (socket says 172.21.15.81:59220) 2024-09-10T16:34:37.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0680de6640 1 -- 172.21.15.81:0/3364236674 learned_addr learned my addr 172.21.15.81:0/3364236674 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1389023192 0 0) 0x7f06740a1ae0 con 0x7f0674024860 2024-09-10T16:34:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): my global_id is 5984 2024-09-10T16:34:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0660003530 con 0x7f0674024860 2024-09-10T16:34:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3526741459 0 0) 0x7f06740a2fd0 con 0x7f0674024c40 2024-09-10T16:34:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): my global_id is 144286 2024-09-10T16:34:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06740a1ae0 con 0x7f0674024c40 2024-09-10T16:34:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1899036622 0 0) 0x7f0660003530 con 0x7f0674024860 2024-09-10T16:34:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f06740a2fd0 con 0x7f0674024860 2024-09-10T16:34:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0670004b30 con 0x7f0674024860 2024-09-10T16:34:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:34:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): dump: 2024-09-10T16:34:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.208 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2798999098 0 0) 0x7f067414d9e0 con 0x7f06740b9240 2024-09-10T16:34:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient(hunting): my global_id is 134967 2024-09-10T16:34:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0660003530 con 0x7f06740b9240 2024-09-10T16:34:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2202575717 0 0) 0x7f06740a2fd0 con 0x7f0674024860 2024-09-10T16:34:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 >> v1:172.21.15.189:6792/0 conn(0x7f0674024c40 legacy=0x7f067414d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 >> v1:172.21.15.189:6790/0 conn(0x7f06740b9240 legacy=0x7f0674154e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient: _finish_hunting 0 2024-09-10T16:34:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 monclient: found mon.e 2024-09-10T16:34:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06740a35a0 con 0x7f0674024860 2024-09-10T16:34:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient: _finish_auth 0 2024-09-10T16:34:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient: _check_auth_tickets 2024-09-10T16:34:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 5 monclient: authenticate success, global_id 5984 2024-09-10T16:34:37.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient: _renew_subs 2024-09-10T16:34:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f06740a4260 con 0x7f0674024860 2024-09-10T16:34:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient: _renew_subs 2024-09-10T16:34:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:34:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f0681de8640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f06740a2840 con 0x7f0674024860 2024-09-10T16:34:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0670004eb0 con 0x7f0674024860 2024-09-10T16:34:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f06700053a0 con 0x7f0674024860 2024-09-10T16:34:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f067affd640 4 set_mon_vals no callback set 2024-09-10T16:34:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.188+0000 7f06797fa640 10 monclient: dump: 2024-09-10T16:34:37.210 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.211 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.212 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f0681de8640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f0681de8640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f065c0065d0 con 0x7f065c002870 2024-09-10T16:34:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f06700018e0 con 0x7f0674024860 2024-09-10T16:34:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(229..229 src has 121..229) ==== 3898+0+0 (unknown 2865557549 0 0) 0x7f067004afc0 con 0x7f0674024860 2024-09-10T16:34:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06815e7640 10 monclient: get_auth_request con 0x7f066003d190 auth_method 0 2024-09-10T16:34:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2453927334 0 0) 0x7f065c0065d0 con 0x7f065c002870 2024-09-10T16:34:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 10 monclient(hunting): my global_id is 5891 2024-09-10T16:34:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06740a2fd0 con 0x7f065c002870 2024-09-10T16:34:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2880327226 0 0) 0x7f06740a2fd0 con 0x7f065c002870 2024-09-10T16:34:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f065c0065d0 con 0x7f065c002870 2024-09-10T16:34:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f06680019a0 con 0x7f065c002870 2024-09-10T16:34:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:34:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 10 monclient: dump: 2024-09-10T16:34:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.214 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2492115126 0 0) 0x7f065c0065d0 con 0x7f065c002870 2024-09-10T16:34:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.189:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f065c00a170 con 0x7f065c002870 2024-09-10T16:34:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0668001a30 con 0x7f065c002870 2024-09-10T16:34:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 >> v1:172.21.15.189:6791/0 conn(0x7f065c002870 legacy=0x7f065c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.192+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 >> v1:172.21.15.189:6791/0 conn(0x7f065c002870 legacy=0x7f065c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f0681de8640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f0681de8640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f065c009e10 con 0x7f065c0090f0 2024-09-10T16:34:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3282769684 0 0) 0x7f065c009e10 con 0x7f065c0090f0 2024-09-10T16:34:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 10 monclient(hunting): my global_id is 5900 2024-09-10T16:34:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f065c0065d0 con 0x7f065c0090f0 2024-09-10T16:34:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1727513264 0 0) 0x7f065c0065d0 con 0x7f065c0090f0 2024-09-10T16:34:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f065c009e10 con 0x7f065c0090f0 2024-09-10T16:34:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0668003b50 con 0x7f065c0090f0 2024-09-10T16:34:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:34:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 10 monclient: dump: 2024-09-10T16:34:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.217 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1946262051 0 0) 0x7f065c009e10 con 0x7f065c0090f0 2024-09-10T16:34:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 --> v1:172.21.15.189:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f065c00c3b0 con 0x7f065c0090f0 2024-09-10T16:34:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 2158666369) 0x7f0668005020 con 0x7f065c0090f0 2024-09-10T16:34:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 >> v1:172.21.15.189:6791/0 conn(0x7f065c0090f0 legacy=0x7f065c009560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06797fa640 1 -- 172.21.15.81:0/3364236674 >> v1:172.21.15.189:6791/0 conn(0x7f065c0090f0 legacy=0x7f065c009560 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:37.218 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 287124, 2024-09-10T16:34:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 5, 2024-09-10T16:34:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:37.219 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:37.220 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.221 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:37.222 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:37.223 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.225 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:37.227 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.228 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:37.231 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.232 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:37.235 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.236 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:34:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.237 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.238 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:37.238 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f0681de8640 1 -- 172.21.15.81:0/3364236674 >> v1:172.21.15.189:6812/1108603242 conn(0x7f066003d190 legacy=0x7f066003f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f0681de8640 10 monclient: shutdown 2024-09-10T16:34:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f0681de8640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f0681de8640 1 -- 172.21.15.81:0/3364236674 >> v1:172.21.15.81:6793/0 conn(0x7f0674024860 legacy=0x7f067414cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06815e7640 1 -- 172.21.15.81:0/3364236674 reap_dead start 2024-09-10T16:34:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f06815e7640 1 -- 172.21.15.81:0/3364236674 reap_dead start 2024-09-10T16:34:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f0681de8640 1 -- 172.21.15.81:0/3364236674 shutdown_connections 2024-09-10T16:34:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f0681de8640 1 -- 172.21.15.81:0/3364236674 >> 172.21.15.81:0/3364236674 conn(0x7f0674007d80 msgr2=0x7f067413f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f0681de8640 1 -- 172.21.15.81:0/3364236674 shutdown_connections 2024-09-10T16:34:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.200+0000 7f0681de8640 1 -- 172.21.15.81:0/3364236674 wait complete. 2024-09-10T16:34:37.240 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:37.240 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-10T16:34:37.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-10T16:34:37.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.360+0000 7f34ec361640 10 monclient: get_monmap_and_config 2024-09-10T16:34:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.360+0000 7f34ec361640 10 monclient: build_initial_monmap 2024-09-10T16:34:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.360+0000 7f34ec361640 10 monclient: monmap: 2024-09-10T16:34:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:37.365788+0000 2024-09-10T16:34:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:37.365788+0000 2024-09-10T16:34:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.366 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:37.367 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 1 Processor -- start 2024-09-10T16:34:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 1 -- start start 2024-09-10T16:34:37.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 10 monclient: init 2024-09-10T16:34:37.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 10 monclient: _add_conns ranks=[2,5,8,4,0,7,6,3,1] 2024-09-10T16:34:37.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 10 monclient(hunting): picked mon.noname-b con 0x7f34e409d440 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 10 monclient(hunting): picked mon.noname-h con 0x7f34e40a39e0 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 10 monclient(hunting): picked mon.noname-e con 0x7f34e40a0900 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e40a37a0 con 0x7f34e409d440 2024-09-10T16:34:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e4074d30 con 0x7f34e40a39e0 2024-09-10T16:34:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e409d820 con 0x7f34e40a0900 2024-09-10T16:34:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 10 monclient(hunting): authenticate will time out at 1244.765092s 2024-09-10T16:34:37.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ea8fe640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f34e40a0900 0x7f34e413e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:59228/0 (socket says 172.21.15.81:59228) 2024-09-10T16:34:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ea0fd640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f34e409d440 0x7f34e409fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:33376/0 (socket says 172.21.15.81:33376) 2024-09-10T16:34:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ea8fe640 1 -- 172.21.15.81:0/422976135 learned_addr learned my addr 172.21.15.81:0/422976135 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 1 -- 172.21.15.81:0/422976135 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2639242605 0 0) 0x7f34e409d820 con 0x7f34e40a0900 2024-09-10T16:34:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient(hunting): my global_id is 5993 2024-09-10T16:34:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 1 -- 172.21.15.81:0/422976135 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34d0005740 con 0x7f34e40a0900 2024-09-10T16:34:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 1 -- 172.21.15.81:0/422976135 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2774021681 0 0) 0x7f34e40a37a0 con 0x7f34e409d440 2024-09-10T16:34:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient(hunting): my global_id is 144344 2024-09-10T16:34:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 1 -- 172.21.15.81:0/422976135 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34e409d820 con 0x7f34e409d440 2024-09-10T16:34:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 1 -- 172.21.15.81:0/422976135 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3410578059 0 0) 0x7f34e409d820 con 0x7f34e409d440 2024-09-10T16:34:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 1 -- 172.21.15.81:0/422976135 >> v1:172.21.15.81:6793/0 conn(0x7f34e40a0900 legacy=0x7f34e413e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 1 -- 172.21.15.81:0/422976135 >> v1:172.21.15.189:6791/0 conn(0x7f34e40a39e0 legacy=0x7f34e40a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient: _finish_hunting 0 2024-09-10T16:34:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 1 monclient: found mon.noname-b 2024-09-10T16:34:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:34:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 1 -- 172.21.15.81:0/422976135 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e409e1c0 con 0x7f34e409d440 2024-09-10T16:34:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient: _finish_auth 0 2024-09-10T16:34:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient: _check_auth_tickets 2024-09-10T16:34:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 1 -- 172.21.15.81:0/422976135 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f34e0001760 con 0x7f34e409d440 2024-09-10T16:34:37.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 5 monclient: authenticate success, global_id 144344 2024-09-10T16:34:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient: dump: 2024-09-10T16:34:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.380 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.381 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 1 -- 172.21.15.81:0/422976135 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34e0001970 con 0x7f34e409d440 2024-09-10T16:34:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 1 -- 172.21.15.81:0/422976135 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f34e00047f0 con 0x7f34e409d440 2024-09-10T16:34:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 4 set_mon_vals no callback set 2024-09-10T16:34:37.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34e90fb640 10 monclient: dump: 2024-09-10T16:34:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.382 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.383 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 10 monclient: shutdown 2024-09-10T16:34:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 1 -- 172.21.15.81:0/422976135 >> v1:172.21.15.81:6790/0 conn(0x7f34e409d440 legacy=0x7f34e409fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 1 -- 172.21.15.81:0/422976135 shutdown_connections 2024-09-10T16:34:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 1 -- 172.21.15.81:0/422976135 >> 172.21.15.81:0/422976135 conn(0x7f34e40a3fd0 msgr2=0x7f34e40a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 1 -- 172.21.15.81:0/422976135 shutdown_connections 2024-09-10T16:34:37.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 1 -- 172.21.15.81:0/422976135 wait complete. 2024-09-10T16:34:37.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 10 monclient: build_initial_monmap 2024-09-10T16:34:37.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 10 monclient: monmap: 2024-09-10T16:34:37.384 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:37.384 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:37.384 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:37.384 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:37.384 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:37.384 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:37.384 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:37.384 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:37.384 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:37.384 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:37.384 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:37.385 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 1 Processor -- start 2024-09-10T16:34:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 1 -- start start 2024-09-10T16:34:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.364+0000 7f34ec361640 10 monclient: init 2024-09-10T16:34:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 10 monclient: _add_conns ranks=[8,0,6,1,7,2,3,4,5] 2024-09-10T16:34:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 10 monclient(hunting): picked mon.noname-e con 0x7f34e409d440 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 10 monclient(hunting): picked mon.noname-a con 0x7f34e40a0900 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:37.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 10 monclient(hunting): picked mon.noname-d con 0x7f34e40a39e0 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e40989e0 con 0x7f34e40a0900 2024-09-10T16:34:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e40a6c10 con 0x7f34e40a39e0 2024-09-10T16:34:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f34e40a6700 con 0x7f34e409d440 2024-09-10T16:34:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 10 monclient(hunting): authenticate will time out at 1244.768196s 2024-09-10T16:34:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ea8fe640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f34e40a39e0 0x7f34e41d6020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:52506/0 (socket says 172.21.15.81:52506) 2024-09-10T16:34:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ea8fe640 1 -- 172.21.15.81:0/2601529669 learned_addr learned my addr 172.21.15.81:0/2601529669 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2274775984 0 0) 0x7f34e40a6c10 con 0x7f34e40a39e0 2024-09-10T16:34:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): my global_id is 144285 2024-09-10T16:34:37.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34c8003530 con 0x7f34e40a39e0 2024-09-10T16:34:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3755838468 0 0) 0x7f34e40989e0 con 0x7f34e40a0900 2024-09-10T16:34:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): my global_id is 5859 2024-09-10T16:34:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34e40a6c10 con 0x7f34e40a0900 2024-09-10T16:34:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2388957890 0 0) 0x7f34e40a6700 con 0x7f34e409d440 2024-09-10T16:34:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): my global_id is 6002 2024-09-10T16:34:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34e40989e0 con 0x7f34e409d440 2024-09-10T16:34:37.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1427083211 0 0) 0x7f34c8003530 con 0x7f34e40a39e0 2024-09-10T16:34:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34e40a6700 con 0x7f34e40a39e0 2024-09-10T16:34:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 941384908 0 0) 0x7f34e40a6c10 con 0x7f34e40a0900 2024-09-10T16:34:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34c8003530 con 0x7f34e40a0900 2024-09-10T16:34:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f34dc0019e0 con 0x7f34e40a39e0 2024-09-10T16:34:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:34:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): dump: 2024-09-10T16:34:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.388 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.389 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.389 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.389 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.389 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.389 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.389 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.389 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.389 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.389 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:37.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f34d4001940 con 0x7f34e40a0900 2024-09-10T16:34:37.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:37.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:34:37.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): dump: 2024-09-10T16:34:37.390 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.390 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.390 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.390 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.390 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.390 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.390 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.390 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.390 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.390 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.390 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.390 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.390 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.391 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1988348395 0 0) 0x7f34e40989e0 con 0x7f34e409d440 2024-09-10T16:34:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34e40a6c10 con 0x7f34e409d440 2024-09-10T16:34:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f34e0001660 con 0x7f34e409d440 2024-09-10T16:34:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): dump: 2024-09-10T16:34:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.391 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.392 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2477579903 0 0) 0x7f34e40a6700 con 0x7f34e40a39e0 2024-09-10T16:34:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 >> v1:172.21.15.81:6793/0 conn(0x7f34e409d440 legacy=0x7f34e409a1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 >> v1:172.21.15.81:6789/0 conn(0x7f34e40a0900 legacy=0x7f34e41d28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient: _finish_hunting 0 2024-09-10T16:34:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 monclient: found mon.d 2024-09-10T16:34:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e4098700 con 0x7f34e40a39e0 2024-09-10T16:34:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient: _finish_auth 0 2024-09-10T16:34:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient: _check_auth_tickets 2024-09-10T16:34:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 5 monclient: authenticate success, global_id 144285 2024-09-10T16:34:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 10 monclient: _renew_subs 2024-09-10T16:34:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f34e4097240 con 0x7f34e40a39e0 2024-09-10T16:34:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 10 monclient: _renew_subs 2024-09-10T16:34:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f34e41cd830 con 0x7f34e40a39e0 2024-09-10T16:34:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f34dc004e20 con 0x7f34e40a39e0 2024-09-10T16:34:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f34dc005310 con 0x7f34e40a39e0 2024-09-10T16:34:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34e88fa640 4 set_mon_vals no callback set 2024-09-10T16:34:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient: dump: 2024-09-10T16:34:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.394 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.395 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.395 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.395 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.395 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.395 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.395 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.395 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.395 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.395 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.395 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.395 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:37.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34ec361640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f34cc0065d0 con 0x7f34cc002870 2024-09-10T16:34:37.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f34dc011220 con 0x7f34e40a39e0 2024-09-10T16:34:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(229..229 src has 121..229) ==== 3898+0+0 (unknown 2865557549 0 0) 0x7f34dc04b2d0 con 0x7f34e40a39e0 2024-09-10T16:34:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34e98fc640 10 monclient: get_auth_request con 0x7f34c803d9c0 auth_method 0 2024-09-10T16:34:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2915225009 0 0) 0x7f34cc0065d0 con 0x7f34cc002870 2024-09-10T16:34:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient(hunting): my global_id is 144295 2024-09-10T16:34:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34e40a6700 con 0x7f34cc002870 2024-09-10T16:34:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3710570480 0 0) 0x7f34e40a6700 con 0x7f34cc002870 2024-09-10T16:34:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34cc0065d0 con 0x7f34cc002870 2024-09-10T16:34:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f34e0001880 con 0x7f34cc002870 2024-09-10T16:34:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:34:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 10 monclient: dump: 2024-09-10T16:34:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.397 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.398 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1861120390 0 0) 0x7f34cc0065d0 con 0x7f34cc002870 2024-09-10T16:34:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.368+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.189:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f34cc00a170 con 0x7f34cc002870 2024-09-10T16:34:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.372+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.7 v1:172.21.15.189:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f34e0007480 con 0x7f34cc002870 2024-09-10T16:34:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.372+0000 7f34daffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.372+0000 7f34daffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.372+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 >> v1:172.21.15.189:6792/0 conn(0x7f34cc002870 legacy=0x7f34cc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.372+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 >> v1:172.21.15.189:6792/0 conn(0x7f34cc002870 legacy=0x7f34cc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:37.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.376+0000 7f34ec361640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:37.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.376+0000 7f34ec361640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f34cc009e80 con 0x7f34cc009140 2024-09-10T16:34:37.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.376+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3882931600 0 0) 0x7f34cc009e80 con 0x7f34cc009140 2024-09-10T16:34:37.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.376+0000 7f34daffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.376+0000 7f34daffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.376+0000 7f34daffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.376+0000 7f34daffd640 10 monclient(hunting): my global_id is 144304 2024-09-10T16:34:37.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.376+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f34cc0065d0 con 0x7f34cc009140 2024-09-10T16:34:37.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.376+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1362820666 0 0) 0x7f34cc0065d0 con 0x7f34cc009140 2024-09-10T16:34:37.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f34cc009e80 con 0x7f34cc009140 2024-09-10T16:34:37.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f34e00055b0 con 0x7f34cc009140 2024-09-10T16:34:37.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34daffd640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:34:37.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34daffd640 10 monclient: dump: 2024-09-10T16:34:37.401 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.401 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.401 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.401 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.401 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.401 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.401 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.401 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.401 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.401 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.401 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.401 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.401 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.402 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3572465936 0 0) 0x7f34cc009e80 con 0x7f34cc009140 2024-09-10T16:34:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 --> v1:172.21.15.189:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f34cc00c420 con 0x7f34cc009140 2024-09-10T16:34:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 <== mon.7 v1:172.21.15.189:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 2501803972) 0x7f34e0006ac0 con 0x7f34cc009140 2024-09-10T16:34:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34daffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34daffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 >> v1:172.21.15.189:6792/0 conn(0x7f34cc009140 legacy=0x7f34cc0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34daffd640 1 -- 172.21.15.81:0/2601529669 >> v1:172.21.15.189:6792/0 conn(0x7f34cc009140 legacy=0x7f34cc0095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:37.403 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:37.403 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:37.403 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:37.403 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:37.403 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 36, 2024-09-10T16:34:37.403 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 20207, 2024-09-10T16:34:37.403 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:37.403 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:37.403 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:34:37.403 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:37.403 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:34:37.403 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:37.404 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:34:37.404 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:37.404 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:34:37.404 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:37.404 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:37.404 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 5, 2024-09-10T16:34:37.404 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:37.404 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:37.404 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:37.404 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:37.404 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:37.404 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:37.404 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:37.404 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:37.405 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:37.405 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:37.405 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:37.405 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:37.405 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:37.405 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:37.405 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:37.405 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:37.405 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:37.405 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:37.405 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:37.405 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:37.405 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:37.406 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:37.406 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:37.406 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:37.406 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:37.406 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:37.406 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:37.406 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:37.406 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.406 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.406 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:37.406 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:37.406 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:37.406 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:37.407 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:37.407 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:37.407 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:37.407 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:37.407 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:37.407 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:37.407 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:37.407 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:37.407 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:37.407 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:37.407 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:37.407 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:37.407 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:37.408 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:37.408 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:37.408 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:37.408 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:37.408 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:37.408 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:37.408 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:37.408 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:37.408 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:37.408 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:37.408 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:37.408 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:37.408 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:37.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.409 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:37.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.409 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:37.409 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:37.409 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.409 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.409 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.409 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.409 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:37.409 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.409 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:37.410 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:37.410 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.410 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.410 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.410 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.410 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:37.410 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:37.410 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.410 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:37.411 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.411 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.411 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.411 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:37.411 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:37.411 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.411 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.411 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.411 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.411 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:37.412 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:37.412 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.412 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:37.412 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.412 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.412 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:37.412 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:37.412 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.412 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.413 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.413 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:37.413 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:37.413 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.413 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:37.413 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.413 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:37.414 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:37.414 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.414 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.414 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.414 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:37.414 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:37.414 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.414 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.414 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:37.415 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:37.416 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:37.416 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.416 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.416 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.416 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:37.416 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:37.416 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.416 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.416 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.417 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:37.417 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:37.417 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.417 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.417 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.417 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:37.417 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.417 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:37.418 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:37.418 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.418 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.418 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.418 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:37.418 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:37.418 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.418 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:37.419 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:37.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:37.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.420 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:37.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:37.420 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:37.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.420 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.420 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:37.420 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:37.420 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:37.420 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:37.420 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:37.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.421 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.421 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:37.421 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:37.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.421 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:37.421 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:37.421 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:37.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.421 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:37.421 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:37.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:37.421 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:37.421 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:37.422 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:34:37.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:37.422 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:37.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:37.422 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:37.422 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34ec361640 1 -- 172.21.15.81:0/2601529669 >> v1:172.21.15.189:6812/1108603242 conn(0x7f34c803d9c0 legacy=0x7f34c803fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34ec361640 10 monclient: shutdown 2024-09-10T16:34:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34ec361640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34ec361640 1 -- 172.21.15.81:0/2601529669 >> v1:172.21.15.81:6792/0 conn(0x7f34e40a39e0 legacy=0x7f34e41d6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34ea8fe640 1 -- 172.21.15.81:0/2601529669 reap_dead start 2024-09-10T16:34:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34ea8fe640 1 -- 172.21.15.81:0/2601529669 reap_dead start 2024-09-10T16:34:37.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34ec361640 1 -- 172.21.15.81:0/2601529669 shutdown_connections 2024-09-10T16:34:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34ec361640 1 -- 172.21.15.81:0/2601529669 >> 172.21.15.81:0/2601529669 conn(0x7f34e40a3fd0 msgr2=0x7f34e40a53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34ec361640 1 -- 172.21.15.81:0/2601529669 shutdown_connections 2024-09-10T16:34:37.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.380+0000 7f34ec361640 1 -- 172.21.15.81:0/2601529669 wait complete. 2024-09-10T16:34:37.424 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:34:37.424 INFO:tasks.mon_thrash.mon_thrasher:monitors to thrash: ['f', 'i', 'g', 'h'] 2024-09-10T16:34:37.424 INFO:tasks.mon_thrash.mon_thrasher:monitors to freeze: [] 2024-09-10T16:34:37.424 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.f 2024-09-10T16:34:37.425 INFO:tasks.mon_thrash.mon_thrasher:killing mon.f 2024-09-10T16:34:37.425 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-09-10T16:34:37.425 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:34:37.445 INFO:tasks.ceph.mon.f:Stopped 2024-09-10T16:34:37.445 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.i 2024-09-10T16:34:37.445 INFO:tasks.mon_thrash.mon_thrasher:killing mon.i 2024-09-10T16:34:37.445 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-09-10T16:34:37.445 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:34:37.503 INFO:tasks.ceph.mon.i:Stopped 2024-09-10T16:34:37.503 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.g 2024-09-10T16:34:37.503 INFO:tasks.mon_thrash.mon_thrasher:killing mon.g 2024-09-10T16:34:37.503 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-09-10T16:34:37.503 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:34:37.568 INFO:tasks.ceph.mon.g:Stopped 2024-09-10T16:34:37.568 INFO:tasks.mon_thrash.mon_thrasher:thrashing mon.h 2024-09-10T16:34:37.568 INFO:tasks.mon_thrash.mon_thrasher:killing mon.h 2024-09-10T16:34:37.568 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2024-09-10T16:34:37.568 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:34:37.635 INFO:tasks.ceph.mon.h:Stopped 2024-09-10T16:34:37.635 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 5 2024-09-10T16:34:37.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T16:34:37.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 10 monclient: get_monmap_and_config 2024-09-10T16:34:37.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 10 monclient: build_initial_monmap 2024-09-10T16:34:37.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 10 monclient: monmap: 2024-09-10T16:34:37.766 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:37.766 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.766 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:37.766666+0000 2024-09-10T16:34:37.766 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:37.766666+0000 2024-09-10T16:34:37.766 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:37.766 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:37.767 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:37.767 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 1 Processor -- start 2024-09-10T16:34:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 1 -- start start 2024-09-10T16:34:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 10 monclient: init 2024-09-10T16:34:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 10 monclient: _add_conns ranks=[4,3,5,2,6,0,8,1,7] 2024-09-10T16:34:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 10 monclient(hunting): picked mon.noname-c con 0x7fbc0406d270 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:37.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 10 monclient(hunting): picked mon.noname-g con 0x7fbc040a3d60 addr v1:172.21.15.189:6790/0 2024-09-10T16:34:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 10 monclient(hunting): picked mon.noname-h con 0x7fbc040a41a0 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc040a52e0 con 0x7fbc040a3d60 2024-09-10T16:34:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc0409fe30 con 0x7fbc0406d270 2024-09-10T16:34:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc040a5520 con 0x7fbc040a41a0 2024-09-10T16:34:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 10 monclient(hunting): authenticate will time out at 1245.166135s 2024-09-10T16:34:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc08f52640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fbc0406d270 0x7fbc040a3650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:41794/0 (socket says 172.21.15.81:41794) 2024-09-10T16:34:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc08f52640 1 -- 172.21.15.81:0/449928614 learned_addr learned my addr 172.21.15.81:0/449928614 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc09753640 1 -- 172.21.15.81:0/449928614 >> v1:172.21.15.189:6791/0 conn(0x7fbc040a41a0 legacy=0x7fbc0413eb70 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc03fff640 1 -- 172.21.15.81:0/449928614 >> v1:172.21.15.189:6790/0 conn(0x7fbc040a3d60 legacy=0x7fbc0413b440 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:34:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 1 -- 172.21.15.81:0/449928614 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 762575436 0 0) 0x7fbc0409fe30 con 0x7fbc0406d270 2024-09-10T16:34:37.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient(hunting): my global_id is 144283 2024-09-10T16:34:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 1 -- 172.21.15.81:0/449928614 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbec003530 con 0x7fbc0406d270 2024-09-10T16:34:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 1 -- 172.21.15.81:0/449928614 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 724751552 0 0) 0x7fbbec003530 con 0x7fbc0406d270 2024-09-10T16:34:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 1 -- 172.21.15.81:0/449928614 >> v1:172.21.15.189:6791/0 conn(0x7fbc040a41a0 legacy=0x7fbc0413eb70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:34:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 1 -- 172.21.15.81:0/449928614 >> v1:172.21.15.189:6790/0 conn(0x7fbc040a3d60 legacy=0x7fbc0413b440 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:34:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient: _finish_hunting 0 2024-09-10T16:34:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 1 monclient: found mon.noname-c 2024-09-10T16:34:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:34:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 1 -- 172.21.15.81:0/449928614 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc0409ed30 con 0x7fbc0406d270 2024-09-10T16:34:37.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient: _finish_auth 0 2024-09-10T16:34:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient: _check_auth_tickets 2024-09-10T16:34:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 5 monclient: authenticate success, global_id 144283 2024-09-10T16:34:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 1 -- 172.21.15.81:0/449928614 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fbbfc001bc0 con 0x7fbc0406d270 2024-09-10T16:34:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:34:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient: dump: 2024-09-10T16:34:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.774 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.775 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 1 -- 172.21.15.81:0/449928614 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbbfc001de0 con 0x7fbc0406d270 2024-09-10T16:34:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:37.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 4 set_mon_vals no callback set 2024-09-10T16:34:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 1 -- 172.21.15.81:0/449928614 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fbbfc004f70 con 0x7fbc0406d270 2024-09-10T16:34:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc037fe640 10 monclient: dump: 2024-09-10T16:34:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:37.776 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:37.777 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:37.777 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:37.777 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:37.777 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:37.777 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:37.777 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:37.777 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:37.777 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 10 monclient: shutdown 2024-09-10T16:34:37.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:37.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/449928614 >> v1:172.21.15.81:6791/0 conn(0x7fbc0406d270 legacy=0x7fbc040a3650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:37.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/449928614 shutdown_connections 2024-09-10T16:34:37.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/449928614 >> 172.21.15.81:0/449928614 conn(0x7fbc040a8240 msgr2=0x7fbc040a4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/449928614 shutdown_connections 2024-09-10T16:34:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.764+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/449928614 wait complete. 2024-09-10T16:34:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 10 monclient: build_initial_monmap 2024-09-10T16:34:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 10 monclient: monmap: 2024-09-10T16:34:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:37.778 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:37.779 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 1 Processor -- start 2024-09-10T16:34:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 1 -- start start 2024-09-10T16:34:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 10 monclient: init 2024-09-10T16:34:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 10 monclient: _add_conns ranks=[3,1,5,0,7,6,8,4,2] 2024-09-10T16:34:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 10 monclient(hunting): picked mon.noname-g con 0x7fbc0406d270 addr v1:172.21.15.189:6790/0 2024-09-10T16:34:37.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 10 monclient(hunting): picked mon.noname-f con 0x7fbc040a3d60 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 10 monclient(hunting): picked mon.noname-h con 0x7fbc040a41a0 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc041a93e0 con 0x7fbc040a3d60 2024-09-10T16:34:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc041a8570 con 0x7fbc0406d270 2024-09-10T16:34:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc041a7080 con 0x7fbc040a41a0 2024-09-10T16:34:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc0b1b6640 10 monclient(hunting): authenticate will time out at 1245.169122s 2024-09-10T16:34:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc09753640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7fbc040a41a0 legacy=0x7fbc041d37f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc08f52640 1 -- >> v1:172.21.15.189:6790/0 conn(0x7fbc0406d270 legacy=0x7fbc041a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:34:37.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.768+0000 7fbc03fff640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fbc040a3d60 legacy=0x7fbc041a5e70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6789/0 2024-09-10T16:34:37.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.972+0000 7fbc08f52640 1 -- >> v1:172.21.15.189:6790/0 conn(0x7fbc0406d270 legacy=0x7fbc041a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:34:37.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.972+0000 7fbc09753640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7fbc040a41a0 legacy=0x7fbc041d37f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:37.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:37.972+0000 7fbc03fff640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fbc040a3d60 legacy=0x7fbc041a5e70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6789/0 2024-09-10T16:34:38.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:38.376+0000 7fbc03fff640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fbc040a3d60 legacy=0x7fbc041a5e70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6789/0 2024-09-10T16:34:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:38.376+0000 7fbc09753640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7fbc040a41a0 legacy=0x7fbc041d37f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:38.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:38.376+0000 7fbc08f52640 1 -- >> v1:172.21.15.189:6790/0 conn(0x7fbc0406d270 legacy=0x7fbc041a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:34:39.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:39.180+0000 7fbc09753640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7fbc040a41a0 legacy=0x7fbc041d37f0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:39.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:39.180+0000 7fbc03fff640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fbc040a3d60 legacy=0x7fbc041a5e70 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6789/0 2024-09-10T16:34:39.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:39.180+0000 7fbc08f52640 1 -- >> v1:172.21.15.189:6790/0 conn(0x7fbc0406d270 legacy=0x7fbc041a5760 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:34:40.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 10 monclient(hunting): tick 2024-09-10T16:34:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 10 monclient(hunting): _check_auth_tickets 2024-09-10T16:34:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 1 monclient(hunting): continuing hunt 2024-09-10T16:34:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 10 monclient(hunting): _reopen_session rank -1 2024-09-10T16:34:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7fbc040a41a0 legacy=0x7fbc041d37f0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 1 -- >> v1:172.21.15.189:6790/0 conn(0x7fbc0406d270 legacy=0x7fbc041a5760 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7fbc040a3d60 legacy=0x7fbc041a5e70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 10 monclient: _add_conns ranks=[0,7,4,2,8,6] 2024-09-10T16:34:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 10 monclient(hunting): picked mon.noname-a con 0x7fbbe4003790 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 10 monclient(hunting): picked mon.noname-i con 0x7fbbe4007420 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 10 monclient(hunting): picked mon.noname-c con 0x7fbbe400b1b0 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:40.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc041a6580 con 0x7fbbe4003790 2024-09-10T16:34:40.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc041a93e0 con 0x7fbbe400b1b0 2024-09-10T16:34:40.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc041a8570 con 0x7fbbe4007420 2024-09-10T16:34:40.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbbebfff640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:40.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc03fff640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7fbbe4007420 legacy=0x7fbbe40098e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:34:40.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc08f52640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fbbe4003790 0x7fbbe4005be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:53286/0 (socket says 172.21.15.81:53286) 2024-09-10T16:34:40.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc08f52640 1 -- 172.21.15.81:0/1123918967 learned_addr learned my addr 172.21.15.81:0/1123918967 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:40.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1738821986 0 0) 0x7fbc041a6580 con 0x7fbbe4003790 2024-09-10T16:34:40.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:40.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:40.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:40.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 10 monclient(hunting): my global_id is 5868 2024-09-10T16:34:40.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbbf0003530 con 0x7fbbe4003790 2024-09-10T16:34:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 747704562 0 0) 0x7fbbf0003530 con 0x7fbbe4003790 2024-09-10T16:34:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbc041a6580 con 0x7fbbe4003790 2024-09-10T16:34:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fbbfc002050 con 0x7fbbe4003790 2024-09-10T16:34:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:40.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:34:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 10 monclient(hunting): dump: 2024-09-10T16:34:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:40.777 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:40.778 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:40.779 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1720217800 0 0) 0x7fbc041a6580 con 0x7fbbe4003790 2024-09-10T16:34:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 >> v1:172.21.15.189:6792/0 conn(0x7fbbe4007420 legacy=0x7fbbe40098e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 >> v1:172.21.15.81:6791/0 conn(0x7fbbe400b1b0 legacy=0x7fbbe400d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:40.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 10 monclient: _finish_hunting 0 2024-09-10T16:34:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 1 monclient: found mon.a 2024-09-10T16:34:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:34:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc041a7080 con 0x7fbbe4003790 2024-09-10T16:34:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc09753640 1 -- 172.21.15.81:0/1123918967 reap_dead start 2024-09-10T16:34:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 10 monclient: _finish_auth 0 2024-09-10T16:34:40.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 10 monclient: _check_auth_tickets 2024-09-10T16:34:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc017fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc0b1b6640 5 monclient: authenticate success, global_id 5868 2024-09-10T16:34:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc0b1b6640 10 monclient: _renew_subs 2024-09-10T16:34:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc0b1b6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:34:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/1123918967 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbc041a8ba0 con 0x7fbbe4003790 2024-09-10T16:34:40.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc0b1b6640 10 monclient: _renew_subs 2024-09-10T16:34:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc0b1b6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:34:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.768+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/1123918967 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fbc041a7e40 con 0x7fbbe4003790 2024-09-10T16:34:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.772+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbbfc001de0 con 0x7fbbe4003790 2024-09-10T16:34:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.772+0000 7fbc017fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.772+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fbbfc005560 con 0x7fbbe4003790 2024-09-10T16:34:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.772+0000 7fbc017fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:40.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.772+0000 7fbc02ffd640 4 set_mon_vals no callback set 2024-09-10T16:34:40.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.772+0000 7fbc017fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:34:40.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.772+0000 7fbc017fa640 10 monclient: dump: 2024-09-10T16:34:40.783 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:40.783 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:40.784 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:40.784 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:40.784 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:40.784 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:40.784 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:40.784 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:40.785 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:40.785 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:40.785 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:40.785 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:40.785 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:40.785 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:40.786 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:40.786 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:40.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.772+0000 7fbc0b1b6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:40.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.772+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fbbfc011470 con 0x7fbbe4003790 2024-09-10T16:34:40.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.772+0000 7fbc0b1b6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:40.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.772+0000 7fbc0b1b6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:34:40.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.772+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/1123918967 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbdc005090 con 0x7fbbe4003790 2024-09-10T16:34:40.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.772+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(229..229 src has 121..229) ==== 3898+0+0 (unknown 2865557549 0 0) 0x7fbbfc04b330 con 0x7fbbe4003790 2024-09-10T16:34:40.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.772+0000 7fbc03fff640 10 monclient: get_auth_request con 0x7fbbf003cee0 auth_method 0 2024-09-10T16:34:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.780+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7fbc041a8ba0 con 0x7fbbe4003790 2024-09-10T16:34:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.780+0000 7fbc017fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:40.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:40.780+0000 7fbc017fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:41.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.008+0000 7fbc0b1b6640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-10T16:34:41.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.008+0000 7fbc0b1b6640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-10T16:34:41.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.008+0000 7fbc0b1b6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:34:41.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.008+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/1123918967 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7fbbdc005380 con 0x7fbbe4003790 2024-09-10T16:34:41.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.008+0000 7fbc017fa640 1 -- 172.21.15.81:0/1123918967 <== mon.0 v1:172.21.15.81:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 2387013356) 0x7fbbfc0170d0 con 0x7fbbe4003790 2024-09-10T16:34:41.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.008+0000 7fbc017fa640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-10T16:34:41.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.008+0000 7fbc017fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:41.012 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":36,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":8,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","modified":"2024-09-10T16:29:22.909160Z","created":"2024-09-10T16:29:22.909160Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6790","nonce":0}]},"addr":"172.21.15.189:6790/0","public_addr":"172.21.15.189:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6791","nonce":0}]},"addr":"172.21.15.81:6791/0","public_addr":"172.21.15.81:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6791","nonce":0}]},"addr":"172.21.15.189:6791/0","public_addr":"172.21.15.189:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6792","nonce":0}]},"addr":"172.21.15.81:6792/0","public_addr":"172.21.15.81:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6792","nonce":0}]},"addr":"172.21.15.189:6792/0","public_addr":"172.21.15.189:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6793","nonce":0}]},"addr":"172.21.15.81:6793/0","public_addr":"172.21.15.81:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T16:34:41.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.012+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/1123918967 >> v1:172.21.15.189:6812/1108603242 conn(0x7fbbf003cee0 legacy=0x7fbbf003f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:41.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.012+0000 7fbc0b1b6640 10 monclient: shutdown 2024-09-10T16:34:41.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.012+0000 7fbc0b1b6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:41.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.012+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/1123918967 >> v1:172.21.15.81:6789/0 conn(0x7fbbe4003790 legacy=0x7fbbe4005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:41.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.012+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/1123918967 shutdown_connections 2024-09-10T16:34:41.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.012+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/1123918967 >> 172.21.15.81:0/1123918967 conn(0x7fbc040a8240 msgr2=0x7fbc04073940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:41.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.012+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/1123918967 shutdown_connections 2024-09-10T16:34:41.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:41.012+0000 7fbc0b1b6640 1 -- 172.21.15.81:0/1123918967 wait complete. 2024-09-10T16:34:44.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T16:34:44.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 10 monclient: get_monmap_and_config 2024-09-10T16:34:44.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 10 monclient: build_initial_monmap 2024-09-10T16:34:44.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 10 monclient: monmap: 2024-09-10T16:34:44.159 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:44.159 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:44.159 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:44.159671+0000 2024-09-10T16:34:44.159 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:44.159671+0000 2024-09-10T16:34:44.159 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:44.159 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:44.160 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:44.160 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 1 Processor -- start 2024-09-10T16:34:44.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 1 -- start start 2024-09-10T16:34:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 10 monclient: init 2024-09-10T16:34:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 10 monclient: _add_conns ranks=[6,5,0,1,2,7,4,8,3] 2024-09-10T16:34:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 10 monclient(hunting): picked mon.noname-d con 0x7f43fc09d440 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 10 monclient(hunting): picked mon.noname-h con 0x7f43fc0a39e0 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 10 monclient(hunting): picked mon.noname-a con 0x7f43fc0a0900 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc0a37a0 con 0x7f43fc0a0900 2024-09-10T16:34:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc074d30 con 0x7f43fc0a39e0 2024-09-10T16:34:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc09d820 con 0x7f43fc09d440 2024-09-10T16:34:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f440326a640 10 monclient(hunting): authenticate will time out at 1251.559131s 2024-09-10T16:34:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f4401807640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f43fc0a0900 0x7f43fc13e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42642/0 (socket says 172.21.15.81:42642) 2024-09-10T16:34:44.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f4400805640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7f43fc0a39e0 legacy=0x7f43fc0a01f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f4401006640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f43fc09d440 0x7f43fc09fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:35038/0 (socket says 172.21.15.81:35038) 2024-09-10T16:34:44.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.156+0000 7f4401807640 1 -- 172.21.15.81:0/1646756276 learned_addr learned my addr 172.21.15.81:0/1646756276 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:44.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.360+0000 7f4400805640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6791/0 conn(0x7f43fc0a39e0 legacy=0x7f43fc0a01f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:44.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:44.764+0000 7f4400805640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6791/0 conn(0x7f43fc0a39e0 legacy=0x7f43fc0a01f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:45.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:45.568+0000 7f4400805640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6791/0 conn(0x7f43fc0a39e0 legacy=0x7f43fc0a01f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:47.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 10 monclient(hunting): tick 2024-09-10T16:34:47.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 10 monclient(hunting): _check_auth_tickets 2024-09-10T16:34:47.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 1 monclient(hunting): continuing hunt 2024-09-10T16:34:47.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 10 monclient(hunting): _reopen_session rank -1 2024-09-10T16:34:47.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.81:6792/0 conn(0x7f43fc09d440 legacy=0x7f43fc09fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:47.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6791/0 conn(0x7f43fc0a39e0 legacy=0x7f43fc0a01f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:34:47.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.81:6789/0 conn(0x7f43fc0a0900 legacy=0x7f43fc13e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:47.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 10 monclient: _add_conns ranks=[3,7,1,2,4,8] 2024-09-10T16:34:47.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 10 monclient(hunting): picked mon.noname-g con 0x7f43e80059e0 addr v1:172.21.15.189:6790/0 2024-09-10T16:34:47.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 10 monclient(hunting): picked mon.noname-i con 0x7f43e80095d0 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:47.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 10 monclient(hunting): picked mon.noname-f con 0x7f43e800d340 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:47.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 1 -- 172.21.15.81:0/1646756276 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc09e1c0 con 0x7f43e800d340 2024-09-10T16:34:47.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 1 -- 172.21.15.81:0/1646756276 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc074d30 con 0x7f43e80059e0 2024-09-10T16:34:47.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 1 -- 172.21.15.81:0/1646756276 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e8013220 con 0x7f43e80095d0 2024-09-10T16:34:47.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f43faffd640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:47.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f4401006640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6790/0 conn(0x7f43e80059e0 legacy=0x7f43e8007e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:34:47.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f4401807640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6789/0 conn(0x7f43e800d340 legacy=0x7f43e800f800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-09-10T16:34:47.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.156+0000 7f4400805640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6792/0 conn(0x7f43e80095d0 legacy=0x7f43e800ba90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:34:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.360+0000 7f4401807640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6789/0 conn(0x7f43e800d340 legacy=0x7f43e800f800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-09-10T16:34:47.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.360+0000 7f4400805640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6792/0 conn(0x7f43e80095d0 legacy=0x7f43e800ba90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:34:47.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.360+0000 7f4401006640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6790/0 conn(0x7f43e80059e0 legacy=0x7f43e8007e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:34:47.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.764+0000 7f4401807640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6789/0 conn(0x7f43e800d340 legacy=0x7f43e800f800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-09-10T16:34:47.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.764+0000 7f4401006640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6790/0 conn(0x7f43e80059e0 legacy=0x7f43e8007e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:34:47.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:47.764+0000 7f4400805640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6792/0 conn(0x7f43e80095d0 legacy=0x7f43e800ba90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:34:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:48.568+0000 7f4401807640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6789/0 conn(0x7f43e800d340 legacy=0x7f43e800f800 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-09-10T16:34:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:48.568+0000 7f4401006640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6790/0 conn(0x7f43e80059e0 legacy=0x7f43e8007e30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:34:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:48.568+0000 7f4400805640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6792/0 conn(0x7f43e80095d0 legacy=0x7f43e800ba90 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:34:50.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 10 monclient(hunting): tick 2024-09-10T16:34:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 10 monclient(hunting): _check_auth_tickets 2024-09-10T16:34:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 1 monclient(hunting): continuing hunt 2024-09-10T16:34:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 10 monclient(hunting): _reopen_session rank -1 2024-09-10T16:34:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6792/0 conn(0x7f43e80095d0 legacy=0x7f43e800ba90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:34:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6790/0 conn(0x7f43e80059e0 legacy=0x7f43e8007e30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:34:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.189:6789/0 conn(0x7f43e800d340 legacy=0x7f43e800f800 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:34:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 10 monclient: _add_conns ranks=[4,2,8] 2024-09-10T16:34:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f4401807640 1 -- 172.21.15.81:0/1646756276 reap_dead start 2024-09-10T16:34:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 10 monclient(hunting): picked mon.noname-c con 0x7f43e8012230 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f4401807640 1 -- 172.21.15.81:0/1646756276 reap_dead start 2024-09-10T16:34:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 10 monclient(hunting): picked mon.noname-b con 0x7f43e800c240 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 10 monclient(hunting): picked mon.noname-e con 0x7f43e800c6c0 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 1 -- 172.21.15.81:0/1646756276 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43e80144c0 con 0x7f43e800c240 2024-09-10T16:34:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 1 -- 172.21.15.81:0/1646756276 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc09e1c0 con 0x7f43e8012230 2024-09-10T16:34:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 1 -- 172.21.15.81:0/1646756276 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc074d30 con 0x7f43e800c6c0 2024-09-10T16:34:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:50.160+0000 7f43faffd640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:52.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.304+0000 7f43fbfff640 1 -- 172.21.15.81:0/1646756276 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3623603657 0 0) 0x7f43fc09e1c0 con 0x7f43e8012230 2024-09-10T16:34:52.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.308+0000 7f43fbfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:52.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.308+0000 7f43fbfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:52.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.308+0000 7f43fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:52.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.308+0000 7f43fbfff640 10 monclient(hunting): my global_id is 144292 2024-09-10T16:34:52.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.308+0000 7f43fbfff640 1 -- 172.21.15.81:0/1646756276 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43e4003530 con 0x7f43e8012230 2024-09-10T16:34:52.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.316+0000 7f43fbfff640 1 -- 172.21.15.81:0/1646756276 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2267580811 0 0) 0x7f43fc074d30 con 0x7f43e800c6c0 2024-09-10T16:34:52.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.316+0000 7f43fbfff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:52.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.316+0000 7f43fbfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:52.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.316+0000 7f43fbfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:52.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.316+0000 7f43fbfff640 10 monclient(hunting): my global_id is 6011 2024-09-10T16:34:52.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.316+0000 7f43fbfff640 1 -- 172.21.15.81:0/1646756276 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43fc09e1c0 con 0x7f43e800c6c0 2024-09-10T16:34:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 1 -- 172.21.15.81:0/1646756276 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2604069223 0 0) 0x7f43fc09e1c0 con 0x7f43e800c6c0 2024-09-10T16:34:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.81:6791/0 conn(0x7f43e8012230 legacy=0x7f43e8012610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.81:6790/0 conn(0x7f43e800c240 legacy=0x7f43e8007e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 10 monclient: _finish_hunting 0 2024-09-10T16:34:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 1 monclient: found mon.noname-e 2024-09-10T16:34:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:34:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 1 -- 172.21.15.81:0/1646756276 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43e8013220 con 0x7f43e800c6c0 2024-09-10T16:34:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 10 monclient: _finish_auth 0 2024-09-10T16:34:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 10 monclient: _check_auth_tickets 2024-09-10T16:34:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 1 -- 172.21.15.81:0/1646756276 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f43ec001750 con 0x7f43e800c6c0 2024-09-10T16:34:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:34:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 10 monclient: dump: 2024-09-10T16:34:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.323 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.324 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.324 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.324 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.324 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.324 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.324 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.324 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.324 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.324 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.324 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.324 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.324 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.325 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.325 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 1 -- 172.21.15.81:0/1646756276 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f43ec0018f0 con 0x7f43e800c6c0 2024-09-10T16:34:52.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:52.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 1 -- 172.21.15.81:0/1646756276 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f43ec0048b0 con 0x7f43e800c6c0 2024-09-10T16:34:52.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:52.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:52.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f43fbfff640 10 monclient: dump: 2024-09-10T16:34:52.325 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.325 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.325 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.325 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.327 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.327 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.327 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f440326a640 5 monclient: authenticate success, global_id 6011 2024-09-10T16:34:52.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f440326a640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:52.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f440326a640 4 set_mon_vals no callback set 2024-09-10T16:34:52.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f440326a640 10 monclient: shutdown 2024-09-10T16:34:52.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f440326a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:52.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f440326a640 1 -- 172.21.15.81:0/1646756276 >> v1:172.21.15.81:6793/0 conn(0x7f43e800c6c0 legacy=0x7f43e800ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.320+0000 7f440326a640 1 -- 172.21.15.81:0/1646756276 shutdown_connections 2024-09-10T16:34:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.324+0000 7f440326a640 1 -- 172.21.15.81:0/1646756276 >> 172.21.15.81:0/1646756276 conn(0x7f43fc0a3fd0 msgr2=0x7f43fc0a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.324+0000 7f440326a640 1 -- 172.21.15.81:0/1646756276 shutdown_connections 2024-09-10T16:34:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.324+0000 7f440326a640 1 -- 172.21.15.81:0/1646756276 wait complete. 2024-09-10T16:34:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.324+0000 7f440326a640 10 monclient: build_initial_monmap 2024-09-10T16:34:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.324+0000 7f440326a640 10 monclient: monmap: 2024-09-10T16:34:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:52.330 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.324+0000 7f440326a640 1 Processor -- start 2024-09-10T16:34:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.324+0000 7f440326a640 1 -- start start 2024-09-10T16:34:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.324+0000 7f440326a640 10 monclient: init 2024-09-10T16:34:52.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.324+0000 7f440326a640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:52.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.324+0000 7f440326a640 10 monclient: _add_conns ranks=[5,1,4,3,0,8,2,7,6] 2024-09-10T16:34:52.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.324+0000 7f440326a640 10 monclient(hunting): picked mon.noname-h con 0x7f43e800c240 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:52.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.324+0000 7f4401006640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7f43e800c240 legacy=0x7f43fc1c1a20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:52.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.324+0000 7f440326a640 10 monclient(hunting): picked mon.noname-f con 0x7f43e800c6c0 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:52.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.328+0000 7f4400805640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7f43e800c6c0 legacy=0x7f43fc1d28b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6789/0 2024-09-10T16:34:52.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.328+0000 7f440326a640 10 monclient(hunting): picked mon.noname-c con 0x7f43e8012230 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:52.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.328+0000 7f440326a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc0966a0 con 0x7f43e800c6c0 2024-09-10T16:34:52.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.328+0000 7f440326a640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc0a6470 con 0x7f43e8012230 2024-09-10T16:34:52.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.328+0000 7f440326a640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43fc09cc30 con 0x7f43e800c240 2024-09-10T16:34:52.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.328+0000 7f440326a640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:52.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.328+0000 7f440326a640 10 monclient(hunting): authenticate will time out at 1259.728229s 2024-09-10T16:34:52.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.332+0000 7f4401807640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f43e8012230 0x7f43fc1d5fe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:36240/0 (socket says 172.21.15.81:36240) 2024-09-10T16:34:52.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.332+0000 7f4401807640 1 -- 172.21.15.81:0/4278780476 learned_addr learned my addr 172.21.15.81:0/4278780476 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.332+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4056933099 0 0) 0x7f43fc0a6470 con 0x7f43e8012230 2024-09-10T16:34:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.332+0000 7f43f9ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.332+0000 7f43f9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.332+0000 7f43f9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.332+0000 7f43f9ffb640 10 monclient(hunting): my global_id is 144301 2024-09-10T16:34:52.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.332+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f43e8005760 con 0x7f43e8012230 2024-09-10T16:34:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.332+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1054265262 0 0) 0x7f43e8005760 con 0x7f43e8012230 2024-09-10T16:34:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.332+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f43fc0a6470 con 0x7f43e8012230 2024-09-10T16:34:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.332+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f43ec001690 con 0x7f43e8012230 2024-09-10T16:34:52.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.332+0000 7f43f9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:34:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 10 monclient(hunting): dump: 2024-09-10T16:34:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.338 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.339 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:52.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4239279136 0 0) 0x7f43fc0a6470 con 0x7f43e8012230 2024-09-10T16:34:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 >> v1:172.21.15.189:6791/0 conn(0x7f43e800c240 legacy=0x7f43fc1c1a20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 >> v1:172.21.15.189:6789/0 conn(0x7f43e800c6c0 legacy=0x7f43fc1d28b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:34:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 1 monclient: found mon.c 2024-09-10T16:34:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43fc098a00 con 0x7f43e8012230 2024-09-10T16:34:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 10 monclient: _finish_auth 0 2024-09-10T16:34:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:34:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f440326a640 5 monclient: authenticate success, global_id 144301 2024-09-10T16:34:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f440326a640 10 monclient: _renew_subs 2024-09-10T16:34:52.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f440326a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f440326a640 1 -- 172.21.15.81:0/4278780476 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f43fc098160 con 0x7f43e8012230 2024-09-10T16:34:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f440326a640 10 monclient: _renew_subs 2024-09-10T16:34:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f440326a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f440326a640 1 -- 172.21.15.81:0/4278780476 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f43fc1c2130 con 0x7f43e8012230 2024-09-10T16:34:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f440326a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f440326a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f440326a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:52.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f440326a640 1 -- 172.21.15.81:0/4278780476 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43fc0008e0 con 0x7f43e8012230 2024-09-10T16:34:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f43ec001830 con 0x7f43e8012230 2024-09-10T16:34:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:52.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f43ec004de0 con 0x7f43e8012230 2024-09-10T16:34:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 10 monclient: dump: 2024-09-10T16:34:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.343 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.344 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43fb7fe640 4 set_mon_vals no callback set 2024-09-10T16:34:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.336+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f43ec005000 con 0x7f43e8012230 2024-09-10T16:34:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.340+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(230..230 src has 121..230) ==== 3898+0+0 (unknown 2485211294 0 0) 0x7f43ec04ac30 con 0x7f43e8012230 2024-09-10T16:34:52.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.340+0000 7f4401006640 10 monclient: get_auth_request con 0x7f43e803f000 auth_method 0 2024-09-10T16:34:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.344+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f43ec0169d0 con 0x7f43e8012230 2024-09-10T16:34:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.344+0000 7f43f9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:52.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.344+0000 7f43f9ffb640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:52.481 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31359]: starting. 2024-09-10T16:34:52.482 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31359]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31358 2024-09-10T16:34:52.482 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31359]: created object 0... 2024-09-10T16:34:52.482 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31359]: created object 25... 2024-09-10T16:34:52.482 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31359]: created object 49... 2024-09-10T16:34:52.482 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31359]: finishing. 2024-09-10T16:34:52.482 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31359]: shutting down. 2024-09-10T16:34:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.588+0000 7f440326a640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-10T16:34:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.588+0000 7f440326a640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-10T16:34:52.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.588+0000 7f440326a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:52.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.588+0000 7f440326a640 1 -- 172.21.15.81:0/4278780476 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f43fc0a33e0 con 0x7f43e8012230 2024-09-10T16:34:52.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.588+0000 7f43f9ffb640 1 -- 172.21.15.81:0/4278780476 <== mon.4 v1:172.21.15.81:6791/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2705 (unknown 254746657 0 2866277743) 0x7f43ec01f7a0 con 0x7f43e8012230 2024-09-10T16:34:52.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.588+0000 7f43f9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-10T16:34:52.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.588+0000 7f43f9ffb640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:52.593 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":40,"quorum":[0,2,4,6,8],"quorum_names":["a","b","c","d","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","modified":"2024-09-10T16:29:22.909160Z","created":"2024-09-10T16:29:22.909160Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6790","nonce":0}]},"addr":"172.21.15.189:6790/0","public_addr":"172.21.15.189:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6791","nonce":0}]},"addr":"172.21.15.81:6791/0","public_addr":"172.21.15.81:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6791","nonce":0}]},"addr":"172.21.15.189:6791/0","public_addr":"172.21.15.189:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6792","nonce":0}]},"addr":"172.21.15.81:6792/0","public_addr":"172.21.15.81:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6792","nonce":0}]},"addr":"172.21.15.189:6792/0","public_addr":"172.21.15.189:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6793","nonce":0}]},"addr":"172.21.15.81:6793/0","public_addr":"172.21.15.81:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T16:34:52.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.592+0000 7f440326a640 1 -- 172.21.15.81:0/4278780476 >> v1:172.21.15.189:6812/1108603242 conn(0x7f43e803f000 legacy=0x7f43e80414c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.592+0000 7f440326a640 10 monclient: shutdown 2024-09-10T16:34:52.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.592+0000 7f440326a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:52.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.592+0000 7f440326a640 1 -- 172.21.15.81:0/4278780476 >> v1:172.21.15.81:6791/0 conn(0x7f43e8012230 legacy=0x7f43fc1d5fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.592+0000 7f440326a640 1 -- 172.21.15.81:0/4278780476 shutdown_connections 2024-09-10T16:34:52.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.592+0000 7f440326a640 1 -- 172.21.15.81:0/4278780476 >> 172.21.15.81:0/4278780476 conn(0x7f43fc0a3fd0 msgr2=0x7f43fc09ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:52.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.592+0000 7f440326a640 1 -- 172.21.15.81:0/4278780476 shutdown_connections 2024-09-10T16:34:52.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.592+0000 7f440326a640 1 -- 172.21.15.81:0/4278780476 wait complete. 2024-09-10T16:34:52.611 INFO:tasks.mon_thrash.ceph_manager:quorum is size 5 2024-09-10T16:34:52.611 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon a 2024-09-10T16:34:52.611 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T16:34:52.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 10 monclient: get_monmap_and_config 2024-09-10T16:34:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 10 monclient: build_initial_monmap 2024-09-10T16:34:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 10 monclient: monmap: 2024-09-10T16:34:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:52.734507+0000 2024-09-10T16:34:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:52.734507+0000 2024-09-10T16:34:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:52.734 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.735 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:52.735 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:52.735 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:52.735 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:52.735 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:52.735 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:52.735 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:52.735 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:52.735 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:52.735 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 1 Processor -- start 2024-09-10T16:34:52.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 1 -- start start 2024-09-10T16:34:52.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 10 monclient: init 2024-09-10T16:34:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 10 monclient: _add_conns ranks=[5,3,4,2,8,1,6,7,0] 2024-09-10T16:34:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 10 monclient(hunting): picked mon.noname-h con 0x7f9a6409d440 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 10 monclient(hunting): picked mon.noname-g con 0x7f9a640a39e0 addr v1:172.21.15.189:6790/0 2024-09-10T16:34:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 10 monclient(hunting): picked mon.noname-c con 0x7f9a640a0900 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a640a37a0 con 0x7f9a640a39e0 2024-09-10T16:34:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a64074d30 con 0x7f9a640a0900 2024-09-10T16:34:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6409d820 con 0x7f9a6409d440 2024-09-10T16:34:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:52.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 10 monclient(hunting): authenticate will time out at 1260.134513s 2024-09-10T16:34:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a696e0640 1 -- >> v1:172.21.15.189:6790/0 conn(0x7f9a640a39e0 legacy=0x7f9a640a01f0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:34:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a69ee1640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7f9a6409d440 legacy=0x7f9a6409fae0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6a6e2640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f9a640a0900 0x7f9a6413e680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:36250/0 (socket says 172.21.15.81:36250) 2024-09-10T16:34:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6a6e2640 1 -- 172.21.15.81:0/2236731456 learned_addr learned my addr 172.21.15.81:0/2236731456 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 1 -- 172.21.15.81:0/2236731456 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 265423402 0 0) 0x7f9a64074d30 con 0x7f9a640a0900 2024-09-10T16:34:52.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient(hunting): _negotiate 2024-09-10T16:34:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient(hunting): my global_id is 144310 2024-09-10T16:34:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 1 -- 172.21.15.81:0/2236731456 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a50003530 con 0x7f9a640a0900 2024-09-10T16:34:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 1 -- 172.21.15.81:0/2236731456 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1541821833 0 0) 0x7f9a50003530 con 0x7f9a640a0900 2024-09-10T16:34:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 1 -- 172.21.15.81:0/2236731456 >> v1:172.21.15.189:6791/0 conn(0x7f9a6409d440 legacy=0x7f9a6409fae0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:34:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 1 -- 172.21.15.81:0/2236731456 >> v1:172.21.15.189:6790/0 conn(0x7f9a640a39e0 legacy=0x7f9a640a01f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:34:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient: _finish_hunting 0 2024-09-10T16:34:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 1 monclient: found mon.noname-c 2024-09-10T16:34:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:34:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 1 -- 172.21.15.81:0/2236731456 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6409e1c0 con 0x7f9a640a0900 2024-09-10T16:34:52.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient: _finish_auth 0 2024-09-10T16:34:52.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient: _check_auth_tickets 2024-09-10T16:34:52.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:52.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 1 -- 172.21.15.81:0/2236731456 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9a5c001bc0 con 0x7f9a640a0900 2024-09-10T16:34:52.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 5 monclient: authenticate success, global_id 144310 2024-09-10T16:34:52.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:52.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:52.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:34:52.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient: dump: 2024-09-10T16:34:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.748 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.749 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 1 -- 172.21.15.81:0/2236731456 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a5c001de0 con 0x7f9a640a0900 2024-09-10T16:34:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a6c145640 4 set_mon_vals no callback set 2024-09-10T16:34:52.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 1 -- 172.21.15.81:0/2236731456 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9a5c0020d0 con 0x7f9a640a0900 2024-09-10T16:34:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.732+0000 7f9a68edf640 10 monclient: dump: 2024-09-10T16:34:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.750 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.751 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.751 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.751 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.751 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.751 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.751 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.751 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient: shutdown 2024-09-10T16:34:52.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:52.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 1 -- 172.21.15.81:0/2236731456 >> v1:172.21.15.81:6791/0 conn(0x7f9a640a0900 legacy=0x7f9a6413e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 1 -- 172.21.15.81:0/2236731456 shutdown_connections 2024-09-10T16:34:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 1 -- 172.21.15.81:0/2236731456 >> 172.21.15.81:0/2236731456 conn(0x7f9a640a3fd0 msgr2=0x7f9a640a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 1 -- 172.21.15.81:0/2236731456 shutdown_connections 2024-09-10T16:34:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 1 -- 172.21.15.81:0/2236731456 wait complete. 2024-09-10T16:34:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient: build_initial_monmap 2024-09-10T16:34:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient: monmap: 2024-09-10T16:34:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:52.752 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:52.753 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 1 Processor -- start 2024-09-10T16:34:52.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 1 -- start start 2024-09-10T16:34:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient: init 2024-09-10T16:34:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient: _add_conns ranks=[2,8,7,0,3,4,5,6,1] 2024-09-10T16:34:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient(hunting): picked mon.noname-b con 0x7f9a6409d440 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient(hunting): picked mon.noname-e con 0x7f9a640a0900 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient(hunting): picked mon.noname-i con 0x7f9a640a39e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6408eac0 con 0x7f9a6409d440 2024-09-10T16:34:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a640a46d0 con 0x7f9a640a39e0 2024-09-10T16:34:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9a6408f360 con 0x7f9a640a0900 2024-09-10T16:34:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient(hunting): authenticate will time out at 1260.137866s 2024-09-10T16:34:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a696e0640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f9a640a0900 0x7f9a6409a0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:40758/0 (socket says 172.21.15.81:40758) 2024-09-10T16:34:52.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a696e0640 1 -- 172.21.15.81:0/2020811867 learned_addr learned my addr 172.21.15.81:0/2020811867 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6a6e2640 1 -- 172.21.15.81:0/2020811867 >> v1:172.21.15.189:6792/0 conn(0x7f9a640a39e0 legacy=0x7f9a641d3cf0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:34:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3260403729 0 0) 0x7f9a6408f360 con 0x7f9a640a0900 2024-09-10T16:34:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): my global_id is 6020 2024-09-10T16:34:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a48003530 con 0x7f9a640a0900 2024-09-10T16:34:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2594283594 0 0) 0x7f9a6408eac0 con 0x7f9a6409d440 2024-09-10T16:34:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:52.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): my global_id is 144353 2024-09-10T16:34:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a6408f360 con 0x7f9a6409d440 2024-09-10T16:34:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1199638433 0 0) 0x7f9a6408f360 con 0x7f9a6409d440 2024-09-10T16:34:52.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a6408eac0 con 0x7f9a6409d440 2024-09-10T16:34:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9a540042b0 con 0x7f9a6409d440 2024-09-10T16:34:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): dump: 2024-09-10T16:34:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.757 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.758 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.759 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 503314572 0 0) 0x7f9a48003530 con 0x7f9a640a0900 2024-09-10T16:34:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a6408f360 con 0x7f9a640a0900 2024-09-10T16:34:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9a60004380 con 0x7f9a640a0900 2024-09-10T16:34:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient(hunting): dump: 2024-09-10T16:34:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.760 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.761 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.761 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 423538537 0 0) 0x7f9a6408eac0 con 0x7f9a6409d440 2024-09-10T16:34:52.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 >> v1:172.21.15.81:6793/0 conn(0x7f9a640a0900 legacy=0x7f9a6409a0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 >> v1:172.21.15.189:6792/0 conn(0x7f9a640a39e0 legacy=0x7f9a641d3cf0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:52.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:34:52.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 monclient: found mon.b 2024-09-10T16:34:52.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:52.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:52.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a6409a7e0 con 0x7f9a6409d440 2024-09-10T16:34:52.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient: _finish_auth 0 2024-09-10T16:34:52.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:34:52.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:52.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 5 monclient: authenticate success, global_id 144353 2024-09-10T16:34:52.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient: _renew_subs 2024-09-10T16:34:52.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:52.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9a6409f220 con 0x7f9a6409d440 2024-09-10T16:34:52.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient: _renew_subs 2024-09-10T16:34:52.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:34:52.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f9a6409eba0 con 0x7f9a6409d440 2024-09-10T16:34:52.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9a54004780 con 0x7f9a6409d440 2024-09-10T16:34:52.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:52.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9a54004cb0 con 0x7f9a6409d440 2024-09-10T16:34:52.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:52.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:52.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5bfff640 4 set_mon_vals no callback set 2024-09-10T16:34:52.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 10 monclient: dump: 2024-09-10T16:34:52.764 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.764 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.764 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.764 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.764 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.764 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.764 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.764 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.765 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a6c145640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9a4c0065d0 con 0x7f9a4c002870 2024-09-10T16:34:52.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.736+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f9a54004ed0 con 0x7f9a6409d440 2024-09-10T16:34:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(230..230 src has 121..230) ==== 3898+0+0 (unknown 2485211294 0 0) 0x7f9a5404aee0 con 0x7f9a6409d440 2024-09-10T16:34:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 901147474 0 0) 0x7f9a4c0065d0 con 0x7f9a4c002870 2024-09-10T16:34:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 10 monclient(hunting): my global_id is 5877 2024-09-10T16:34:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a6408eac0 con 0x7f9a4c002870 2024-09-10T16:34:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 4066364681 0 0) 0x7f9a6408eac0 con 0x7f9a4c002870 2024-09-10T16:34:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a4c0065d0 con 0x7f9a4c002870 2024-09-10T16:34:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9a60004c20 con 0x7f9a4c002870 2024-09-10T16:34:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:34:52.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 10 monclient: dump: 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.767 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.768 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a6a6e2640 10 monclient: get_auth_request con 0x7f9a4803d500 auth_method 0 2024-09-10T16:34:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3276715765 0 0) 0x7f9a4c0065d0 con 0x7f9a4c002870 2024-09-10T16:34:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9a4c00a170 con 0x7f9a4c002870 2024-09-10T16:34:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f9a60005020 con 0x7f9a4c002870 2024-09-10T16:34:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 >> v1:172.21.15.81:6789/0 conn(0x7f9a4c002870 legacy=0x7f9a4c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.740+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 >> v1:172.21.15.81:6789/0 conn(0x7f9a4c002870 legacy=0x7f9a4c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:52.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a6c145640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:52.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a6c145640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f9a4c009e80 con 0x7f9a4c009140 2024-09-10T16:34:52.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1049318051 0 0) 0x7f9a4c009e80 con 0x7f9a4c009140 2024-09-10T16:34:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:34:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 10 monclient(hunting): my global_id is 5886 2024-09-10T16:34:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9a4c0065d0 con 0x7f9a4c009140 2024-09-10T16:34:52.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2218602795 0 0) 0x7f9a4c0065d0 con 0x7f9a4c009140 2024-09-10T16:34:52.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9a4c009e80 con 0x7f9a4c009140 2024-09-10T16:34:52.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9a60005850 con 0x7f9a4c009140 2024-09-10T16:34:52.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:52.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:34:52.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 10 monclient: dump: 2024-09-10T16:34:52.772 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.773 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.774 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.774 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.774 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.774 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.774 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.775 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.775 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.775 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.775 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 163245135 0 0) 0x7f9a4c009e80 con 0x7f9a4c009140 2024-09-10T16:34:52.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 --> v1:172.21.15.81:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f9a4c00c420 con 0x7f9a4c009140 2024-09-10T16:34:52.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7669 (unknown 0 0 679654017) 0x7f9a60005ab0 con 0x7f9a4c009140 2024-09-10T16:34:52.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:52.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:52.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 >> v1:172.21.15.81:6789/0 conn(0x7f9a4c009140 legacy=0x7f9a4c0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.744+0000 7f9a5a7fc640 1 -- 172.21.15.81:0/2020811867 >> v1:172.21.15.81:6789/0 conn(0x7f9a4c009140 legacy=0x7f9a4c0095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:52.777 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-09-10T16:34:52.777 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 40, 2024-09-10T16:34:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 302693, 2024-09-10T16:34:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:52.778 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-09-10T16:34:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:52.779 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:52.780 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:52.781 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:52.782 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:52.783 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:52.783 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:52.783 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:52.783 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:52.783 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:52.784 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:52.784 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:52.784 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.784 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:52.785 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:52.786 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:52.786 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:52.786 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:52.786 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:52.786 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:52.786 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:52.787 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:52.788 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.789 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.790 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.791 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.792 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.793 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.794 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.795 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:52.796 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:52.797 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.798 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.800 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.801 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:52.802 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:52.803 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:52.804 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.805 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.806 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.807 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.808 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:52.809 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:52.810 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.811 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:34:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:34:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.812 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.813 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:52.813 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.748+0000 7f9a6c145640 1 -- 172.21.15.81:0/2020811867 >> v1:172.21.15.189:6812/1108603242 conn(0x7f9a4803d500 legacy=0x7f9a4803f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.748+0000 7f9a6c145640 10 monclient: shutdown 2024-09-10T16:34:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.748+0000 7f9a6c145640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.748+0000 7f9a6c145640 1 -- 172.21.15.81:0/2020811867 >> v1:172.21.15.81:6790/0 conn(0x7f9a6409d440 legacy=0x7f9a640999c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.748+0000 7f9a6a6e2640 1 -- 172.21.15.81:0/2020811867 reap_dead start 2024-09-10T16:34:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.748+0000 7f9a6a6e2640 1 -- 172.21.15.81:0/2020811867 reap_dead start 2024-09-10T16:34:52.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.748+0000 7f9a6c145640 1 -- 172.21.15.81:0/2020811867 shutdown_connections 2024-09-10T16:34:52.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.748+0000 7f9a6c145640 1 -- 172.21.15.81:0/2020811867 >> 172.21.15.81:0/2020811867 conn(0x7f9a640a3fd0 msgr2=0x7f9a64094070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:52.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.748+0000 7f9a6c145640 1 -- 172.21.15.81:0/2020811867 shutdown_connections 2024-09-10T16:34:52.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.748+0000 7f9a6c145640 1 -- 172.21.15.81:0/2020811867 wait complete. 2024-09-10T16:34:52.815 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-10T16:34:52.815 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon b 2024-09-10T16:34:52.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T16:34:52.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 10 monclient: get_monmap_and_config 2024-09-10T16:34:52.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 10 monclient: build_initial_monmap 2024-09-10T16:34:52.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 10 monclient: monmap: 2024-09-10T16:34:52.931 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:52.931 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.931 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:52.931174+0000 2024-09-10T16:34:52.931 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:52.931174+0000 2024-09-10T16:34:52.931 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:52.931 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.931 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:52.931 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:52.932 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:52.932 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:52.932 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:52.932 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:52.932 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:52.932 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:52.932 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:52.932 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 1 Processor -- start 2024-09-10T16:34:52.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 1 -- start start 2024-09-10T16:34:52.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 10 monclient: init 2024-09-10T16:34:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 10 monclient: _add_conns ranks=[5,8,6,2,4,3,0,1,7] 2024-09-10T16:34:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 10 monclient(hunting): picked mon.noname-h con 0x7f38dc09ca10 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 10 monclient(hunting): picked mon.noname-e con 0x7f38dc0a56e0 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 10 monclient(hunting): picked mon.noname-d con 0x7f38dc0a5b00 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38dc1362b0 con 0x7f38dc09ca10 2024-09-10T16:34:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38dc0a80b0 con 0x7f38dc0a5b00 2024-09-10T16:34:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38dc09de70 con 0x7f38dc0a56e0 2024-09-10T16:34:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:52.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 10 monclient(hunting): authenticate will time out at 1260.330633s 2024-09-10T16:34:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38dbfff640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7f38dc09ca10 legacy=0x7f38dc135ba0 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e0e3a640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f38dc0a5b00 0x7f38dc141650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:35046/0 (socket says 172.21.15.81:35046) 2024-09-10T16:34:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38db7fe640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f38dc0a56e0 0x7f38dc13df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:40766/0 (socket says 172.21.15.81:40766) 2024-09-10T16:34:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e0e3a640 1 -- 172.21.15.81:0/2660253119 learned_addr learned my addr 172.21.15.81:0/2660253119 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 1 -- 172.21.15.81:0/2660253119 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 745922596 0 0) 0x7f38dc0a80b0 con 0x7f38dc0a5b00 2024-09-10T16:34:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient(hunting): my global_id is 144294 2024-09-10T16:34:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 1 -- 172.21.15.81:0/2660253119 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38c4003530 con 0x7f38dc0a5b00 2024-09-10T16:34:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 1 -- 172.21.15.81:0/2660253119 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1039076871 0 0) 0x7f38dc09de70 con 0x7f38dc0a56e0 2024-09-10T16:34:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient(hunting): _negotiate 2024-09-10T16:34:52.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient(hunting): my global_id is 6029 2024-09-10T16:34:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 1 -- 172.21.15.81:0/2660253119 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38dc0a80b0 con 0x7f38dc0a56e0 2024-09-10T16:34:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 1 -- 172.21.15.81:0/2660253119 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1440567613 0 0) 0x7f38c4003530 con 0x7f38dc0a5b00 2024-09-10T16:34:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 1 -- 172.21.15.81:0/2660253119 >> v1:172.21.15.81:6793/0 conn(0x7f38dc0a56e0 legacy=0x7f38dc13df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 1 -- 172.21.15.81:0/2660253119 >> v1:172.21.15.189:6791/0 conn(0x7f38dc09ca10 legacy=0x7f38dc135ba0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:34:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient: _finish_hunting 0 2024-09-10T16:34:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 1 monclient: found mon.noname-d 2024-09-10T16:34:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:34:52.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 1 -- 172.21.15.81:0/2660253119 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38dc09e150 con 0x7f38dc0a5b00 2024-09-10T16:34:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient: _finish_auth 0 2024-09-10T16:34:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient: _check_auth_tickets 2024-09-10T16:34:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 1 -- 172.21.15.81:0/2660253119 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f38d4001bc0 con 0x7f38dc0a5b00 2024-09-10T16:34:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:34:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient: dump: 2024-09-10T16:34:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.943 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.944 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.945 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.945 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.945 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.945 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 5 monclient: authenticate success, global_id 144294 2024-09-10T16:34:52.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:52.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 1 -- 172.21.15.81:0/2660253119 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f38d4001de0 con 0x7f38dc0a5b00 2024-09-10T16:34:52.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:52.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:52.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 1 -- 172.21.15.81:0/2660253119 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f38d4004f70 con 0x7f38dc0a5b00 2024-09-10T16:34:52.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:52.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38e289d640 4 set_mon_vals no callback set 2024-09-10T16:34:52.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:52.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.928+0000 7f38daffd640 10 monclient: dump: 2024-09-10T16:34:52.946 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.947 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.948 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient: shutdown 2024-09-10T16:34:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:52.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 1 -- 172.21.15.81:0/2660253119 >> v1:172.21.15.81:6792/0 conn(0x7f38dc0a5b00 legacy=0x7f38dc141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 1 -- 172.21.15.81:0/2660253119 shutdown_connections 2024-09-10T16:34:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 1 -- 172.21.15.81:0/2660253119 >> 172.21.15.81:0/2660253119 conn(0x7f38dc06dc90 msgr2=0x7f38dc0ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 1 -- 172.21.15.81:0/2660253119 shutdown_connections 2024-09-10T16:34:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 1 -- 172.21.15.81:0/2660253119 wait complete. 2024-09-10T16:34:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient: build_initial_monmap 2024-09-10T16:34:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient: monmap: 2024-09-10T16:34:52.949 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:52.950 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:52.951 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 1 Processor -- start 2024-09-10T16:34:52.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 1 -- start start 2024-09-10T16:34:52.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient: init 2024-09-10T16:34:52.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:52.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient: _add_conns ranks=[1,0,7,6,2,5,4,8,3] 2024-09-10T16:34:52.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient(hunting): picked mon.noname-f con 0x7f38dc09ca10 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:52.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient(hunting): picked mon.noname-a con 0x7f38dc0a56e0 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:52.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient(hunting): picked mon.noname-i con 0x7f38dc0a5b00 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:52.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38dc132cd0 con 0x7f38dc0a56e0 2024-09-10T16:34:52.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38dc09f790 con 0x7f38dc09ca10 2024-09-10T16:34:52.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38dc0a9ee0 con 0x7f38dc0a5b00 2024-09-10T16:34:52.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:52.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient(hunting): authenticate will time out at 1260.333608s 2024-09-10T16:34:52.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38db7fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f38dc0a56e0 0x7f38dc1d2860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42690/0 (socket says 172.21.15.81:42690) 2024-09-10T16:34:52.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38db7fe640 1 -- 172.21.15.81:0/2270952137 learned_addr learned my addr 172.21.15.81:0/2270952137 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:52.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38dbfff640 1 -- 172.21.15.81:0/2270952137 >> v1:172.21.15.189:6789/0 conn(0x7f38dc09ca10 legacy=0x7f38dc0a4ce0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6789/0 2024-09-10T16:34:52.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e0e3a640 1 -- 172.21.15.81:0/2270952137 >> v1:172.21.15.189:6792/0 conn(0x7f38dc0a5b00 legacy=0x7f38dc1d5f90 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:34:52.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2615115715 0 0) 0x7f38dc132cd0 con 0x7f38dc0a56e0 2024-09-10T16:34:52.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:52.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:52.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:52.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient(hunting): my global_id is 5895 2024-09-10T16:34:52.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38c8003530 con 0x7f38dc0a56e0 2024-09-10T16:34:52.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3430792382 0 0) 0x7f38c8003530 con 0x7f38dc0a56e0 2024-09-10T16:34:52.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f38dc132cd0 con 0x7f38dc0a56e0 2024-09-10T16:34:52.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f38d0001660 con 0x7f38dc0a56e0 2024-09-10T16:34:52.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:52.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:34:52.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient(hunting): dump: 2024-09-10T16:34:52.955 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.955 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.955 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.955 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.955 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.955 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.955 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.956 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.956 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.956 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.956 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.956 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.956 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.956 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.956 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.956 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:52.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 4037949505 0 0) 0x7f38dc132cd0 con 0x7f38dc0a56e0 2024-09-10T16:34:52.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 >> v1:172.21.15.189:6792/0 conn(0x7f38dc0a5b00 legacy=0x7f38dc1d5f90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:52.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 >> v1:172.21.15.189:6789/0 conn(0x7f38dc09ca10 legacy=0x7f38dc0a4ce0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:52.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:34:52.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 monclient: found mon.a 2024-09-10T16:34:52.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:52.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:34:52.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38dc09f4b0 con 0x7f38dc0a56e0 2024-09-10T16:34:52.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient: _finish_auth 0 2024-09-10T16:34:52.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:34:52.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:52.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 5 monclient: authenticate success, global_id 5895 2024-09-10T16:34:52.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient: _renew_subs 2024-09-10T16:34:52.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:34:52.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 1 -- 172.21.15.81:0/2270952137 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f38dc132a00 con 0x7f38dc0a56e0 2024-09-10T16:34:52.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient: _renew_subs 2024-09-10T16:34:52.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:34:52.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 1 -- 172.21.15.81:0/2270952137 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f38dc1cd500 con 0x7f38dc0a56e0 2024-09-10T16:34:52.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f38d0004aa0 con 0x7f38dc0a56e0 2024-09-10T16:34:52.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:52.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f38d0004f90 con 0x7f38dc0a56e0 2024-09-10T16:34:52.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:52.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38da7fc640 4 set_mon_vals no callback set 2024-09-10T16:34:52.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:34:52.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient: dump: 2024-09-10T16:34:52.958 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.960 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38e289d640 1 -- 172.21.15.81:0/2270952137 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f38bc0065d0 con 0x7f38bc002870 2024-09-10T16:34:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f38d0010ea0 con 0x7f38dc0a56e0 2024-09-10T16:34:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(230..230 src has 121..230) ==== 3898+0+0 (unknown 2485211294 0 0) 0x7f38d004b060 con 0x7f38dc0a56e0 2024-09-10T16:34:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3694171956 0 0) 0x7f38bc0065d0 con 0x7f38bc002870 2024-09-10T16:34:52.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient(hunting): my global_id is 144362 2024-09-10T16:34:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38dc132cd0 con 0x7f38bc002870 2024-09-10T16:34:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 607028921 0 0) 0x7f38dc132cd0 con 0x7f38bc002870 2024-09-10T16:34:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f38bc0065d0 con 0x7f38bc002870 2024-09-10T16:34:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f38cc004110 con 0x7f38bc002870 2024-09-10T16:34:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.932+0000 7f38d8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.936+0000 7f38d8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.936+0000 7f38d8ff9640 10 monclient: dump: 2024-09-10T16:34:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.961 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.962 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.936+0000 7f38e0e3a640 10 monclient: get_auth_request con 0x7f38c803ce40 auth_method 0 2024-09-10T16:34:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.936+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1747807145 0 0) 0x7f38bc0065d0 con 0x7f38bc002870 2024-09-10T16:34:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.936+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 --> v1:172.21.15.81:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f38bc00a170 con 0x7f38bc002870 2024-09-10T16:34:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.936+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f38cc006490 con 0x7f38bc002870 2024-09-10T16:34:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.936+0000 7f38d8ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.936+0000 7f38d8ff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.936+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 >> v1:172.21.15.81:6790/0 conn(0x7f38bc002870 legacy=0x7f38bc004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.936+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 >> v1:172.21.15.81:6790/0 conn(0x7f38bc002870 legacy=0x7f38bc004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38e289d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38e289d640 1 -- 172.21.15.81:0/2270952137 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f38bc009e80 con 0x7f38bc009140 2024-09-10T16:34:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1155725408 0 0) 0x7f38bc009e80 con 0x7f38bc009140 2024-09-10T16:34:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:34:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 10 monclient(hunting): my global_id is 144371 2024-09-10T16:34:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f38bc0065d0 con 0x7f38bc009140 2024-09-10T16:34:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3418133189 0 0) 0x7f38bc0065d0 con 0x7f38bc009140 2024-09-10T16:34:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f38bc009e80 con 0x7f38bc009140 2024-09-10T16:34:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f38cc004b70 con 0x7f38bc009140 2024-09-10T16:34:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 10 monclient: dump: 2024-09-10T16:34:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:52.967 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1019138714 0 0) 0x7f38bc009e80 con 0x7f38bc009140 2024-09-10T16:34:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 --> v1:172.21.15.81:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f38bc00c420 con 0x7f38bc009140 2024-09-10T16:34:52.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7499 (unknown 0 0 1493340858) 0x7f38cc0060c0 con 0x7f38bc009140 2024-09-10T16:34:52.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:52.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:52.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 >> v1:172.21.15.81:6790/0 conn(0x7f38bc009140 legacy=0x7f38bc0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38d8ff9640 1 -- 172.21.15.81:0/2270952137 >> v1:172.21.15.81:6790/0 conn(0x7f38bc009140 legacy=0x7f38bc0095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:52.968 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:52.968 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:52.968 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:52.968 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:52.968 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 40, 2024-09-10T16:34:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 35779, 2024-09-10T16:34:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-09-10T16:34:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:52.969 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:52.970 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:52.971 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:52.972 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.973 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:52.974 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.976 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.978 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:52.979 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:52.981 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.982 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.983 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.984 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:52.985 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:52.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:52.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:52.988 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:52.988 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:52.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38e289d640 1 -- 172.21.15.81:0/2270952137 >> v1:172.21.15.189:6812/1108603242 conn(0x7f38c803ce40 legacy=0x7f38c803f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38e289d640 10 monclient: shutdown 2024-09-10T16:34:52.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38e289d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:52.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38e289d640 1 -- 172.21.15.81:0/2270952137 >> v1:172.21.15.81:6789/0 conn(0x7f38dc0a56e0 legacy=0x7f38dc1d2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:52.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38e0e3a640 1 -- 172.21.15.81:0/2270952137 reap_dead start 2024-09-10T16:34:52.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38e0e3a640 1 -- 172.21.15.81:0/2270952137 reap_dead start 2024-09-10T16:34:52.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38e289d640 1 -- 172.21.15.81:0/2270952137 shutdown_connections 2024-09-10T16:34:52.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.940+0000 7f38e289d640 1 -- 172.21.15.81:0/2270952137 >> 172.21.15.81:0/2270952137 conn(0x7f38dc06dc90 msgr2=0x7f38dc0aa600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:52.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.944+0000 7f38e289d640 1 -- 172.21.15.81:0/2270952137 shutdown_connections 2024-09-10T16:34:52.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:52.944+0000 7f38e289d640 1 -- 172.21.15.81:0/2270952137 wait complete. 2024-09-10T16:34:52.990 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-10T16:34:52.990 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon c 2024-09-10T16:34:52.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T16:34:53.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 10 monclient: get_monmap_and_config 2024-09-10T16:34:53.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 10 monclient: build_initial_monmap 2024-09-10T16:34:53.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 10 monclient: monmap: 2024-09-10T16:34:53.114 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:53.114 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.114 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:53.114274+0000 2024-09-10T16:34:53.114 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:53.114274+0000 2024-09-10T16:34:53.114 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:53.114 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.114 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:53.114 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:53.114 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:53.114 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:53.114 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:53.115 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:53.115 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:53.115 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:53.115 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:53.115 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 1 Processor -- start 2024-09-10T16:34:53.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 1 -- start start 2024-09-10T16:34:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 10 monclient: init 2024-09-10T16:34:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 10 monclient: _add_conns ranks=[0,2,5,1,3,8,7,4,6] 2024-09-10T16:34:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 10 monclient(hunting): picked mon.noname-a con 0x7f469009ca10 addr v1:172.21.15.81:6789/0 2024-09-10T16:34:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 10 monclient(hunting): picked mon.noname-b con 0x7f46900a56e0 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:53.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 10 monclient(hunting): picked mon.noname-h con 0x7f46900a5b00 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46901362b0 con 0x7f469009ca10 2024-09-10T16:34:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46900a80b0 con 0x7f46900a56e0 2024-09-10T16:34:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f469009de70 con 0x7f46900a5b00 2024-09-10T16:34:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 10 monclient(hunting): authenticate will time out at 1260.513798s 2024-09-10T16:34:53.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4694e28640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f46900a56e0 0x7f469013df20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:37782/0 (socket says 172.21.15.81:37782) 2024-09-10T16:34:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4695629640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f469009ca10 0x7f4690135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:42706/0 (socket says 172.21.15.81:42706) 2024-09-10T16:34:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4694e28640 1 -- 172.21.15.81:0/4128239238 learned_addr learned my addr 172.21.15.81:0/4128239238 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4695e2a640 1 -- 172.21.15.81:0/4128239238 >> v1:172.21.15.189:6791/0 conn(0x7f46900a5b00 legacy=0x7f4690141650 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 1 -- 172.21.15.81:0/4128239238 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3530429815 0 0) 0x7f46900a80b0 con 0x7f46900a56e0 2024-09-10T16:34:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient(hunting): my global_id is 144380 2024-09-10T16:34:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 1 -- 172.21.15.81:0/4128239238 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f467c003530 con 0x7f46900a56e0 2024-09-10T16:34:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 1 -- 172.21.15.81:0/4128239238 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 556908805 0 0) 0x7f46901362b0 con 0x7f469009ca10 2024-09-10T16:34:53.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient(hunting): _negotiate 2024-09-10T16:34:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient(hunting): my global_id is 5904 2024-09-10T16:34:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 1 -- 172.21.15.81:0/4128239238 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46900a80b0 con 0x7f469009ca10 2024-09-10T16:34:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 1 -- 172.21.15.81:0/4128239238 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3303306789 0 0) 0x7f467c003530 con 0x7f46900a56e0 2024-09-10T16:34:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 1 -- 172.21.15.81:0/4128239238 >> v1:172.21.15.189:6791/0 conn(0x7f46900a5b00 legacy=0x7f4690141650 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:34:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 1 -- 172.21.15.81:0/4128239238 >> v1:172.21.15.81:6789/0 conn(0x7f469009ca10 legacy=0x7f4690135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient: _finish_hunting 0 2024-09-10T16:34:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 1 monclient: found mon.noname-b 2024-09-10T16:34:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:34:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 1 -- 172.21.15.81:0/4128239238 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469009e150 con 0x7f46900a56e0 2024-09-10T16:34:53.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient: _finish_auth 0 2024-09-10T16:34:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient: _check_auth_tickets 2024-09-10T16:34:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 1 -- 172.21.15.81:0/4128239238 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f468c001840 con 0x7f46900a56e0 2024-09-10T16:34:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 5 monclient: authenticate success, global_id 144380 2024-09-10T16:34:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient: dump: 2024-09-10T16:34:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:53.130 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:53.131 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 1 -- 172.21.15.81:0/4128239238 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f468c0019e0 con 0x7f46900a56e0 2024-09-10T16:34:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:53.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 4 set_mon_vals no callback set 2024-09-10T16:34:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 1 -- 172.21.15.81:0/4128239238 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f468c004bf0 con 0x7f46900a56e0 2024-09-10T16:34:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f4687fff640 10 monclient: dump: 2024-09-10T16:34:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:53.132 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:53.133 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:53.134 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 10 monclient: shutdown 2024-09-10T16:34:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 1 -- 172.21.15.81:0/4128239238 >> v1:172.21.15.81:6790/0 conn(0x7f46900a56e0 legacy=0x7f469013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 1 -- 172.21.15.81:0/4128239238 shutdown_connections 2024-09-10T16:34:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 1 -- 172.21.15.81:0/4128239238 >> 172.21.15.81:0/4128239238 conn(0x7f469006dc90 msgr2=0x7f46900ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 1 -- 172.21.15.81:0/4128239238 shutdown_connections 2024-09-10T16:34:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.112+0000 7f469788d640 1 -- 172.21.15.81:0/4128239238 wait complete. 2024-09-10T16:34:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 monclient: build_initial_monmap 2024-09-10T16:34:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 monclient: monmap: 2024-09-10T16:34:53.134 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:53.135 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:53.136 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 1 Processor -- start 2024-09-10T16:34:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 1 -- start start 2024-09-10T16:34:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 monclient: init 2024-09-10T16:34:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 monclient: _add_conns ranks=[5,7,6,1,8,0,4,2,3] 2024-09-10T16:34:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 monclient(hunting): picked mon.noname-h con 0x7f469009ca10 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 monclient(hunting): picked mon.noname-i con 0x7f46900a56e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 monclient(hunting): picked mon.noname-d con 0x7f46900a5b00 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4690132dd0 con 0x7f469009ca10 2024-09-10T16:34:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46900a06c0 con 0x7f46900a5b00 2024-09-10T16:34:53.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f469009fe20 con 0x7f46900a56e0 2024-09-10T16:34:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 monclient(hunting): authenticate will time out at 1260.517010s 2024-09-10T16:34:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4695629640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7f469009ca10 legacy=0x7f46901cd410 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4695e2a640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f46900a5b00 0x7f46901d57b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:35052/0 (socket says 172.21.15.81:35052) 2024-09-10T16:34:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4694e28640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7f46900a56e0 legacy=0x7f46900a4c00 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:34:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4695e2a640 1 -- 172.21.15.81:0/3017459739 learned_addr learned my addr 172.21.15.81:0/3017459739 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 98035315 0 0) 0x7f46900a06c0 con 0x7f46900a5b00 2024-09-10T16:34:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient(hunting): my global_id is 144303 2024-09-10T16:34:53.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4674003530 con 0x7f46900a5b00 2024-09-10T16:34:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1764352469 0 0) 0x7f4674003530 con 0x7f46900a5b00 2024-09-10T16:34:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46900a06c0 con 0x7f46900a5b00 2024-09-10T16:34:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4688004670 con 0x7f46900a5b00 2024-09-10T16:34:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:34:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient(hunting): dump: 2024-09-10T16:34:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.138 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:53.139 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3515635150 0 0) 0x7f46900a06c0 con 0x7f46900a5b00 2024-09-10T16:34:53.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 >> v1:172.21.15.189:6792/0 conn(0x7f46900a56e0 legacy=0x7f46900a4c00 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 >> v1:172.21.15.189:6791/0 conn(0x7f469009ca10 legacy=0x7f46901cd410 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:34:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 monclient: found mon.d 2024-09-10T16:34:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f469009eec0 con 0x7f46900a5b00 2024-09-10T16:34:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient: _finish_auth 0 2024-09-10T16:34:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:34:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 5 monclient: authenticate success, global_id 144303 2024-09-10T16:34:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 monclient: _renew_subs 2024-09-10T16:34:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:53.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 1 -- 172.21.15.81:0/3017459739 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f46900a5310 con 0x7f46900a5b00 2024-09-10T16:34:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 monclient: _renew_subs 2024-09-10T16:34:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:34:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 1 -- 172.21.15.81:0/3017459739 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f46901d70a0 con 0x7f46900a5b00 2024-09-10T16:34:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4688004890 con 0x7f46900a5b00 2024-09-10T16:34:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4688004ec0 con 0x7f46900a5b00 2024-09-10T16:34:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f46877fe640 4 set_mon_vals no callback set 2024-09-10T16:34:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient: dump: 2024-09-10T16:34:53.141 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:53.142 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:53.143 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f4688005060 con 0x7f46900a5b00 2024-09-10T16:34:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f469788d640 1 -- 172.21.15.81:0/3017459739 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f46700065d0 con 0x7f4670002870 2024-09-10T16:34:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(230..230 src has 121..230) ==== 3898+0+0 (unknown 2485211294 0 0) 0x7f468804b2c0 con 0x7f46900a5b00 2024-09-10T16:34:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 63070676 0 0) 0x7f46700065d0 con 0x7f4670002870 2024-09-10T16:34:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient(hunting): my global_id is 144319 2024-09-10T16:34:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46900a06c0 con 0x7f4670002870 2024-09-10T16:34:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4694e28640 10 monclient: get_auth_request con 0x7f467403cf20 auth_method 0 2024-09-10T16:34:53.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1129389294 0 0) 0x7f46900a06c0 con 0x7f4670002870 2024-09-10T16:34:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f46700065d0 con 0x7f4670002870 2024-09-10T16:34:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4680000fa0 con 0x7f4670002870 2024-09-10T16:34:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 10 monclient: dump: 2024-09-10T16:34:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:53.144 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:53.145 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2426998752 0 0) 0x7f46700065d0 con 0x7f4670002870 2024-09-10T16:34:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.116+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 --> v1:172.21.15.81:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f467000a170 con 0x7f4670002870 2024-09-10T16:34:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.120+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f46800017a0 con 0x7f4670002870 2024-09-10T16:34:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.120+0000 7f4685ffb640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:53.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.120+0000 7f4685ffb640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.120+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 >> v1:172.21.15.81:6791/0 conn(0x7f4670002870 legacy=0x7f4670004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:53.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.120+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 >> v1:172.21.15.81:6791/0 conn(0x7f4670002870 legacy=0x7f4670004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f469788d640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f469788d640 1 -- 172.21.15.81:0/3017459739 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4670009e60 con 0x7f4670009120 2024-09-10T16:34:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2872049749 0 0) 0x7f4670009e60 con 0x7f4670009120 2024-09-10T16:34:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:34:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 10 monclient(hunting): my global_id is 144328 2024-09-10T16:34:53.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f46700065d0 con 0x7f4670009120 2024-09-10T16:34:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3209407757 0 0) 0x7f46700065d0 con 0x7f4670009120 2024-09-10T16:34:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4670009e60 con 0x7f4670009120 2024-09-10T16:34:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4680004d60 con 0x7f4670009120 2024-09-10T16:34:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 10 monclient: dump: 2024-09-10T16:34:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.148 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:53.149 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1179031709 0 0) 0x7f4670009e60 con 0x7f4670009120 2024-09-10T16:34:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 --> v1:172.21.15.81:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f467000c400 con 0x7f4670009120 2024-09-10T16:34:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7499 (unknown 0 0 3879179254) 0x7f4680006350 con 0x7f4670009120 2024-09-10T16:34:53.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:53.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:53.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 >> v1:172.21.15.81:6791/0 conn(0x7f4670009120 legacy=0x7f46700095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:53.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4685ffb640 1 -- 172.21.15.81:0/3017459739 >> v1:172.21.15.81:6791/0 conn(0x7f4670009120 legacy=0x7f46700095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:53.150 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:53.150 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:53.150 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:53.150 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:53.150 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 40, 2024-09-10T16:34:53.150 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 35971, 2024-09-10T16:34:53.151 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:53.151 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:53.151 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:53.151 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:53.151 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:53.151 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:53.151 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:53.151 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 0, 2024-09-10T16:34:53.151 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:53.151 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:53.151 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:53.151 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:53.151 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:53.152 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:53.152 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:53.152 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:53.152 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:53.152 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:53.152 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:53.152 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:53.152 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:53.152 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:53.152 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:53.152 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:53.152 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:53.152 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:53.153 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:53.153 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:53.153 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:53.153 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:53.153 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:53.153 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:53.153 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:53.153 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:53.153 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:53.153 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:53.154 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.154 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:53.154 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:53.154 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:53.154 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:53.154 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:53.154 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:53.154 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:53.154 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:53.154 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:53.154 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:53.154 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:53.154 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:53.155 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:53.155 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:53.155 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:53.155 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:53.155 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:53.155 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:53.155 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:53.155 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:53.155 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:53.155 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:53.156 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:53.156 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:53.156 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:53.156 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:53.156 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:53.156 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:53.156 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:53.156 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:53.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.156 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:53.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.156 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:53.157 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:53.157 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.157 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.157 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:53.157 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.157 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.157 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:53.157 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:53.157 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.158 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.158 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.158 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:53.158 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:53.158 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.158 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.159 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.159 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:53.159 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.159 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.159 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:53.159 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:53.159 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.159 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.159 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.160 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:53.160 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:53.160 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.160 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.160 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:53.160 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.160 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.161 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.161 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:53.161 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:53.161 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.161 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.162 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.162 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:53.162 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:53.162 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.163 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.163 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:53.163 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.163 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.164 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:53.164 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:53.164 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.164 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.164 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.165 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:53.165 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:53.165 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.165 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.165 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.165 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.166 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:53.166 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.166 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.166 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.166 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.166 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:53.167 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:53.167 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.167 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.167 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.167 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.168 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:53.168 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:53.168 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.168 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.168 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.168 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:53.169 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.169 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.169 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.169 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:53.169 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:53.169 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.170 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.170 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.170 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:53.170 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:53.170 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.170 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.170 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:53.170 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.171 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.172 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.172 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.172 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:53.172 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.172 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.172 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.172 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:53.172 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:53.172 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.172 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.172 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.173 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:53.173 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:53.173 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.173 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.173 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.173 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.173 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:53.173 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.173 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.173 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.174 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:53.174 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:53.174 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.174 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.174 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.174 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.174 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.174 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:53.174 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:53.174 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.174 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:53.174 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:53.174 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:53.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.175 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:53.175 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:53.175 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.175 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:53.175 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:53.175 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:34:53.175 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.175 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.175 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:53.175 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:53.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f469788d640 1 -- 172.21.15.81:0/3017459739 >> v1:172.21.15.189:6812/1108603242 conn(0x7f467403cf20 legacy=0x7f467403f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:53.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f469788d640 10 monclient: shutdown 2024-09-10T16:34:53.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f469788d640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:53.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f469788d640 1 -- 172.21.15.81:0/3017459739 >> v1:172.21.15.81:6792/0 conn(0x7f46900a5b00 legacy=0x7f46901d57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:53.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4695e2a640 1 -- 172.21.15.81:0/3017459739 reap_dead start 2024-09-10T16:34:53.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f4695e2a640 1 -- 172.21.15.81:0/3017459739 reap_dead start 2024-09-10T16:34:53.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f469788d640 1 -- 172.21.15.81:0/3017459739 shutdown_connections 2024-09-10T16:34:53.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f469788d640 1 -- 172.21.15.81:0/3017459739 >> 172.21.15.81:0/3017459739 conn(0x7f469006dc90 msgr2=0x7f46900a82f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:53.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f469788d640 1 -- 172.21.15.81:0/3017459739 shutdown_connections 2024-09-10T16:34:53.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.124+0000 7f469788d640 1 -- 172.21.15.81:0/3017459739 wait complete. 2024-09-10T16:34:53.178 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-10T16:34:53.178 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon d 2024-09-10T16:34:53.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-10T16:34:53.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 10 monclient: get_monmap_and_config 2024-09-10T16:34:53.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 10 monclient: build_initial_monmap 2024-09-10T16:34:53.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 10 monclient: monmap: 2024-09-10T16:34:53.300 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:53.300 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.300 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:53.299379+0000 2024-09-10T16:34:53.300 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:53.299379+0000 2024-09-10T16:34:53.301 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:53.301 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.301 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:53.301 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:53.301 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:53.301 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:53.302 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:53.302 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:53.302 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:53.302 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:53.302 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:53.302 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 1 Processor -- start 2024-09-10T16:34:53.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 1 -- start start 2024-09-10T16:34:53.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 10 monclient: init 2024-09-10T16:34:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 10 monclient: _add_conns ranks=[8,2,6,7,4,0,3,1,5] 2024-09-10T16:34:53.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 10 monclient(hunting): picked mon.noname-e con 0x7f3d3409ca10 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 10 monclient(hunting): picked mon.noname-b con 0x7f3d340a56e0 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 10 monclient(hunting): picked mon.noname-d con 0x7f3d340a5b00 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d341362b0 con 0x7f3d340a56e0 2024-09-10T16:34:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d340a80b0 con 0x7f3d340a5b00 2024-09-10T16:34:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d3409de70 con 0x7f3d3409ca10 2024-09-10T16:34:53.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d3af51640 10 monclient(hunting): authenticate will time out at 1260.698779s 2024-09-10T16:34:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d38ced640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f3d3409ca10 0x7f3d34135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:40780/0 (socket says 172.21.15.81:40780) 2024-09-10T16:34:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d394ee640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f3d340a5b00 0x7f3d34141650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:35056/0 (socket says 172.21.15.81:35056) 2024-09-10T16:34:53.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.296+0000 7f3d38ced640 1 -- 172.21.15.81:0/732932041 learned_addr learned my addr 172.21.15.81:0/732932041 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:53.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 1 -- 172.21.15.81:0/732932041 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3930482585 0 0) 0x7f3d341362b0 con 0x7f3d340a56e0 2024-09-10T16:34:53.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:53.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient(hunting): my global_id is 144389 2024-09-10T16:34:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 1 -- 172.21.15.81:0/732932041 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d1c003530 con 0x7f3d340a56e0 2024-09-10T16:34:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 1 -- 172.21.15.81:0/732932041 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2911883869 0 0) 0x7f3d340a80b0 con 0x7f3d340a5b00 2024-09-10T16:34:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient(hunting): my global_id is 144312 2024-09-10T16:34:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 1 -- 172.21.15.81:0/732932041 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d341362b0 con 0x7f3d340a5b00 2024-09-10T16:34:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 1 -- 172.21.15.81:0/732932041 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1098460572 0 0) 0x7f3d3409de70 con 0x7f3d3409ca10 2024-09-10T16:34:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:53.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:53.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:53.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient(hunting): my global_id is 6038 2024-09-10T16:34:53.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 1 -- 172.21.15.81:0/732932041 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d340a80b0 con 0x7f3d3409ca10 2024-09-10T16:34:53.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 1 -- 172.21.15.81:0/732932041 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1771067504 0 0) 0x7f3d341362b0 con 0x7f3d340a5b00 2024-09-10T16:34:53.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 1 -- 172.21.15.81:0/732932041 >> v1:172.21.15.81:6793/0 conn(0x7f3d3409ca10 legacy=0x7f3d34135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:53.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 1 -- 172.21.15.81:0/732932041 >> v1:172.21.15.81:6790/0 conn(0x7f3d340a56e0 legacy=0x7f3d3413df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:53.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient: _finish_hunting 0 2024-09-10T16:34:53.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 1 monclient: found mon.noname-d 2024-09-10T16:34:53.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:53.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:34:53.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 1 -- 172.21.15.81:0/732932041 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d3409e150 con 0x7f3d340a5b00 2024-09-10T16:34:53.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient: _finish_auth 0 2024-09-10T16:34:53.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient: _check_auth_tickets 2024-09-10T16:34:53.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:53.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 1 -- 172.21.15.81:0/732932041 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3d280017a0 con 0x7f3d340a5b00 2024-09-10T16:34:53.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d3af51640 5 monclient: authenticate success, global_id 144312 2024-09-10T16:34:53.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d3af51640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:53.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:53.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:34:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient: dump: 2024-09-10T16:34:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:53.317 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:53.318 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d3af51640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 1 -- 172.21.15.81:0/732932041 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d280019c0 con 0x7f3d340a5b00 2024-09-10T16:34:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 1 -- 172.21.15.81:0/732932041 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3d28004b30 con 0x7f3d340a5b00 2024-09-10T16:34:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d3af51640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:53.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d3af51640 4 set_mon_vals no callback set 2024-09-10T16:34:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d337fe640 10 monclient: dump: 2024-09-10T16:34:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:53.319 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:53.320 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d3af51640 10 monclient: shutdown 2024-09-10T16:34:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d3af51640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d3af51640 1 -- 172.21.15.81:0/732932041 >> v1:172.21.15.81:6792/0 conn(0x7f3d340a5b00 legacy=0x7f3d34141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d3af51640 1 -- 172.21.15.81:0/732932041 shutdown_connections 2024-09-10T16:34:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.304+0000 7f3d3af51640 1 -- 172.21.15.81:0/732932041 >> 172.21.15.81:0/732932041 conn(0x7f3d3406dc90 msgr2=0x7f3d340ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:53.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 1 -- 172.21.15.81:0/732932041 shutdown_connections 2024-09-10T16:34:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 1 -- 172.21.15.81:0/732932041 wait complete. 2024-09-10T16:34:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 10 monclient: build_initial_monmap 2024-09-10T16:34:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 10 monclient: monmap: 2024-09-10T16:34:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:53.321 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:53.322 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 1 Processor -- start 2024-09-10T16:34:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 1 -- start start 2024-09-10T16:34:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 10 monclient: init 2024-09-10T16:34:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:53.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 10 monclient: _add_conns ranks=[4,3,5,0,8,6,2,1,7] 2024-09-10T16:34:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 10 monclient(hunting): picked mon.noname-c con 0x7f3d3409ca10 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 10 monclient(hunting): picked mon.noname-g con 0x7f3d340a56e0 addr v1:172.21.15.189:6790/0 2024-09-10T16:34:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 10 monclient(hunting): picked mon.noname-h con 0x7f3d340a5b00 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d34130a80 con 0x7f3d340a56e0 2024-09-10T16:34:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d340aa2e0 con 0x7f3d3409ca10 2024-09-10T16:34:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d340aa7a0 con 0x7f3d340a5b00 2024-09-10T16:34:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d3af51640 10 monclient(hunting): authenticate will time out at 1260.710572s 2024-09-10T16:34:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d38ced640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f3d3409ca10 0x7f3d3412d700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:36298/0 (socket says 172.21.15.81:36298) 2024-09-10T16:34:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d38ced640 1 -- 172.21.15.81:0/2499669067 learned_addr learned my addr 172.21.15.81:0/2499669067 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d394ee640 1 -- 172.21.15.81:0/2499669067 >> v1:172.21.15.189:6791/0 conn(0x7f3d340a5b00 legacy=0x7f3d341d5fb0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.308+0000 7f3d33fff640 1 -- 172.21.15.81:0/2499669067 >> v1:172.21.15.189:6790/0 conn(0x7f3d340a56e0 legacy=0x7f3d3412de10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6790/0 2024-09-10T16:34:53.324 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31360]: starting. 2024-09-10T16:34:53.324 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31360]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31358 2024-09-10T16:34:53.324 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31360]: shutting down. 2024-09-10T16:34:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2222305710 0 0) 0x7f3d340aa2e0 con 0x7f3d3409ca10 2024-09-10T16:34:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient(hunting): my global_id is 144337 2024-09-10T16:34:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d20003530 con 0x7f3d3409ca10 2024-09-10T16:34:53.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4134088205 0 0) 0x7f3d20003530 con 0x7f3d3409ca10 2024-09-10T16:34:53.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d340aa2e0 con 0x7f3d3409ca10 2024-09-10T16:34:53.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3d2c001bc0 con 0x7f3d3409ca10 2024-09-10T16:34:53.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:53.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:34:53.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient(hunting): dump: 2024-09-10T16:34:53.331 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:53.332 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.332 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.332 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.332 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:53.332 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.332 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:53.332 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:53.333 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:53.333 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:53.333 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:53.333 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:53.333 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:53.333 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:53.333 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:53.333 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:53.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 574905950 0 0) 0x7f3d340aa2e0 con 0x7f3d3409ca10 2024-09-10T16:34:53.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 >> v1:172.21.15.189:6791/0 conn(0x7f3d340a5b00 legacy=0x7f3d341d5fb0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:53.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 >> v1:172.21.15.189:6790/0 conn(0x7f3d340a56e0 legacy=0x7f3d3412de10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:53.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient: _finish_hunting 0 2024-09-10T16:34:53.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 monclient: found mon.c 2024-09-10T16:34:53.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:53.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:53.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d341304b0 con 0x7f3d3409ca10 2024-09-10T16:34:53.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient: _finish_auth 0 2024-09-10T16:34:53.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient: _check_auth_tickets 2024-09-10T16:34:53.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:53.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d3af51640 5 monclient: authenticate success, global_id 144337 2024-09-10T16:34:53.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d3af51640 10 monclient: _renew_subs 2024-09-10T16:34:53.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d3af51640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:53.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d3af51640 1 -- 172.21.15.81:0/2499669067 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f3d3412ea80 con 0x7f3d3409ca10 2024-09-10T16:34:53.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d3af51640 10 monclient: _renew_subs 2024-09-10T16:34:53.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d3af51640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:53.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d3af51640 1 -- 172.21.15.81:0/2499669067 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f3d3412e520 con 0x7f3d3409ca10 2024-09-10T16:34:53.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f3d2c004aa0 con 0x7f3d3409ca10 2024-09-10T16:34:53.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:53.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3d2c0050d0 con 0x7f3d3409ca10 2024-09-10T16:34:53.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:53.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:53.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient: dump: 2024-09-10T16:34:53.337 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:53.337 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.337 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.337 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.337 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:53.337 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.337 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:53.338 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:53.338 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:53.338 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:53.338 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:53.338 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:53.338 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:53.338 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:53.338 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:53.338 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d32ffd640 4 set_mon_vals no callback set 2024-09-10T16:34:53.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d3af51640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:53.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f3d2c0052f0 con 0x7f3d3409ca10 2024-09-10T16:34:53.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d3af51640 1 -- 172.21.15.81:0/2499669067 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3d3412e810 con 0x7f3d34142d70 2024-09-10T16:34:53.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(231..231 src has 121..231) ==== 3506+0+0 (unknown 1835394016 0 0) 0x7f3d2c04afd0 con 0x7f3d3409ca10 2024-09-10T16:34:53.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1832784920 0 0) 0x7f3d3412e810 con 0x7f3d34142d70 2024-09-10T16:34:53.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:53.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:53.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:53.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient(hunting): my global_id is 144321 2024-09-10T16:34:53.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d340aa2e0 con 0x7f3d34142d70 2024-09-10T16:34:53.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d394ee640 10 monclient: get_auth_request con 0x7f3d2003ce90 auth_method 0 2024-09-10T16:34:53.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 281332039 0 0) 0x7f3d340aa2e0 con 0x7f3d34142d70 2024-09-10T16:34:53.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d3412e810 con 0x7f3d34142d70 2024-09-10T16:34:53.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3d24001810 con 0x7f3d34142d70 2024-09-10T16:34:53.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:53.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:53.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient: dump: 2024-09-10T16:34:53.340 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:53.340 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.340 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.340 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.340 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:53.340 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.340 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:53.341 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:53.341 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:53.341 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:53.341 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:53.341 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:53.341 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:53.341 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:53.341 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:53.341 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1174541215 0 0) 0x7f3d3412e810 con 0x7f3d34142d70 2024-09-10T16:34:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 --> v1:172.21.15.81:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3d340008e0 con 0x7f3d34142d70 2024-09-10T16:34:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f3d24001a50 con 0x7f3d34142d70 2024-09-10T16:34:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 >> v1:172.21.15.81:6792/0 conn(0x7f3d34142d70 legacy=0x7f3d34136750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.316+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 >> v1:172.21.15.81:6792/0 conn(0x7f3d34142d70 legacy=0x7f3d34136750 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d3af51640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d3af51640 1 -- 172.21.15.81:0/2499669067 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f3d34137570 con 0x7f3d3412fb20 2024-09-10T16:34:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1903051088 0 0) 0x7f3d34137570 con 0x7f3d3412fb20 2024-09-10T16:34:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:53.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 10 monclient(hunting): my global_id is 144330 2024-09-10T16:34:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d3412e810 con 0x7f3d3412fb20 2024-09-10T16:34:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1932751817 0 0) 0x7f3d3412e810 con 0x7f3d3412fb20 2024-09-10T16:34:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f3d34137570 con 0x7f3d3412fb20 2024-09-10T16:34:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f3d24005030 con 0x7f3d3412fb20 2024-09-10T16:34:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:34:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 10 monclient: dump: 2024-09-10T16:34:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:53.343 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.344 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:53.344 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:53.344 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:53.344 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:53.344 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:53.344 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:53.344 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:53.344 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:53.344 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:53.344 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4286907684 0 0) 0x7f3d34137570 con 0x7f3d3412fb20 2024-09-10T16:34:53.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 --> v1:172.21.15.81:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f3d3412ff00 con 0x7f3d3412fb20 2024-09-10T16:34:53.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7666 (unknown 0 0 1525058653) 0x7f3d24007290 con 0x7f3d3412fb20 2024-09-10T16:34:53.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:53.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:53.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 >> v1:172.21.15.81:6792/0 conn(0x7f3d3412fb20 legacy=0x7f3d34136e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:53.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d317fa640 1 -- 172.21.15.81:0/2499669067 >> v1:172.21.15.81:6792/0 conn(0x7f3d3412fb20 legacy=0x7f3d34136e60 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:53.345 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:53.346 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:53.346 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:53.346 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:53.346 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 40, 2024-09-10T16:34:53.346 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 36171, 2024-09-10T16:34:53.346 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:53.346 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:53.346 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:53.346 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:53.346 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:53.346 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:53.346 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:53.347 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 1, 2024-09-10T16:34:53.347 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:53.347 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:53.347 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:53.347 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:53.347 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:53.347 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:53.347 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:53.347 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:53.347 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:53.347 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:53.347 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:53.348 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:53.348 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:53.348 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:53.348 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:53.348 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:53.348 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:53.348 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:53.348 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:53.348 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:53.348 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:53.348 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:53.349 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:53.349 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:53.349 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:53.349 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:53.349 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:53.349 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:53.349 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.349 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:53.349 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:53.349 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:53.350 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:53.350 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:53.350 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:53.350 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:53.350 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:53.350 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:53.350 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:53.350 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:53.350 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:53.350 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:53.350 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:53.350 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:53.351 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:53.352 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:53.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.352 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:53.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.352 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:53.352 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:53.352 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.352 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.352 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.352 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:53.352 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.353 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.353 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.353 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:53.353 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:53.353 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.353 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.353 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.353 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.353 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:53.353 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:53.353 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.354 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.354 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:53.354 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.354 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.354 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.354 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:53.354 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:53.354 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.354 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.354 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.355 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:53.355 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:53.355 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.355 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:53.355 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.355 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.355 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.355 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.359 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:53.360 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.361 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:53.362 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.363 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:53.365 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:53.366 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:34:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-09-10T16:34:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:53.367 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:53.368 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:53.368 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d3af51640 1 -- 172.21.15.81:0/2499669067 >> v1:172.21.15.189:6812/1108603242 conn(0x7f3d2003ce90 legacy=0x7f3d2003f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d3af51640 10 monclient: shutdown 2024-09-10T16:34:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d3af51640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d3af51640 1 -- 172.21.15.81:0/2499669067 >> v1:172.21.15.81:6791/0 conn(0x7f3d3409ca10 legacy=0x7f3d3412d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d394ee640 1 -- 172.21.15.81:0/2499669067 reap_dead start 2024-09-10T16:34:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d394ee640 1 -- 172.21.15.81:0/2499669067 reap_dead start 2024-09-10T16:34:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d3af51640 1 -- 172.21.15.81:0/2499669067 shutdown_connections 2024-09-10T16:34:53.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d3af51640 1 -- 172.21.15.81:0/2499669067 >> 172.21.15.81:0/2499669067 conn(0x7f3d3406dc90 msgr2=0x7f3d341290f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d3af51640 1 -- 172.21.15.81:0/2499669067 shutdown_connections 2024-09-10T16:34:53.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.324+0000 7f3d3af51640 1 -- 172.21.15.81:0/2499669067 wait complete. 2024-09-10T16:34:53.371 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-10T16:34:53.371 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 5 for mon e 2024-09-10T16:34:53.371 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-10T16:34:53.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 10 monclient: get_monmap_and_config 2024-09-10T16:34:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 10 monclient: build_initial_monmap 2024-09-10T16:34:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 10 monclient: monmap: 2024-09-10T16:34:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:53.487 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:34:53.486926+0000 2024-09-10T16:34:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:34:53.486926+0000 2024-09-10T16:34:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:53.488 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:53.489 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:53.489 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:53.489 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:53.489 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:53.489 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:53.489 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:53.489 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 1 Processor -- start 2024-09-10T16:34:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 1 -- start start 2024-09-10T16:34:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 10 monclient: init 2024-09-10T16:34:53.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:53.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 10 monclient: _add_conns ranks=[5,7,1,2,6,3,8,4,0] 2024-09-10T16:34:53.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 10 monclient(hunting): picked mon.noname-h con 0x7f84880a3650 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:53.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 10 monclient(hunting): picked mon.noname-i con 0x7f848809df40 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:53.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 10 monclient(hunting): picked mon.noname-f con 0x7f84880a4140 addr v1:172.21.15.189:6789/0 2024-09-10T16:34:53.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84880a52e0 con 0x7f84880a4140 2024-09-10T16:34:53.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84880a1c30 con 0x7f84880a3650 2024-09-10T16:34:53.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848809ccc0 con 0x7f848809df40 2024-09-10T16:34:53.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:53.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848f1cf640 10 monclient(hunting): authenticate will time out at 1260.886685s 2024-09-10T16:34:53.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f8487fff640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7f848809df40 legacy=0x7f848813c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:34:53.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848d76c640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7f84880a4140 legacy=0x7f848813fb80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-09-10T16:34:53.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.484+0000 7f848cf6b640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7f84880a3650 legacy=0x7f84880a3a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.688+0000 7f8487fff640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7f848809df40 legacy=0x7f848813c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:34:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.688+0000 7f848d76c640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7f84880a4140 legacy=0x7f848813fb80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-09-10T16:34:53.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:53.688+0000 7f848cf6b640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7f84880a3650 legacy=0x7f84880a3a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:54.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:54.092+0000 7f848d76c640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7f84880a4140 legacy=0x7f848813fb80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-09-10T16:34:54.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:54.092+0000 7f8487fff640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7f848809df40 legacy=0x7f848813c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:34:54.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:54.092+0000 7f848cf6b640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7f84880a3650 legacy=0x7f84880a3a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:54.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:54.896+0000 7f8487fff640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7f848809df40 legacy=0x7f848813c450 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:34:54.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:54.896+0000 7f848d76c640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7f84880a4140 legacy=0x7f848813fb80 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6789/0 2024-09-10T16:34:54.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:54.896+0000 7f848cf6b640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7f84880a3650 legacy=0x7f84880a3a30 unknown :-1 s=STATE_CONNECTING_RE l=0).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:56.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 10 monclient(hunting): tick 2024-09-10T16:34:56.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 10 monclient(hunting): _check_auth_tickets 2024-09-10T16:34:56.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 1 monclient(hunting): continuing hunt 2024-09-10T16:34:56.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 10 monclient(hunting): _reopen_session rank -1 2024-09-10T16:34:56.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7f848809df40 legacy=0x7f848813c450 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:34:56.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7f84880a3650 legacy=0x7f84880a3a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:34:56.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 1 -- >> v1:172.21.15.189:6789/0 conn(0x7f84880a4140 legacy=0x7f848813fb80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-10T16:34:56.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 10 monclient: _add_conns ranks=[6,8,2,3,0,4] 2024-09-10T16:34:56.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 10 monclient(hunting): picked mon.noname-d con 0x7f8474003790 addr v1:172.21.15.81:6792/0 2024-09-10T16:34:56.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 10 monclient(hunting): picked mon.noname-e con 0x7f8474007420 addr v1:172.21.15.81:6793/0 2024-09-10T16:34:56.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 10 monclient(hunting): picked mon.noname-b con 0x7f847400b1b0 addr v1:172.21.15.81:6790/0 2024-09-10T16:34:56.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848809cfa0 con 0x7f847400b1b0 2024-09-10T16:34:56.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84880a52e0 con 0x7f8474003790 2024-09-10T16:34:56.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f848809ccc0 con 0x7f8474007420 2024-09-10T16:34:56.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f84867fc640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:56.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f8487fff640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f8474007420 0x7f84740098e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:51682/0 (socket says 172.21.15.81:51682) 2024-09-10T16:34:56.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f848cf6b640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f8474003790 0x7f8474005be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:60288/0 (socket says 172.21.15.81:60288) 2024-09-10T16:34:56.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.484+0000 7f8487fff640 1 -- 172.21.15.81:0/1281126257 learned_addr learned my addr 172.21.15.81:0/1281126257 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 1 -- 172.21.15.81:0/1281126257 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3803927880 0 0) 0x7f848809cfa0 con 0x7f847400b1b0 2024-09-10T16:34:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient(hunting): my global_id is 144407 2024-09-10T16:34:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 1 -- 172.21.15.81:0/1281126257 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8470003530 con 0x7f847400b1b0 2024-09-10T16:34:56.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 1 -- 172.21.15.81:0/1281126257 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3369117765 0 0) 0x7f848809ccc0 con 0x7f8474007420 2024-09-10T16:34:56.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:56.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:56.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:56.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient(hunting): my global_id is 6074 2024-09-10T16:34:56.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 1 -- 172.21.15.81:0/1281126257 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f848809cfa0 con 0x7f8474007420 2024-09-10T16:34:56.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 1 -- 172.21.15.81:0/1281126257 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3051089114 0 0) 0x7f84880a52e0 con 0x7f8474003790 2024-09-10T16:34:56.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient(hunting): _negotiate 2024-09-10T16:34:56.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:56.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:56.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient(hunting): my global_id is 144348 2024-09-10T16:34:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 1 -- 172.21.15.81:0/1281126257 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f848809ccc0 con 0x7f8474003790 2024-09-10T16:34:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 1 -- 172.21.15.81:0/1281126257 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2933700598 0 0) 0x7f8470003530 con 0x7f847400b1b0 2024-09-10T16:34:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 1 -- 172.21.15.81:0/1281126257 >> v1:172.21.15.81:6793/0 conn(0x7f8474007420 legacy=0x7f84740098e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 1 -- 172.21.15.81:0/1281126257 >> v1:172.21.15.81:6792/0 conn(0x7f8474003790 legacy=0x7f8474005be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient: _finish_hunting 0 2024-09-10T16:34:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 1 monclient: found mon.noname-b 2024-09-10T16:34:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848d76c640 1 -- 172.21.15.81:0/1281126257 reap_dead start 2024-09-10T16:34:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:34:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 1 -- 172.21.15.81:0/1281126257 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8474012070 con 0x7f847400b1b0 2024-09-10T16:34:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient: _finish_auth 0 2024-09-10T16:34:56.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient: _check_auth_tickets 2024-09-10T16:34:56.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:56.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848f1cf640 5 monclient: authenticate success, global_id 144407 2024-09-10T16:34:56.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 1 -- 172.21.15.81:0/1281126257 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f84780041f0 con 0x7f847400b1b0 2024-09-10T16:34:56.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848f1cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:56.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:56.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:34:56.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient: dump: 2024-09-10T16:34:56.503 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:56.504 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:56.504 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:56.504 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:56.504 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:56.504 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:56.504 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:56.504 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:56.504 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:56.504 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:56.504 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:56.504 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:56.505 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:56.505 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:56.505 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:56.509 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848f1cf640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:34:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 1 -- 172.21.15.81:0/1281126257 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8478004390 con 0x7f847400b1b0 2024-09-10T16:34:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:56.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848f1cf640 10 monclient: get_monmap_and_config success 2024-09-10T16:34:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 1 -- 172.21.15.81:0/1281126257 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f8478004900 con 0x7f847400b1b0 2024-09-10T16:34:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848f1cf640 4 set_mon_vals no callback set 2024-09-10T16:34:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:34:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f84877fe640 10 monclient: dump: 2024-09-10T16:34:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:56.510 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:56.511 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848f1cf640 10 monclient: shutdown 2024-09-10T16:34:56.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848f1cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848f1cf640 1 -- 172.21.15.81:0/1281126257 >> v1:172.21.15.81:6790/0 conn(0x7f847400b1b0 legacy=0x7f847400d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848f1cf640 1 -- 172.21.15.81:0/1281126257 shutdown_connections 2024-09-10T16:34:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848f1cf640 1 -- 172.21.15.81:0/1281126257 >> 172.21.15.81:0/1281126257 conn(0x7f84880a8240 msgr2=0x7f84880a4740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848f1cf640 1 -- 172.21.15.81:0/1281126257 shutdown_connections 2024-09-10T16:34:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848f1cf640 1 -- 172.21.15.81:0/1281126257 wait complete. 2024-09-10T16:34:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848f1cf640 10 monclient: build_initial_monmap 2024-09-10T16:34:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.488+0000 7f848f1cf640 10 monclient: monmap: 2024-09-10T16:34:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:34:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:34:56.512 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:34:56.513 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:34:56.513 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:34:56.513 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:34:56.513 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:34:56.513 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:34:56.513 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:34:56.513 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:34:56.513 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:34:56.513 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:34:56.513 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:34:56.513 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:34:56.513 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:34:56.514 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:56.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 1 Processor -- start 2024-09-10T16:34:56.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 1 -- start start 2024-09-10T16:34:56.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 10 monclient: init 2024-09-10T16:34:56.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 10 monclient: _reopen_session rank -1 2024-09-10T16:34:56.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 10 monclient: _add_conns ranks=[5,7,4,1,0,3,2,6,8] 2024-09-10T16:34:56.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 10 monclient(hunting): picked mon.noname-h con 0x7f847400b1b0 addr v1:172.21.15.189:6791/0 2024-09-10T16:34:56.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 10 monclient(hunting): picked mon.noname-i con 0x7f84881a5c70 addr v1:172.21.15.189:6792/0 2024-09-10T16:34:56.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 10 monclient(hunting): picked mon.noname-c con 0x7f84881d16c0 addr v1:172.21.15.81:6791/0 2024-09-10T16:34:56.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84881a8510 con 0x7f84881d16c0 2024-09-10T16:34:56.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84881a7020 con 0x7f847400b1b0 2024-09-10T16:34:56.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84881a8ae0 con 0x7f84881a5c70 2024-09-10T16:34:56.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 10 monclient(hunting): _renew_subs 2024-09-10T16:34:56.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 10 monclient(hunting): authenticate will time out at 1263.893229s 2024-09-10T16:34:56.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848cf6b640 1 -- >> v1:172.21.15.189:6791/0 conn(0x7f847400b1b0 legacy=0x7f84881a5560 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6791/0 2024-09-10T16:34:56.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f8487fff640 1 -- >> v1:172.21.15.189:6792/0 conn(0x7f84881a5c70 legacy=0x7f84881a6100 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.189:6792/0 2024-09-10T16:34:56.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848d76c640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f84881d16c0 0x7f84881d3ab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:50578/0 (socket says 172.21.15.81:50578) 2024-09-10T16:34:56.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848d76c640 1 -- 172.21.15.81:0/3515320623 learned_addr learned my addr 172.21.15.81:0/3515320623 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:34:56.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1622794794 0 0) 0x7f84881a8510 con 0x7f84881d16c0 2024-09-10T16:34:56.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:56.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:56.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:56.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient(hunting): my global_id is 144373 2024-09-10T16:34:56.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84740053c0 con 0x7f84881d16c0 2024-09-10T16:34:56.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3490865501 0 0) 0x7f84740053c0 con 0x7f84881d16c0 2024-09-10T16:34:56.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f84881a8510 con 0x7f84881d16c0 2024-09-10T16:34:56.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f8478004880 con 0x7f84881d16c0 2024-09-10T16:34:56.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:34:56.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:34:56.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient(hunting): dump: 2024-09-10T16:34:56.516 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:56.516 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:56.516 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:56.516 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:56.516 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:56.516 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:56.516 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:56.516 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:56.517 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:56.517 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:56.517 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:56.517 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:56.517 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:56.517 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:56.517 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:56.517 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:56.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:34:56.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3281241806 0 0) 0x7f84881a8510 con 0x7f84881d16c0 2024-09-10T16:34:56.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 >> v1:172.21.15.189:6792/0 conn(0x7f84881a5c70 legacy=0x7f84881a6100 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:56.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 >> v1:172.21.15.189:6791/0 conn(0x7f847400b1b0 legacy=0x7f84881a5560 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-10T16:34:56.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient: _finish_hunting 0 2024-09-10T16:34:56.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 monclient: found mon.c 2024-09-10T16:34:56.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:34:56.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:56.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84881a8dc0 con 0x7f84881d16c0 2024-09-10T16:34:56.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient: _finish_auth 0 2024-09-10T16:34:56.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient: _check_auth_tickets 2024-09-10T16:34:56.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:34:56.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 5 monclient: authenticate success, global_id 144373 2024-09-10T16:34:56.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 10 monclient: _renew_subs 2024-09-10T16:34:56.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:56.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 1 -- 172.21.15.81:0/3515320623 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f84881a7e10 con 0x7f84881d16c0 2024-09-10T16:34:56.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 10 monclient: _renew_subs 2024-09-10T16:34:56.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:34:56.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 1 -- 172.21.15.81:0/3515320623 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f84881a69e0 con 0x7f84881d16c0 2024-09-10T16:34:56.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f8478004cd0 con 0x7f84881d16c0 2024-09-10T16:34:56.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:34:56.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f8478004330 con 0x7f84881d16c0 2024-09-10T16:34:56.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:56.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:34:56.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient: dump: 2024-09-10T16:34:56.519 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:56.519 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:56.519 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:56.519 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:56.519 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:56.520 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:56.520 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:56.520 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:56.520 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:56.520 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:56.520 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:56.520 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:56.520 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:56.520 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:56.521 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:56.521 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:56.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f8486ffd640 4 set_mon_vals no callback set 2024-09-10T16:34:56.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f8478010f30 con 0x7f84881d16c0 2024-09-10T16:34:56.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:56.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f848f1cf640 1 -- 172.21.15.81:0/3515320623 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f84680065d0 con 0x7f8468002870 2024-09-10T16:34:56.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(231..231 src has 121..231) ==== 3506+0+0 (unknown 1835394016 0 0) 0x7f847804ac00 con 0x7f84881d16c0 2024-09-10T16:34:56.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 475413787 0 0) 0x7f84680065d0 con 0x7f8468002870 2024-09-10T16:34:56.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:56.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:56.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:56.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 10 monclient(hunting): my global_id is 6083 2024-09-10T16:34:56.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.492+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84881a8510 con 0x7f8468002870 2024-09-10T16:34:56.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.496+0000 7f8487fff640 10 monclient: get_auth_request con 0x7f847403e2a0 auth_method 0 2024-09-10T16:34:56.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.496+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1961675484 0 0) 0x7f84881a8510 con 0x7f8468002870 2024-09-10T16:34:56.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.496+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f84680065d0 con 0x7f8468002870 2024-09-10T16:34:56.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.496+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f8480004640 con 0x7f8468002870 2024-09-10T16:34:56.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.496+0000 7f84857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:56.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.496+0000 7f84857fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:56.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.496+0000 7f84857fa640 10 monclient: dump: 2024-09-10T16:34:56.522 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:56.523 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:56.523 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:56.523 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:56.523 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:56.523 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:56.523 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:56.523 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:56.523 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:56.523 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:56.523 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:56.524 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:56.524 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:56.524 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:56.524 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:56.524 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:56.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.496+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2754948233 0 0) 0x7f84680065d0 con 0x7f8468002870 2024-09-10T16:34:56.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.496+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 --> v1:172.21.15.81:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f846800a170 con 0x7f8468002870 2024-09-10T16:34:56.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.496+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f8480004800 con 0x7f8468002870 2024-09-10T16:34:56.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.496+0000 7f84857fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:34:56.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.496+0000 7f84857fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:34:56.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.496+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 >> v1:172.21.15.81:6793/0 conn(0x7f8468002870 legacy=0x7f8468004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:56.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.496+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 >> v1:172.21.15.81:6793/0 conn(0x7f8468002870 legacy=0x7f8468004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:56.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.500+0000 7f848f1cf640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:34:56.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.500+0000 7f848f1cf640 1 -- 172.21.15.81:0/3515320623 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f8468009e80 con 0x7f8468009140 2024-09-10T16:34:56.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.500+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4223190190 0 0) 0x7f8468009e80 con 0x7f8468009140 2024-09-10T16:34:56.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.500+0000 7f84857fa640 10 monclient(hunting): _negotiate 2024-09-10T16:34:56.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.500+0000 7f84857fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:34:56.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.500+0000 7f84857fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:34:56.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.500+0000 7f84857fa640 10 monclient(hunting): my global_id is 6092 2024-09-10T16:34:56.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.500+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f84680065d0 con 0x7f8468009140 2024-09-10T16:34:56.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2356033594 0 0) 0x7f84680065d0 con 0x7f8468009140 2024-09-10T16:34:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f8468009e80 con 0x7f8468009140 2024-09-10T16:34:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f8480004f60 con 0x7f8468009140 2024-09-10T16:34:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f84857fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:34:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f84857fa640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:34:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f84857fa640 10 monclient: dump: 2024-09-10T16:34:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:34:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:34:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:34:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:34:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:34:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:34:56.528 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:34:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:34:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:34:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:34:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:34:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:34:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:34:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:34:56.529 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:34:56.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 54098184 0 0) 0x7f8468009e80 con 0x7f8468009140 2024-09-10T16:34:56.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 --> v1:172.21.15.81:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f846800c420 con 0x7f8468009140 2024-09-10T16:34:56.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7667 (unknown 0 0 1020297251) 0x7f8480006450 con 0x7f8468009140 2024-09-10T16:34:56.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f84857fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:34:56.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f84857fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:34:56.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 >> v1:172.21.15.81:6793/0 conn(0x7f8468009140 legacy=0x7f84680095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:56.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f84857fa640 1 -- 172.21.15.81:0/3515320623 >> v1:172.21.15.81:6793/0 conn(0x7f8468009140 legacy=0x7f84680095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:34:56.531 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:34:56.531 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:56.531 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:56.531 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:34:56.531 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 40, 2024-09-10T16:34:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 306465, 2024-09-10T16:34:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:34:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:34:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:34:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:34:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:34:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:34:56.532 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-09-10T16:34:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:34:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:34:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:56.533 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:34:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:34:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:56.534 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.535 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:34:56.536 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:34:56.536 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:34:56.536 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:34:56.536 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:34:56.536 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:34:56.536 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:56.536 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:34:56.536 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:34:56.536 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:34:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:34:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:34:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:34:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:34:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:34:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:34:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:34:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:34:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:34:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:34:56.537 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:34:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:34:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:34:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:34:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:34:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:34:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:34:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:34:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:34:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:34:56.538 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:34:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:34:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:34:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.539 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:34:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:34:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:56.540 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:34:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:34:56.541 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:34:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:56.542 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:34:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:34:56.543 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:34:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:34:56.544 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:34:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:34:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:34:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:56.545 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.546 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:34:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:34:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:34:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.547 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:34:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:34:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:34:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:34:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:56.548 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:34:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:34:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:34:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.549 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:34:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:34:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:34:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.550 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:34:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:34:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:34:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:34:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:56.551 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:34:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:34:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:34:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:34:56.552 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:34:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:34:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:34:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:34:56.553 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:34:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:34:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:34:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:34:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:34:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:34:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:34:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:56.554 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:34:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:34:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:34:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:34:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:34:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:34:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:34:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.555 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:34:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:34:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-09-10T16:34:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:34:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:34:56.556 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:34:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:34:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:34:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4 2024-09-10T16:34:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:34:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:34:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:34:56.557 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:34:56.557 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:34:56.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f848f1cf640 1 -- 172.21.15.81:0/3515320623 >> v1:172.21.15.189:6812/1108603242 conn(0x7f847403e2a0 legacy=0x7f8474040760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:56.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f848f1cf640 10 monclient: shutdown 2024-09-10T16:34:56.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f848f1cf640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:34:56.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f848f1cf640 1 -- 172.21.15.81:0/3515320623 >> v1:172.21.15.81:6791/0 conn(0x7f84881d16c0 legacy=0x7f84881d3ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:34:56.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f848d76c640 1 -- 172.21.15.81:0/3515320623 reap_dead start 2024-09-10T16:34:56.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f848d76c640 1 -- 172.21.15.81:0/3515320623 reap_dead start 2024-09-10T16:34:56.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f848f1cf640 1 -- 172.21.15.81:0/3515320623 shutdown_connections 2024-09-10T16:34:56.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f848f1cf640 1 -- 172.21.15.81:0/3515320623 >> 172.21.15.81:0/3515320623 conn(0x7f84880a8240 msgr2=0x7f84880a5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:34:56.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f848f1cf640 1 -- 172.21.15.81:0/3515320623 shutdown_connections 2024-09-10T16:34:56.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:34:56.504+0000 7f848f1cf640 1 -- 172.21.15.81:0/3515320623 wait complete. 2024-09-10T16:34:56.560 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 5 2024-09-10T16:34:56.560 INFO:tasks.mon_thrash.mon_thrasher:waiting for 90.0 secs before reviving monitors 2024-09-10T16:34:58.609 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:58.610 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31393]: starting. 2024-09-10T16:34:58.610 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31393]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31358 2024-09-10T16:34:58.610 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31393]: created object 0... 2024-09-10T16:34:58.610 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31393]: created object 25... 2024-09-10T16:34:58.610 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31393]: created object 49... 2024-09-10T16:34:58.610 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31393]: finishing. 2024-09-10T16:34:58.610 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31393]: shutting down. 2024-09-10T16:34:58.637 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:58.637 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31395]: starting. 2024-09-10T16:34:58.637 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31395]: listing objects. 2024-09-10T16:34:58.637 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31395]: listed object 0... 2024-09-10T16:34:58.637 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31395]: listed object 25... 2024-09-10T16:34:58.637 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31395]: saw 50 objects 2024-09-10T16:34:58.637 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31395]: shutting down. 2024-09-10T16:34:59.364 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:59.364 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31394]: starting. 2024-09-10T16:34:59.364 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31394]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31358 2024-09-10T16:34:59.364 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31394]: shutting down. 2024-09-10T16:34:59.367 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:59.368 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:34:59.368 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:34:59.372 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:35:01.337 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31446]: starting. 2024-09-10T16:35:01.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31446]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31445 2024-09-10T16:35:01.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31446]: created object 0... 2024-09-10T16:35:01.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31446]: created object 25... 2024-09-10T16:35:01.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31446]: created object 49... 2024-09-10T16:35:01.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31446]: finishing. 2024-09-10T16:35:01.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31446]: shutting down. 2024-09-10T16:35:03.180 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31447]: starting. 2024-09-10T16:35:03.180 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31447]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31445 2024-09-10T16:35:03.180 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31447]: shutting down. 2024-09-10T16:35:05.369 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:05.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31483]: starting. 2024-09-10T16:35:05.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31483]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31445 2024-09-10T16:35:05.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31483]: created object 0... 2024-09-10T16:35:05.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31483]: created object 25... 2024-09-10T16:35:05.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31483]: created object 49... 2024-09-10T16:35:05.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31483]: finishing. 2024-09-10T16:35:05.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31483]: shutting down. 2024-09-10T16:35:05.397 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:05.397 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31485]: starting. 2024-09-10T16:35:05.397 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31485]: listing objects. 2024-09-10T16:35:05.397 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31485]: listed object 0... 2024-09-10T16:35:05.397 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31485]: listed object 25... 2024-09-10T16:35:05.397 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31485]: saw 50 objects 2024-09-10T16:35:05.397 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31485]: shutting down. 2024-09-10T16:35:06.204 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:06.204 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31484]: starting. 2024-09-10T16:35:06.204 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31484]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31445 2024-09-10T16:35:06.204 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31484]: shutting down. 2024-09-10T16:35:06.207 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:06.207 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:06.207 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:35:06.211 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:35:08.626 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31536]: starting. 2024-09-10T16:35:08.627 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31536]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31535 2024-09-10T16:35:08.627 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31536]: created object 0... 2024-09-10T16:35:08.627 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31536]: created object 25... 2024-09-10T16:35:08.627 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31536]: created object 49... 2024-09-10T16:35:08.627 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31536]: finishing. 2024-09-10T16:35:08.627 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31536]: shutting down. 2024-09-10T16:35:09.450 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31537]: starting. 2024-09-10T16:35:09.450 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31537]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31535 2024-09-10T16:35:09.450 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31537]: shutting down. 2024-09-10T16:35:11.338 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:11.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31570]: starting. 2024-09-10T16:35:11.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31570]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31535 2024-09-10T16:35:11.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31570]: created object 0... 2024-09-10T16:35:11.338 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31570]: created object 25... 2024-09-10T16:35:11.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31570]: created object 49... 2024-09-10T16:35:11.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31570]: finishing. 2024-09-10T16:35:11.339 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31570]: shutting down. 2024-09-10T16:35:11.367 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:11.367 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31572]: starting. 2024-09-10T16:35:11.367 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31572]: listing objects. 2024-09-10T16:35:11.367 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31572]: listed object 0... 2024-09-10T16:35:11.367 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31572]: listed object 25... 2024-09-10T16:35:11.367 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31572]: saw 50 objects 2024-09-10T16:35:11.367 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31572]: shutting down. 2024-09-10T16:35:12.172 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:12.172 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31571]: starting. 2024-09-10T16:35:12.172 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31571]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31535 2024-09-10T16:35:12.172 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31571]: shutting down. 2024-09-10T16:35:12.176 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:12.177 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:12.177 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:35:12.180 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:35:14.361 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31623]: starting. 2024-09-10T16:35:14.361 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31623]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31622 2024-09-10T16:35:14.361 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31623]: created object 0... 2024-09-10T16:35:14.361 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31623]: created object 25... 2024-09-10T16:35:14.361 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31623]: created object 49... 2024-09-10T16:35:14.361 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31623]: finishing. 2024-09-10T16:35:14.361 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31623]: shutting down. 2024-09-10T16:35:15.184 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31624]: starting. 2024-09-10T16:35:15.184 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31624]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31622 2024-09-10T16:35:15.184 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31624]: shutting down. 2024-09-10T16:35:17.427 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:17.428 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31657]: starting. 2024-09-10T16:35:17.428 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31657]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31622 2024-09-10T16:35:17.428 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31657]: created object 0... 2024-09-10T16:35:17.428 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31657]: created object 25... 2024-09-10T16:35:17.428 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31657]: created object 49... 2024-09-10T16:35:17.428 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31657]: finishing. 2024-09-10T16:35:17.428 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31657]: shutting down. 2024-09-10T16:35:17.455 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:17.455 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31659]: starting. 2024-09-10T16:35:17.455 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31659]: listing objects. 2024-09-10T16:35:17.455 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31659]: listed object 0... 2024-09-10T16:35:17.455 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31659]: listed object 25... 2024-09-10T16:35:17.455 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31659]: saw 50 objects 2024-09-10T16:35:17.455 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31659]: shutting down. 2024-09-10T16:35:18.253 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:18.253 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31658]: starting. 2024-09-10T16:35:18.253 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31658]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31622 2024-09-10T16:35:18.254 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31658]: shutting down. 2024-09-10T16:35:18.256 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:18.256 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:18.256 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:35:18.260 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:35:20.354 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31710]: starting. 2024-09-10T16:35:20.354 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31710]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31709 2024-09-10T16:35:20.354 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31710]: created object 0... 2024-09-10T16:35:20.354 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31710]: created object 25... 2024-09-10T16:35:20.354 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31710]: created object 49... 2024-09-10T16:35:20.354 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31710]: finishing. 2024-09-10T16:35:20.355 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31710]: shutting down. 2024-09-10T16:35:21.174 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31711]: starting. 2024-09-10T16:35:21.174 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31711]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31709 2024-09-10T16:35:21.174 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31711]: shutting down. 2024-09-10T16:35:23.358 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:23.358 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31744]: starting. 2024-09-10T16:35:23.358 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31744]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31709 2024-09-10T16:35:23.358 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31744]: created object 0... 2024-09-10T16:35:23.359 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31744]: created object 25... 2024-09-10T16:35:23.359 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31744]: created object 49... 2024-09-10T16:35:23.359 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31744]: finishing. 2024-09-10T16:35:23.359 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31744]: shutting down. 2024-09-10T16:35:23.386 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:23.387 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31746]: starting. 2024-09-10T16:35:23.387 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31746]: listing objects. 2024-09-10T16:35:23.387 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31746]: listed object 0... 2024-09-10T16:35:23.387 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31746]: listed object 25... 2024-09-10T16:35:23.387 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31746]: saw 50 objects 2024-09-10T16:35:23.387 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31746]: shutting down. 2024-09-10T16:35:24.175 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:24.176 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31745]: starting. 2024-09-10T16:35:24.176 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31745]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31709 2024-09-10T16:35:24.176 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31745]: shutting down. 2024-09-10T16:35:24.179 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:24.180 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:24.180 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:35:24.184 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:35:26.381 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31797]: starting. 2024-09-10T16:35:26.381 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31797]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31796 2024-09-10T16:35:26.381 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31797]: created object 0... 2024-09-10T16:35:26.381 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31797]: created object 25... 2024-09-10T16:35:26.381 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31797]: created object 49... 2024-09-10T16:35:26.381 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31797]: finishing. 2024-09-10T16:35:26.381 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31797]: shutting down. 2024-09-10T16:35:27.227 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31798]: starting. 2024-09-10T16:35:27.227 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31798]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31796 2024-09-10T16:35:27.227 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31798]: shutting down. 2024-09-10T16:35:29.434 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:29.435 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31831]: starting. 2024-09-10T16:35:29.435 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31831]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31796 2024-09-10T16:35:29.435 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31831]: created object 0... 2024-09-10T16:35:29.435 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31831]: created object 25... 2024-09-10T16:35:29.435 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31831]: created object 49... 2024-09-10T16:35:29.435 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31831]: finishing. 2024-09-10T16:35:29.435 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31831]: shutting down. 2024-09-10T16:35:30.273 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:30.273 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31833]: starting. 2024-09-10T16:35:30.273 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31833]: listing objects. 2024-09-10T16:35:30.273 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31833]: listed object 0... 2024-09-10T16:35:30.273 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31833]: listed object 25... 2024-09-10T16:35:30.273 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31833]: saw 50 objects 2024-09-10T16:35:30.274 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31833]: shutting down. 2024-09-10T16:35:31.267 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:31.267 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31832]: starting. 2024-09-10T16:35:31.267 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31832]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31796 2024-09-10T16:35:31.267 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31832]: shutting down. 2024-09-10T16:35:31.271 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:31.271 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:31.271 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:35:31.274 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:35:33.464 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31884]: starting. 2024-09-10T16:35:33.465 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31884]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31883 2024-09-10T16:35:33.465 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31884]: created object 0... 2024-09-10T16:35:33.465 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31884]: created object 25... 2024-09-10T16:35:33.465 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31884]: created object 49... 2024-09-10T16:35:33.465 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31884]: finishing. 2024-09-10T16:35:33.465 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31884]: shutting down. 2024-09-10T16:35:34.276 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31885]: starting. 2024-09-10T16:35:34.277 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31885]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31883 2024-09-10T16:35:34.277 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31885]: shutting down. 2024-09-10T16:35:36.471 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:36.471 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31918]: starting. 2024-09-10T16:35:36.471 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31918]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31883 2024-09-10T16:35:36.472 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31918]: created object 0... 2024-09-10T16:35:36.472 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31918]: created object 25... 2024-09-10T16:35:36.472 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31918]: created object 49... 2024-09-10T16:35:36.472 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31918]: finishing. 2024-09-10T16:35:36.472 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[31918]: shutting down. 2024-09-10T16:35:36.495 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:36.495 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31920]: starting. 2024-09-10T16:35:36.495 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31920]: listing objects. 2024-09-10T16:35:36.495 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31920]: listed object 0... 2024-09-10T16:35:36.496 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31920]: listed object 25... 2024-09-10T16:35:36.496 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31920]: saw 50 objects 2024-09-10T16:35:36.496 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[31920]: shutting down. 2024-09-10T16:35:37.315 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:37.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31919]: starting. 2024-09-10T16:35:37.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31919]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31883 2024-09-10T16:35:37.315 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[31919]: shutting down. 2024-09-10T16:35:37.318 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:37.318 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:37.318 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:35:37.321 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:35:39.492 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31971]: starting. 2024-09-10T16:35:39.492 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31971]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31970 2024-09-10T16:35:39.492 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31971]: created object 0... 2024-09-10T16:35:39.492 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31971]: created object 25... 2024-09-10T16:35:39.492 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31971]: created object 49... 2024-09-10T16:35:39.492 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31971]: finishing. 2024-09-10T16:35:39.492 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[31971]: shutting down. 2024-09-10T16:35:40.178 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31972]: starting. 2024-09-10T16:35:40.178 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31972]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31970 2024-09-10T16:35:40.178 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[31972]: shutting down. 2024-09-10T16:35:42.369 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:42.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32005]: starting. 2024-09-10T16:35:42.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32005]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-31970 2024-09-10T16:35:42.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32005]: created object 0... 2024-09-10T16:35:42.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32005]: created object 25... 2024-09-10T16:35:42.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32005]: created object 49... 2024-09-10T16:35:42.370 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32005]: finishing. 2024-09-10T16:35:42.370 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32005]: shutting down. 2024-09-10T16:35:42.397 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:42.397 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32007]: starting. 2024-09-10T16:35:42.397 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32007]: listing objects. 2024-09-10T16:35:42.397 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32007]: listed object 0... 2024-09-10T16:35:42.397 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32007]: listed object 25... 2024-09-10T16:35:42.397 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32007]: saw 50 objects 2024-09-10T16:35:42.397 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32007]: shutting down. 2024-09-10T16:35:44.234 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:44.234 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32006]: starting. 2024-09-10T16:35:44.234 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32006]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-31970 2024-09-10T16:35:44.234 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32006]: shutting down. 2024-09-10T16:35:44.239 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:44.239 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:44.239 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:35:44.242 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:35:46.412 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32058]: starting. 2024-09-10T16:35:46.413 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32058]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-32057 2024-09-10T16:35:46.413 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32058]: created object 0... 2024-09-10T16:35:46.413 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32058]: created object 25... 2024-09-10T16:35:46.413 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32058]: created object 49... 2024-09-10T16:35:46.413 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32058]: finishing. 2024-09-10T16:35:46.413 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32058]: shutting down. 2024-09-10T16:35:47.255 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32059]: starting. 2024-09-10T16:35:47.255 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32059]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-32057 2024-09-10T16:35:47.255 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32059]: shutting down. 2024-09-10T16:35:49.488 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:49.489 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32092]: starting. 2024-09-10T16:35:49.489 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32092]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-32057 2024-09-10T16:35:49.489 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32092]: created object 0... 2024-09-10T16:35:49.489 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32092]: created object 25... 2024-09-10T16:35:49.489 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32092]: created object 49... 2024-09-10T16:35:49.489 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32092]: finishing. 2024-09-10T16:35:49.489 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32092]: shutting down. 2024-09-10T16:35:49.518 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:49.518 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32094]: starting. 2024-09-10T16:35:49.519 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32094]: listing objects. 2024-09-10T16:35:49.519 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32094]: listed object 0... 2024-09-10T16:35:49.519 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32094]: listed object 25... 2024-09-10T16:35:49.519 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32094]: saw 50 objects 2024-09-10T16:35:49.519 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32094]: shutting down. 2024-09-10T16:35:50.176 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:50.177 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32093]: starting. 2024-09-10T16:35:50.177 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32093]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-32057 2024-09-10T16:35:50.177 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32093]: shutting down. 2024-09-10T16:35:50.180 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:50.180 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:50.180 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:35:50.184 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:35:52.336 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32145]: starting. 2024-09-10T16:35:52.336 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32145]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-32144 2024-09-10T16:35:52.336 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32145]: created object 0... 2024-09-10T16:35:52.336 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32145]: created object 25... 2024-09-10T16:35:52.336 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32145]: created object 49... 2024-09-10T16:35:52.336 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32145]: finishing. 2024-09-10T16:35:52.337 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32145]: shutting down. 2024-09-10T16:35:53.187 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32146]: starting. 2024-09-10T16:35:53.187 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32146]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-32144 2024-09-10T16:35:53.187 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32146]: shutting down. 2024-09-10T16:35:55.368 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:55.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32179]: starting. 2024-09-10T16:35:55.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32179]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-32144 2024-09-10T16:35:55.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32179]: created object 0... 2024-09-10T16:35:55.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32179]: created object 25... 2024-09-10T16:35:55.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32179]: created object 49... 2024-09-10T16:35:55.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32179]: finishing. 2024-09-10T16:35:55.369 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32179]: shutting down. 2024-09-10T16:35:56.254 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:56.254 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32181]: starting. 2024-09-10T16:35:56.254 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32181]: listing objects. 2024-09-10T16:35:56.254 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32181]: listed object 0... 2024-09-10T16:35:56.254 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32181]: listed object 25... 2024-09-10T16:35:56.254 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32181]: saw 50 objects 2024-09-10T16:35:56.254 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32181]: shutting down. 2024-09-10T16:35:57.234 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:57.234 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32180]: starting. 2024-09-10T16:35:57.234 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32180]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-32144 2024-09-10T16:35:57.234 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32180]: shutting down. 2024-09-10T16:35:57.240 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:57.240 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:35:57.240 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:35:57.242 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:36:02.443 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32232]: starting. 2024-09-10T16:36:02.443 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32232]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-32231 2024-09-10T16:36:02.443 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32232]: created object 0... 2024-09-10T16:36:02.443 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32232]: created object 25... 2024-09-10T16:36:02.443 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32232]: created object 49... 2024-09-10T16:36:02.443 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32232]: finishing. 2024-09-10T16:36:02.443 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32232]: shutting down. 2024-09-10T16:36:03.275 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32233]: starting. 2024-09-10T16:36:03.275 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32233]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-32231 2024-09-10T16:36:03.276 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32233]: shutting down. 2024-09-10T16:36:05.538 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:05.538 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32266]: starting. 2024-09-10T16:36:05.538 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32266]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-32231 2024-09-10T16:36:05.538 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32266]: created object 0... 2024-09-10T16:36:05.538 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32266]: created object 25... 2024-09-10T16:36:05.538 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32266]: created object 49... 2024-09-10T16:36:05.538 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32266]: finishing. 2024-09-10T16:36:05.539 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32266]: shutting down. 2024-09-10T16:36:05.565 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:05.565 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32268]: starting. 2024-09-10T16:36:05.565 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32268]: listing objects. 2024-09-10T16:36:05.565 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32268]: listed object 0... 2024-09-10T16:36:05.565 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32268]: listed object 25... 2024-09-10T16:36:05.565 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32268]: saw 50 objects 2024-09-10T16:36:05.565 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32268]: shutting down. 2024-09-10T16:36:06.355 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:06.356 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32267]: starting. 2024-09-10T16:36:06.356 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32267]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-32231 2024-09-10T16:36:06.356 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32267]: shutting down. 2024-09-10T16:36:06.359 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:06.359 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:06.359 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:36:06.362 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:36:08.531 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32319]: starting. 2024-09-10T16:36:08.531 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32319]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-32318 2024-09-10T16:36:08.531 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32319]: created object 0... 2024-09-10T16:36:08.531 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32319]: created object 25... 2024-09-10T16:36:08.531 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32319]: created object 49... 2024-09-10T16:36:08.532 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32319]: finishing. 2024-09-10T16:36:08.532 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32319]: shutting down. 2024-09-10T16:36:09.377 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32320]: starting. 2024-09-10T16:36:09.377 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32320]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-32318 2024-09-10T16:36:09.377 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32320]: shutting down. 2024-09-10T16:36:11.348 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:11.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32353]: starting. 2024-09-10T16:36:11.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32353]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-32318 2024-09-10T16:36:11.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32353]: created object 0... 2024-09-10T16:36:11.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32353]: created object 25... 2024-09-10T16:36:11.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32353]: created object 49... 2024-09-10T16:36:11.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32353]: finishing. 2024-09-10T16:36:11.348 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32353]: shutting down. 2024-09-10T16:36:11.373 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:11.374 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32355]: starting. 2024-09-10T16:36:11.374 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32355]: listing objects. 2024-09-10T16:36:11.374 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32355]: listed object 0... 2024-09-10T16:36:11.374 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32355]: listed object 25... 2024-09-10T16:36:11.374 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32355]: saw 50 objects 2024-09-10T16:36:11.374 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32355]: shutting down. 2024-09-10T16:36:12.196 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:12.196 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32354]: starting. 2024-09-10T16:36:12.196 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32354]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-32318 2024-09-10T16:36:12.196 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32354]: shutting down. 2024-09-10T16:36:12.199 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:12.199 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:12.199 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:36:12.202 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:36:14.395 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32409]: starting. 2024-09-10T16:36:14.395 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32409]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-32408 2024-09-10T16:36:14.395 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32409]: created object 0... 2024-09-10T16:36:14.395 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32409]: created object 25... 2024-09-10T16:36:14.396 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32409]: created object 49... 2024-09-10T16:36:14.396 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32409]: finishing. 2024-09-10T16:36:14.396 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32409]: shutting down. 2024-09-10T16:36:15.240 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32410]: starting. 2024-09-10T16:36:15.240 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32410]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-32408 2024-09-10T16:36:15.240 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32410]: shutting down. 2024-09-10T16:36:17.448 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:17.448 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32443]: starting. 2024-09-10T16:36:17.448 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32443]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-32408 2024-09-10T16:36:17.448 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32443]: created object 0... 2024-09-10T16:36:17.448 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32443]: created object 25... 2024-09-10T16:36:17.448 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32443]: created object 49... 2024-09-10T16:36:17.449 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32443]: finishing. 2024-09-10T16:36:17.449 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32443]: shutting down. 2024-09-10T16:36:17.478 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:17.478 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32445]: starting. 2024-09-10T16:36:17.478 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32445]: listing objects. 2024-09-10T16:36:17.478 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32445]: listed object 0... 2024-09-10T16:36:17.478 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32445]: listed object 25... 2024-09-10T16:36:17.478 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32445]: saw 50 objects 2024-09-10T16:36:17.478 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32445]: shutting down. 2024-09-10T16:36:19.312 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:19.312 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32444]: starting. 2024-09-10T16:36:19.312 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32444]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-32408 2024-09-10T16:36:19.312 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32444]: shutting down. 2024-09-10T16:36:19.315 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:19.316 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:19.316 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:36:19.318 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:36:21.363 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32496]: starting. 2024-09-10T16:36:21.363 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32496]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-32495 2024-09-10T16:36:21.363 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32496]: created object 0... 2024-09-10T16:36:21.363 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32496]: created object 25... 2024-09-10T16:36:21.364 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32496]: created object 49... 2024-09-10T16:36:21.364 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32496]: finishing. 2024-09-10T16:36:21.364 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32496]: shutting down. 2024-09-10T16:36:22.197 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32497]: starting. 2024-09-10T16:36:22.197 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32497]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-32495 2024-09-10T16:36:22.197 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32497]: shutting down. 2024-09-10T16:36:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32530]: starting. 2024-09-10T16:36:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32530]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-32495 2024-09-10T16:36:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32530]: created object 0... 2024-09-10T16:36:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32530]: created object 25... 2024-09-10T16:36:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32530]: created object 49... 2024-09-10T16:36:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32530]: finishing. 2024-09-10T16:36:24.413 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32530]: shutting down. 2024-09-10T16:36:24.435 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:24.435 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32532]: starting. 2024-09-10T16:36:24.435 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32532]: listing objects. 2024-09-10T16:36:24.435 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32532]: listed object 0... 2024-09-10T16:36:24.435 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32532]: listed object 25... 2024-09-10T16:36:24.435 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32532]: saw 50 objects 2024-09-10T16:36:24.435 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32532]: shutting down. 2024-09-10T16:36:25.221 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:25.222 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32531]: starting. 2024-09-10T16:36:25.222 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32531]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-32495 2024-09-10T16:36:25.222 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32531]: shutting down. 2024-09-10T16:36:25.225 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:25.225 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:25.225 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:36:25.228 DEBUG:teuthology.orchestra.run.smithi189:> sudo TESTDIR=/home/ubuntu/cephtest bash -c ceph_test_rados_delete_pools_parallel 2024-09-10T16:36:26.561 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.f 2024-09-10T16:36:26.561 INFO:tasks.ceph.mon.f:Restarting daemon 2024-09-10T16:36:26.561 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i f 2024-09-10T16:36:26.564 INFO:tasks.ceph.mon.f:Started 2024-09-10T16:36:26.564 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.i 2024-09-10T16:36:26.564 INFO:tasks.ceph.mon.i:Restarting daemon 2024-09-10T16:36:26.564 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i i 2024-09-10T16:36:26.567 INFO:tasks.ceph.mon.i:Started 2024-09-10T16:36:26.567 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.g 2024-09-10T16:36:26.567 INFO:tasks.ceph.mon.g:Restarting daemon 2024-09-10T16:36:26.567 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i g 2024-09-10T16:36:26.569 INFO:tasks.ceph.mon.g:Started 2024-09-10T16:36:26.569 INFO:tasks.mon_thrash.mon_thrasher:reviving mon.h 2024-09-10T16:36:26.569 INFO:tasks.ceph.mon.h:Restarting daemon 2024-09-10T16:36:26.570 DEBUG:teuthology.orchestra.run.smithi189:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i h 2024-09-10T16:36:26.572 INFO:tasks.ceph.mon.h:Started 2024-09-10T16:36:26.572 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-10T16:36:26.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T16:36:26.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 10 monclient: get_monmap_and_config 2024-09-10T16:36:26.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 10 monclient: build_initial_monmap 2024-09-10T16:36:26.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 10 monclient: monmap: 2024-09-10T16:36:26.707 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:26.707 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:26.707 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:26.708097+0000 2024-09-10T16:36:26.707 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:26.708097+0000 2024-09-10T16:36:26.708 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:26.708 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:26.708 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:26.708 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:26.708 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:26.708 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:26.708 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:26.708 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:26.708 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:26.708 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:26.708 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:26.708 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:26.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 1 Processor -- start 2024-09-10T16:36:26.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 1 -- start start 2024-09-10T16:36:26.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 10 monclient: init 2024-09-10T16:36:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 10 monclient: _add_conns ranks=[3,7,2,1,0,5,8,4,6] 2024-09-10T16:36:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 10 monclient(hunting): picked mon.noname-g con 0x7f30e00a5510 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 10 monclient(hunting): picked mon.noname-i con 0x7f30e0135bf0 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 10 monclient(hunting): picked mon.noname-b con 0x7f30e0136060 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e009d7e0 con 0x7f30e0136060 2024-09-10T16:36:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e009dac0 con 0x7f30e00a5510 2024-09-10T16:36:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e009dda0 con 0x7f30e0135bf0 2024-09-10T16:36:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30e54a9640 10 monclient(hunting): authenticate will time out at 1354.107650s 2024-09-10T16:36:26.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30df7fe640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f30e0136060 0x7f30e0141560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:60652/0 (socket says 172.21.15.81:60652) 2024-09-10T16:36:26.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:26.703+0000 7f30df7fe640 1 -- 172.21.15.81:0/874161788 learned_addr learned my addr 172.21.15.81:0/874161788 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:29.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 10 monclient(hunting): tick 2024-09-10T16:36:29.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 10 monclient(hunting): _check_auth_tickets 2024-09-10T16:36:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 1 monclient(hunting): continuing hunt 2024-09-10T16:36:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 10 monclient(hunting): _reopen_session rank -1 2024-09-10T16:36:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 1 -- 172.21.15.81:0/874161788 >> v1:172.21.15.189:6792/0 conn(0x7f30e0135bf0 legacy=0x7f30e013de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 1 -- 172.21.15.81:0/874161788 >> v1:172.21.15.189:6790/0 conn(0x7f30e00a5510 legacy=0x7f30e00a58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 1 -- 172.21.15.81:0/874161788 >> v1:172.21.15.81:6790/0 conn(0x7f30e0136060 legacy=0x7f30e0141560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 10 monclient: _add_conns ranks=[4,6,0,8,5,1] 2024-09-10T16:36:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 10 monclient(hunting): picked mon.noname-c con 0x7f30c0003820 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 10 monclient(hunting): picked mon.noname-d con 0x7f30c00074b0 addr v1:172.21.15.81:6792/0 2024-09-10T16:36:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 10 monclient(hunting): picked mon.noname-a con 0x7f30c000b240 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 1 -- 172.21.15.81:0/874161788 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e009cca0 con 0x7f30c000b240 2024-09-10T16:36:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 1 -- 172.21.15.81:0/874161788 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30c0010020 con 0x7f30c0003820 2024-09-10T16:36:29.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 1 -- 172.21.15.81:0/874161788 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30c00112a0 con 0x7f30c00074b0 2024-09-10T16:36:29.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:29.703+0000 7f30dd7fa640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:31.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.719+0000 7f30de7fc640 1 -- 172.21.15.81:0/874161788 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3538913602 0 0) 0x7f30c00112a0 con 0x7f30c00074b0 2024-09-10T16:36:31.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.719+0000 7f30de7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:36:31.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.719+0000 7f30de7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:31.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.719+0000 7f30de7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:31.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.719+0000 7f30de7fc640 10 monclient(hunting): my global_id is 144699 2024-09-10T16:36:31.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.719+0000 7f30de7fc640 1 -- 172.21.15.81:0/874161788 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30cc003530 con 0x7f30c00074b0 2024-09-10T16:36:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.719+0000 7f30de7fc640 1 -- 172.21.15.81:0/874161788 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 543999783 0 0) 0x7f30cc003530 con 0x7f30c00074b0 2024-09-10T16:36:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.719+0000 7f30de7fc640 1 -- 172.21.15.81:0/874161788 >> v1:172.21.15.81:6791/0 conn(0x7f30c0003820 legacy=0x7f30c0005c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.719+0000 7f30de7fc640 1 -- 172.21.15.81:0/874161788 >> v1:172.21.15.81:6789/0 conn(0x7f30c000b240 legacy=0x7f30c000d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.719+0000 7f30de7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:36:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.719+0000 7f30de7fc640 1 monclient: found mon.noname-d 2024-09-10T16:36:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.719+0000 7f30df7fe640 1 -- 172.21.15.81:0/874161788 reap_dead start 2024-09-10T16:36:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.719+0000 7f30de7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:36:31.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 1 -- 172.21.15.81:0/874161788 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30c0012520 con 0x7f30c00074b0 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 10 monclient: _finish_auth 0 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 1 -- 172.21.15.81:0/874161788 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f30c8001880 con 0x7f30c00074b0 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 10 monclient: dump: 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:31.726 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:31.727 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30e54a9640 5 monclient: authenticate success, global_id 144699 2024-09-10T16:36:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30e54a9640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 1 -- 172.21.15.81:0/874161788 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f30c8001b10 con 0x7f30c00074b0 2024-09-10T16:36:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:31.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 1 -- 172.21.15.81:0/874161788 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f30c8001d40 con 0x7f30c00074b0 2024-09-10T16:36:31.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:31.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:36:31.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30de7fc640 10 monclient: dump: 2024-09-10T16:36:31.728 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:31.728 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:31.728 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:31.728 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:31.728 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:31.728 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:31.728 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:31.728 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:31.728 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:31.729 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:31.729 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:31.729 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:31.729 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:31.729 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:31.729 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:31.729 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:31.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30e54a9640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:31.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30e54a9640 4 set_mon_vals no callback set 2024-09-10T16:36:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30e54a9640 10 monclient: shutdown 2024-09-10T16:36:31.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30e54a9640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30e54a9640 1 -- 172.21.15.81:0/874161788 >> v1:172.21.15.81:6792/0 conn(0x7f30c00074b0 legacy=0x7f30c0009970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30e54a9640 1 -- 172.21.15.81:0/874161788 shutdown_connections 2024-09-10T16:36:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30e54a9640 1 -- 172.21.15.81:0/874161788 >> 172.21.15.81:0/874161788 conn(0x7f30e006dae0 msgr2=0x7f30e00ab8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30e54a9640 1 -- 172.21.15.81:0/874161788 shutdown_connections 2024-09-10T16:36:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30e54a9640 1 -- 172.21.15.81:0/874161788 wait complete. 2024-09-10T16:36:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30e54a9640 10 monclient: build_initial_monmap 2024-09-10T16:36:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.723+0000 7f30e54a9640 10 monclient: monmap: 2024-09-10T16:36:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:31.734 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:31.735 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 1 Processor -- start 2024-09-10T16:36:31.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 1 -- start start 2024-09-10T16:36:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 10 monclient: init 2024-09-10T16:36:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 10 monclient: _add_conns ranks=[2,0,7,4,1,5,3,8,6] 2024-09-10T16:36:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 10 monclient(hunting): picked mon.noname-b con 0x7f30c00074b0 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 10 monclient(hunting): picked mon.noname-a con 0x7f30e01cda90 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 10 monclient(hunting): picked mon.noname-i con 0x7f30e0132900 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e00a6b30 con 0x7f30e01cda90 2024-09-10T16:36:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e0126940 con 0x7f30c00074b0 2024-09-10T16:36:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30e0126c20 con 0x7f30e0132900 2024-09-10T16:36:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:31.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 10 monclient(hunting): authenticate will time out at 1359.129620s 2024-09-10T16:36:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30deffd640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f30c00074b0 0x7f30e01321f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:60668/0 (socket says 172.21.15.81:60668) 2024-09-10T16:36:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d7fff640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f30e01cda90 0x7f30e01d2b90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:52844/0 (socket says 172.21.15.81:52844) 2024-09-10T16:36:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30deffd640 1 -- 172.21.15.81:0/2253004992 learned_addr learned my addr 172.21.15.81:0/2253004992 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2159765708 0 0) 0x7f30c0012520 con 0x7f30e01cda90 2024-09-10T16:36:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient(hunting): my global_id is 6471 2024-09-10T16:36:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30c00101f0 con 0x7f30e01cda90 2024-09-10T16:36:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 914189554 0 0) 0x7f30c00101f0 con 0x7f30e01cda90 2024-09-10T16:36:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f30c0012520 con 0x7f30e01cda90 2024-09-10T16:36:31.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f30c8003940 con 0x7f30e01cda90 2024-09-10T16:36:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:36:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient(hunting): dump: 2024-09-10T16:36:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:31.738 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:31.739 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3856421445 0 0) 0x7f30c0012520 con 0x7f30e01cda90 2024-09-10T16:36:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 >> v1:172.21.15.189:6792/0 conn(0x7f30e0132900 legacy=0x7f30e01d62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 >> v1:172.21.15.81:6790/0 conn(0x7f30c00074b0 legacy=0x7f30e01321f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient: _finish_hunting 0 2024-09-10T16:36:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 1 monclient: found mon.a 2024-09-10T16:36:31.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30e00a8b10 con 0x7f30e01cda90 2024-09-10T16:36:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient: _finish_auth 0 2024-09-10T16:36:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient: _check_auth_tickets 2024-09-10T16:36:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 5 monclient: authenticate success, global_id 6471 2024-09-10T16:36:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 10 monclient: _renew_subs 2024-09-10T16:36:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 1 -- 172.21.15.81:0/2253004992 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f30e0125420 con 0x7f30e01cda90 2024-09-10T16:36:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 10 monclient: _renew_subs 2024-09-10T16:36:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30e54a9640 1 -- 172.21.15.81:0/2253004992 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f30e01d7bb0 con 0x7f30e01cda90 2024-09-10T16:36:31.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f30c8001cc0 con 0x7f30e01cda90 2024-09-10T16:36:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f30c8004150 con 0x7f30e01cda90 2024-09-10T16:36:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30ddffb640 4 set_mon_vals no callback set 2024-09-10T16:36:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.727+0000 7f30d77fe640 10 monclient: dump: 2024-09-10T16:36:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:31.741 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:31.742 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.731+0000 7f30e54a9640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.731+0000 7f30e54a9640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.731+0000 7f30e54a9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:31.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.731+0000 7f30e54a9640 1 -- 172.21.15.81:0/2253004992 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30c4005090 con 0x7f30e01cda90 2024-09-10T16:36:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.731+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f30c8011500 con 0x7f30e01cda90 2024-09-10T16:36:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.731+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(319..319 src has 121..319) ==== 3898+0+0 (unknown 378483932 0 0) 0x7f30c804b010 con 0x7f30e01cda90 2024-09-10T16:36:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.731+0000 7f30deffd640 10 monclient: get_auth_request con 0x7f30c003e380 auth_method 0 2024-09-10T16:36:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.735+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f30e00a6b30 con 0x7f30e01cda90 2024-09-10T16:36:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.735+0000 7f30d77fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:31.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:31.735+0000 7f30d77fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:31.936 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32583]: starting. 2024-09-10T16:36:31.936 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32583]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-32582 2024-09-10T16:36:31.936 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32583]: created object 0... 2024-09-10T16:36:31.936 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32583]: created object 25... 2024-09-10T16:36:31.936 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32583]: created object 49... 2024-09-10T16:36:31.937 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32583]: finishing. 2024-09-10T16:36:31.937 INFO:teuthology.orchestra.run.smithi189.stdout:process_1_[32583]: shutting down. 2024-09-10T16:36:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.007+0000 7f30e54a9640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-10T16:36:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.007+0000 7f30e54a9640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-10T16:36:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.007+0000 7f30e54a9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.007+0000 7f30e54a9640 1 -- 172.21.15.81:0/2253004992 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f30c4005380 con 0x7f30e01cda90 2024-09-10T16:36:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.011+0000 7f30d77fe640 1 -- 172.21.15.81:0/2253004992 <== mon.0 v1:172.21.15.81:6789/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2717 (unknown 254746657 0 3892788496) 0x7f30c8016db0 con 0x7f30e01cda90 2024-09-10T16:36:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.011+0000 7f30d77fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-10T16:36:32.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.011+0000 7f30d77fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:36:32.013 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":42,"quorum":[0,1,2,3,4,6,8],"quorum_names":["a","f","b","g","c","d","e"],"quorum_leader_name":"a","quorum_age":0,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","modified":"2024-09-10T16:29:22.909160Z","created":"2024-09-10T16:29:22.909160Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6790","nonce":0}]},"addr":"172.21.15.189:6790/0","public_addr":"172.21.15.189:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6791","nonce":0}]},"addr":"172.21.15.81:6791/0","public_addr":"172.21.15.81:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6791","nonce":0}]},"addr":"172.21.15.189:6791/0","public_addr":"172.21.15.189:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6792","nonce":0}]},"addr":"172.21.15.81:6792/0","public_addr":"172.21.15.81:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6792","nonce":0}]},"addr":"172.21.15.189:6792/0","public_addr":"172.21.15.189:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6793","nonce":0}]},"addr":"172.21.15.81:6793/0","public_addr":"172.21.15.81:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T16:36:32.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.011+0000 7f30e54a9640 1 -- 172.21.15.81:0/2253004992 >> v1:172.21.15.189:6812/1108603242 conn(0x7f30c003e380 legacy=0x7f30c0040840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.011+0000 7f30e54a9640 10 monclient: shutdown 2024-09-10T16:36:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.011+0000 7f30e54a9640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.011+0000 7f30e54a9640 1 -- 172.21.15.81:0/2253004992 >> v1:172.21.15.81:6789/0 conn(0x7f30e01cda90 legacy=0x7f30e01d2b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.011+0000 7f30e54a9640 1 -- 172.21.15.81:0/2253004992 shutdown_connections 2024-09-10T16:36:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.011+0000 7f30e54a9640 1 -- 172.21.15.81:0/2253004992 >> 172.21.15.81:0/2253004992 conn(0x7f30e006dae0 msgr2=0x7f30e0133430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.011+0000 7f30e54a9640 1 -- 172.21.15.81:0/2253004992 shutdown_connections 2024-09-10T16:36:32.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:32.011+0000 7f30e54a9640 1 -- 172.21.15.81:0/2253004992 wait complete. 2024-09-10T16:36:32.802 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32584]: starting. 2024-09-10T16:36:32.802 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32584]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-32582 2024-09-10T16:36:32.802 INFO:teuthology.orchestra.run.smithi189.stdout:process_2_[32584]: shutting down. 2024-09-10T16:36:35.031 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T16:36:35.095 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:35.095 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32785]: starting. 2024-09-10T16:36:35.095 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32785]: creating pool ceph_test_rados_delete_pools_parallel.smithi189-32582 2024-09-10T16:36:35.095 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32785]: created object 0... 2024-09-10T16:36:35.095 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32785]: created object 25... 2024-09-10T16:36:35.095 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32785]: created object 49... 2024-09-10T16:36:35.095 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32785]: finishing. 2024-09-10T16:36:35.095 INFO:teuthology.orchestra.run.smithi189.stdout:process_3_[32785]: shutting down. 2024-09-10T16:36:35.118 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:35.118 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32787]: starting. 2024-09-10T16:36:35.118 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32787]: listing objects. 2024-09-10T16:36:35.118 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32787]: listed object 0... 2024-09-10T16:36:35.119 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32787]: listed object 25... 2024-09-10T16:36:35.119 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32787]: saw 50 objects 2024-09-10T16:36:35.119 INFO:teuthology.orchestra.run.smithi189.stdout:process_5_[32787]: shutting down. 2024-09-10T16:36:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 10 monclient: get_monmap_and_config 2024-09-10T16:36:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 10 monclient: build_initial_monmap 2024-09-10T16:36:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 10 monclient: monmap: 2024-09-10T16:36:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:35.163792+0000 2024-09-10T16:36:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:35.163792+0000 2024-09-10T16:36:35.162 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:35.163 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:35.163 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 1 Processor -- start 2024-09-10T16:36:35.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 1 -- start start 2024-09-10T16:36:35.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 10 monclient: init 2024-09-10T16:36:35.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 10 monclient: _add_conns ranks=[2,7,3,4,6,5,1,8,0] 2024-09-10T16:36:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 10 monclient(hunting): picked mon.noname-b con 0x7f001c0a0a90 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 10 monclient(hunting): picked mon.noname-i con 0x7f001c0a35f0 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 10 monclient(hunting): picked mon.noname-g con 0x7f001c0a3a40 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f001c09df70 con 0x7f001c0a0a90 2024-09-10T16:36:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f001c09fa30 con 0x7f001c0a3a40 2024-09-10T16:36:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f001c09fd10 con 0x7f001c0a35f0 2024-09-10T16:36:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f002119c640 10 monclient(hunting): authenticate will time out at 1362.563161s 2024-09-10T16:36:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f001ad9d640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f001c0a0a90 0x7f001c0a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34102/0 (socket says 172.21.15.81:34102) 2024-09-10T16:36:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f001ad9d640 1 -- 172.21.15.81:0/1710774659 learned_addr learned my addr 172.21.15.81:0/1710774659 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f0019d9b640 1 -- 172.21.15.81:0/1710774659 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3684755587 0 0) 0x7f001c09df70 con 0x7f001c0a0a90 2024-09-10T16:36:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f0019d9b640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f0019d9b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f0019d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f0019d9b640 10 monclient(hunting): my global_id is 144875 2024-09-10T16:36:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.159+0000 7f0019d9b640 1 -- 172.21.15.81:0/1710774659 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0004003530 con 0x7f001c0a0a90 2024-09-10T16:36:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 1 -- 172.21.15.81:0/1710774659 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 304134134 0 0) 0x7f001c09fd10 con 0x7f001c0a35f0 2024-09-10T16:36:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient(hunting): my global_id is 164104 2024-09-10T16:36:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 1 -- 172.21.15.81:0/1710774659 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f001c09df70 con 0x7f001c0a35f0 2024-09-10T16:36:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 1 -- 172.21.15.81:0/1710774659 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3362263525 0 0) 0x7f001c09fa30 con 0x7f001c0a3a40 2024-09-10T16:36:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient(hunting): my global_id is 164109 2024-09-10T16:36:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 1 -- 172.21.15.81:0/1710774659 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f001c09fd10 con 0x7f001c0a3a40 2024-09-10T16:36:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 1 -- 172.21.15.81:0/1710774659 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3033605518 0 0) 0x7f0004003530 con 0x7f001c0a0a90 2024-09-10T16:36:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 1 -- 172.21.15.81:0/1710774659 >> v1:172.21.15.189:6792/0 conn(0x7f001c0a35f0 legacy=0x7f001c13c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 1 -- 172.21.15.81:0/1710774659 >> v1:172.21.15.189:6790/0 conn(0x7f001c0a3a40 legacy=0x7f001c13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient: _finish_hunting 0 2024-09-10T16:36:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 1 monclient: found mon.noname-b 2024-09-10T16:36:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:36:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 1 -- 172.21.15.81:0/1710774659 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c09fff0 con 0x7f001c0a0a90 2024-09-10T16:36:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient: _finish_auth 0 2024-09-10T16:36:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient: _check_auth_tickets 2024-09-10T16:36:35.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:35.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 1 -- 172.21.15.81:0/1710774659 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0010001860 con 0x7f001c0a0a90 2024-09-10T16:36:35.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:35.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient: dump: 2024-09-10T16:36:35.173 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.173 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.173 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.173 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.173 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.173 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.174 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 5 monclient: authenticate success, global_id 144875 2024-09-10T16:36:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 1 -- 172.21.15.81:0/1710774659 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0010001a00 con 0x7f001c0a0a90 2024-09-10T16:36:35.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 1 -- 172.21.15.81:0/1710774659 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0010004bf0 con 0x7f001c0a0a90 2024-09-10T16:36:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f0019d9b640 10 monclient: dump: 2024-09-10T16:36:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.175 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.176 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 4 set_mon_vals no callback set 2024-09-10T16:36:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient: shutdown 2024-09-10T16:36:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 1 -- 172.21.15.81:0/1710774659 >> v1:172.21.15.81:6790/0 conn(0x7f001c0a0a90 legacy=0x7f001c0a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 1 -- 172.21.15.81:0/1710774659 shutdown_connections 2024-09-10T16:36:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 1 -- 172.21.15.81:0/1710774659 >> 172.21.15.81:0/1710774659 conn(0x7f001c0a3fd0 msgr2=0x7f001c0a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 1 -- 172.21.15.81:0/1710774659 shutdown_connections 2024-09-10T16:36:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 1 -- 172.21.15.81:0/1710774659 wait complete. 2024-09-10T16:36:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient: build_initial_monmap 2024-09-10T16:36:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient: monmap: 2024-09-10T16:36:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:35.177 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:35.178 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 1 Processor -- start 2024-09-10T16:36:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 1 -- start start 2024-09-10T16:36:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient: init 2024-09-10T16:36:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient: _add_conns ranks=[1,8,2,0,5,6,3,7,4] 2024-09-10T16:36:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient(hunting): picked mon.noname-f con 0x7f001c0a0a90 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient(hunting): picked mon.noname-e con 0x7f001c0a35f0 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient(hunting): picked mon.noname-b con 0x7f001c0a3a40 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f001c094ac0 con 0x7f001c0a0a90 2024-09-10T16:36:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f001c1cbf80 con 0x7f001c0a3a40 2024-09-10T16:36:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f001c096e20 con 0x7f001c0a35f0 2024-09-10T16:36:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient(hunting): authenticate will time out at 1362.566696s 2024-09-10T16:36:35.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f001b59e640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f001c0a3a40 0x7f001c1d4360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34116/0 (socket says 172.21.15.81:34116) 2024-09-10T16:36:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f001b59e640 1 -- 172.21.15.81:0/3995908472 learned_addr learned my addr 172.21.15.81:0/3995908472 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2956742595 0 0) 0x7f001c1cbf80 con 0x7f001c0a3a40 2024-09-10T16:36:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): my global_id is 144884 2024-09-10T16:36:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0008003530 con 0x7f001c0a3a40 2024-09-10T16:36:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2530609336 0 0) 0x7f001c096e20 con 0x7f001c0a35f0 2024-09-10T16:36:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): my global_id is 6524 2024-09-10T16:36:35.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f001c1cbf80 con 0x7f001c0a35f0 2024-09-10T16:36:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3364748978 0 0) 0x7f0008003530 con 0x7f001c0a3a40 2024-09-10T16:36:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f001c096e20 con 0x7f001c0a3a40 2024-09-10T16:36:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0014001e20 con 0x7f001c0a3a40 2024-09-10T16:36:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): dump: 2024-09-10T16:36:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.181 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.182 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1912909673 0 0) 0x7f001c1cbf80 con 0x7f001c0a35f0 2024-09-10T16:36:35.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0008003530 con 0x7f001c0a35f0 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f000c001b20 con 0x7f001c0a35f0 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): dump: 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.183 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.184 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.184 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.184 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.184 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.184 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 174686237 0 0) 0x7f001c094ac0 con 0x7f001c0a0a90 2024-09-10T16:36:35.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient(hunting): my global_id is 164098 2024-09-10T16:36:35.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f001c1cbf80 con 0x7f001c0a0a90 2024-09-10T16:36:35.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1184388952 0 0) 0x7f001c096e20 con 0x7f001c0a3a40 2024-09-10T16:36:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 >> v1:172.21.15.81:6793/0 conn(0x7f001c0a35f0 legacy=0x7f001c1d0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 >> v1:172.21.15.189:6789/0 conn(0x7f001c0a0a90 legacy=0x7f001c09a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient: _finish_hunting 0 2024-09-10T16:36:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 monclient: found mon.b 2024-09-10T16:36:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f001c095ae0 con 0x7f001c0a3a40 2024-09-10T16:36:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient: _finish_auth 0 2024-09-10T16:36:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient: _check_auth_tickets 2024-09-10T16:36:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 5 monclient: authenticate success, global_id 144884 2024-09-10T16:36:35.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient: _renew_subs 2024-09-10T16:36:35.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:35.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 1 -- 172.21.15.81:0/3995908472 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f001c096580 con 0x7f001c0a3a40 2024-09-10T16:36:35.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient: _renew_subs 2024-09-10T16:36:35.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:35.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f002119c640 1 -- 172.21.15.81:0/3995908472 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f001c09aa80 con 0x7f001c0a3a40 2024-09-10T16:36:35.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f00140020c0 con 0x7f001c0a3a40 2024-09-10T16:36:35.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:35.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0014003f90 con 0x7f001c0a3a40 2024-09-10T16:36:35.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f001959a640 4 set_mon_vals no callback set 2024-09-10T16:36:35.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:35.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.163+0000 7f00037fe640 10 monclient: dump: 2024-09-10T16:36:35.186 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.186 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.187 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.187 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.187 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.187 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.187 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.187 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.187 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.187 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.187 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.187 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.187 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.187 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.187 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.188 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.167+0000 7f002119c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:35.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.167+0000 7f002119c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:35.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.167+0000 7f002119c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:35.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.167+0000 7f002119c640 1 -- 172.21.15.81:0/3995908472 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efffc005090 con 0x7f001c0a3a40 2024-09-10T16:36:35.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.167+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f00140041b0 con 0x7f001c0a3a40 2024-09-10T16:36:35.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.167+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(323..323 src has 121..323) ==== 3898+0+0 (unknown 2315862761 0 0) 0x7f001404b0e0 con 0x7f001c0a3a40 2024-09-10T16:36:35.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.167+0000 7f001ad9d640 10 monclient: get_auth_request con 0x7f000803d750 auth_method 0 2024-09-10T16:36:35.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.171+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f0014016f80 con 0x7f001c0a3a40 2024-09-10T16:36:35.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.171+0000 7f00037fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:35.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.171+0000 7f00037fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:35.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f002119c640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-10T16:36:35.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f002119c640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-10T16:36:35.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f002119c640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:35.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f002119c640 1 -- 172.21.15.81:0/3995908472 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7efffc005380 con 0x7f001c0a3a40 2024-09-10T16:36:35.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f00037fe640 1 -- 172.21.15.81:0/3995908472 <== mon.2 v1:172.21.15.81:6790/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 195692261) 0x7f001401fd30 con 0x7f001c0a3a40 2024-09-10T16:36:35.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f00037fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-10T16:36:35.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f00037fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:36:35.413 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":44,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":2,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","modified":"2024-09-10T16:29:22.909160Z","created":"2024-09-10T16:29:22.909160Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6790","nonce":0}]},"addr":"172.21.15.189:6790/0","public_addr":"172.21.15.189:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6791","nonce":0}]},"addr":"172.21.15.81:6791/0","public_addr":"172.21.15.81:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6791","nonce":0}]},"addr":"172.21.15.189:6791/0","public_addr":"172.21.15.189:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6792","nonce":0}]},"addr":"172.21.15.81:6792/0","public_addr":"172.21.15.81:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6792","nonce":0}]},"addr":"172.21.15.189:6792/0","public_addr":"172.21.15.189:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6793","nonce":0}]},"addr":"172.21.15.81:6793/0","public_addr":"172.21.15.81:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T16:36:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f002119c640 1 -- 172.21.15.81:0/3995908472 >> v1:172.21.15.189:6812/1108603242 conn(0x7f000803d750 legacy=0x7f000803fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f002119c640 10 monclient: shutdown 2024-09-10T16:36:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f002119c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f002119c640 1 -- 172.21.15.81:0/3995908472 >> v1:172.21.15.81:6790/0 conn(0x7f001c0a3a40 legacy=0x7f001c1d4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f002119c640 1 -- 172.21.15.81:0/3995908472 shutdown_connections 2024-09-10T16:36:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f002119c640 1 -- 172.21.15.81:0/3995908472 >> 172.21.15.81:0/3995908472 conn(0x7f001c0a3fd0 msgr2=0x7f001c0741e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f002119c640 1 -- 172.21.15.81:0/3995908472 shutdown_connections 2024-09-10T16:36:35.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.411+0000 7f002119c640 1 -- 172.21.15.81:0/3995908472 wait complete. 2024-09-10T16:36:35.431 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-10T16:36:35.431 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon a 2024-09-10T16:36:35.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.a mon_status 2024-09-10T16:36:35.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 10 monclient: get_monmap_and_config 2024-09-10T16:36:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 10 monclient: build_initial_monmap 2024-09-10T16:36:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 10 monclient: monmap: 2024-09-10T16:36:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:35.554471+0000 2024-09-10T16:36:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:35.554471+0000 2024-09-10T16:36:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:35.553 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:35.554 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:35.554 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 1 Processor -- start 2024-09-10T16:36:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 1 -- start start 2024-09-10T16:36:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 10 monclient: init 2024-09-10T16:36:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 10 monclient: _add_conns ranks=[7,2,6,1,3,0,4,8,5] 2024-09-10T16:36:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 10 monclient(hunting): picked mon.noname-i con 0x7fda100a0a90 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 10 monclient(hunting): picked mon.noname-b con 0x7fda100a35f0 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 10 monclient(hunting): picked mon.noname-d con 0x7fda100a3a40 addr v1:172.21.15.81:6792/0 2024-09-10T16:36:35.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda1009df70 con 0x7fda100a35f0 2024-09-10T16:36:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda1009fa30 con 0x7fda100a3a40 2024-09-10T16:36:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda1009fd10 con 0x7fda100a0a90 2024-09-10T16:36:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 10 monclient(hunting): authenticate will time out at 1362.953920s 2024-09-10T16:36:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0f7fe640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fda100a3a40 0x7fda1013fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:40140/0 (socket says 172.21.15.81:40140) 2024-09-10T16:36:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0f7fe640 1 -- 172.21.15.81:0/2231810084 learned_addr learned my addr 172.21.15.81:0/2231810084 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0e7fc640 1 --1- 172.21.15.81:0/2231810084 >> v1:172.21.15.81:6790/0 conn(0x7fda100a35f0 0x7fda1013c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34130/0 (socket says 172.21.15.81:34130) 2024-09-10T16:36:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 1 -- 172.21.15.81:0/2231810084 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 436542695 0 0) 0x7fda1009df70 con 0x7fda100a35f0 2024-09-10T16:36:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient(hunting): my global_id is 144893 2024-09-10T16:36:35.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 1 -- 172.21.15.81:0/2231810084 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9f8003530 con 0x7fda100a35f0 2024-09-10T16:36:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 1 -- 172.21.15.81:0/2231810084 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2723410298 0 0) 0x7fda1009fa30 con 0x7fda100a3a40 2024-09-10T16:36:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient(hunting): my global_id is 144717 2024-09-10T16:36:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 1 -- 172.21.15.81:0/2231810084 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda1009df70 con 0x7fda100a3a40 2024-09-10T16:36:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 1 -- 172.21.15.81:0/2231810084 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1795884009 0 0) 0x7fd9f8003530 con 0x7fda100a35f0 2024-09-10T16:36:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 1 -- 172.21.15.81:0/2231810084 >> v1:172.21.15.189:6792/0 conn(0x7fda100a0a90 legacy=0x7fda100a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 1 -- 172.21.15.81:0/2231810084 >> v1:172.21.15.81:6792/0 conn(0x7fda100a3a40 legacy=0x7fda1013fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient: _finish_hunting 0 2024-09-10T16:36:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 1 monclient: found mon.noname-b 2024-09-10T16:36:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:35.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:36:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 1 -- 172.21.15.81:0/2231810084 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1009fff0 con 0x7fda100a35f0 2024-09-10T16:36:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient: _finish_auth 0 2024-09-10T16:36:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient: _check_auth_tickets 2024-09-10T16:36:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 1 -- 172.21.15.81:0/2231810084 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fda00001790 con 0x7fda100a35f0 2024-09-10T16:36:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient: dump: 2024-09-10T16:36:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.564 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 5 monclient: authenticate success, global_id 144893 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:35.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 1 -- 172.21.15.81:0/2231810084 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda000019b0 con 0x7fda100a35f0 2024-09-10T16:36:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 1 -- 172.21.15.81:0/2231810084 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fda00001be0 con 0x7fda100a35f0 2024-09-10T16:36:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda0dffb640 10 monclient: dump: 2024-09-10T16:36:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.566 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.567 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 4 set_mon_vals no callback set 2024-09-10T16:36:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 10 monclient: shutdown 2024-09-10T16:36:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 1 -- 172.21.15.81:0/2231810084 >> v1:172.21.15.81:6790/0 conn(0x7fda100a35f0 legacy=0x7fda1013c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 1 -- 172.21.15.81:0/2231810084 shutdown_connections 2024-09-10T16:36:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 1 -- 172.21.15.81:0/2231810084 >> 172.21.15.81:0/2231810084 conn(0x7fda100a3fd0 msgr2=0x7fda100a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 1 -- 172.21.15.81:0/2231810084 shutdown_connections 2024-09-10T16:36:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.551+0000 7fda15447640 1 -- 172.21.15.81:0/2231810084 wait complete. 2024-09-10T16:36:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 monclient: build_initial_monmap 2024-09-10T16:36:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 monclient: monmap: 2024-09-10T16:36:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:35.568 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:35.569 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 1 Processor -- start 2024-09-10T16:36:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 1 -- start start 2024-09-10T16:36:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 monclient: init 2024-09-10T16:36:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 monclient: _add_conns ranks=[6,1,7,2,0,8,5,4,3] 2024-09-10T16:36:35.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 monclient(hunting): picked mon.noname-d con 0x7fda100a0a90 addr v1:172.21.15.81:6792/0 2024-09-10T16:36:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 monclient(hunting): picked mon.noname-f con 0x7fda100a35f0 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 monclient(hunting): picked mon.noname-i con 0x7fda100a3a40 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda10094d10 con 0x7fda100a35f0 2024-09-10T16:36:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda100a6c00 con 0x7fda100a0a90 2024-09-10T16:36:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda10097070 con 0x7fda100a3a40 2024-09-10T16:36:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 monclient(hunting): authenticate will time out at 1362.957215s 2024-09-10T16:36:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda0effd640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fda100a0a90 0x7fda1009a5c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:40146/0 (socket says 172.21.15.81:40146) 2024-09-10T16:36:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda0effd640 1 -- 172.21.15.81:0/188406327 learned_addr learned my addr 172.21.15.81:0/188406327 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 997961022 0 0) 0x7fda100a6c00 con 0x7fda100a0a90 2024-09-10T16:36:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): my global_id is 144726 2024-09-10T16:36:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9fc003530 con 0x7fda100a0a90 2024-09-10T16:36:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 227011670 0 0) 0x7fd9fc003530 con 0x7fda100a0a90 2024-09-10T16:36:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fda100a6c00 con 0x7fda100a0a90 2024-09-10T16:36:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fda04001ba0 con 0x7fda100a0a90 2024-09-10T16:36:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:36:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): dump: 2024-09-10T16:36:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.571 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.572 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:35.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3031285734 0 0) 0x7fda10097070 con 0x7fda100a3a40 2024-09-10T16:36:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): my global_id is 164122 2024-09-10T16:36:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9fc003530 con 0x7fda100a3a40 2024-09-10T16:36:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 698371088 0 0) 0x7fda10094d10 con 0x7fda100a35f0 2024-09-10T16:36:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): my global_id is 164107 2024-09-10T16:36:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda10097070 con 0x7fda100a35f0 2024-09-10T16:36:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1724393899 0 0) 0x7fda100a6c00 con 0x7fda100a0a90 2024-09-10T16:36:35.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 >> v1:172.21.15.189:6792/0 conn(0x7fda100a3a40 legacy=0x7fda101d4390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 >> v1:172.21.15.189:6789/0 conn(0x7fda100a35f0 legacy=0x7fda101d0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient: _finish_hunting 0 2024-09-10T16:36:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 monclient: found mon.d 2024-09-10T16:36:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda1009acd0 con 0x7fda100a0a90 2024-09-10T16:36:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient: _finish_auth 0 2024-09-10T16:36:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient: _check_auth_tickets 2024-09-10T16:36:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 5 monclient: authenticate success, global_id 144726 2024-09-10T16:36:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 monclient: _renew_subs 2024-09-10T16:36:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:35.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fda10095870 con 0x7fda100a0a90 2024-09-10T16:36:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 monclient: _renew_subs 2024-09-10T16:36:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fda101cbab0 con 0x7fda100a0a90 2024-09-10T16:36:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fda040038d0 con 0x7fda100a0a90 2024-09-10T16:36:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fda04003e80 con 0x7fda100a0a90 2024-09-10T16:36:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda0d7fa640 4 set_mon_vals no callback set 2024-09-10T16:36:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:36:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient: dump: 2024-09-10T16:36:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.575 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.576 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.576 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda15447640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd9f00065d0 con 0x7fd9f0002870 2024-09-10T16:36:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fda040040a0 con 0x7fda100a0a90 2024-09-10T16:36:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(323..323 src has 121..323) ==== 3898+0+0 (unknown 2315862761 0 0) 0x7fda0404afe0 con 0x7fda100a0a90 2024-09-10T16:36:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2072105250 0 0) 0x7fd9f00065d0 con 0x7fd9f0002870 2024-09-10T16:36:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient(hunting): my global_id is 6489 2024-09-10T16:36:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fda100a6c00 con 0x7fd9f0002870 2024-09-10T16:36:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fda0f7fe640 10 monclient: get_auth_request con 0x7fd9fc03d1e0 auth_method 0 2024-09-10T16:36:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 511300183 0 0) 0x7fda100a6c00 con 0x7fd9f0002870 2024-09-10T16:36:35.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9f00065d0 con 0x7fd9f0002870 2024-09-10T16:36:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fda00001810 con 0x7fd9f0002870 2024-09-10T16:36:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 10 monclient: dump: 2024-09-10T16:36:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.578 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.579 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3666265726 0 0) 0x7fd9f00065d0 con 0x7fd9f0002870 2024-09-10T16:36:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.555+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.81:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9f000a170 con 0x7fd9f0002870 2024-09-10T16:36:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.559+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fda00001b30 con 0x7fd9f0002870 2024-09-10T16:36:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.559+0000 7fd9f77fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.559+0000 7fd9f77fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:35.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.559+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 >> v1:172.21.15.81:6789/0 conn(0x7fd9f0002870 legacy=0x7fd9f0004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.559+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 >> v1:172.21.15.81:6789/0 conn(0x7fd9f0002870 legacy=0x7fd9f0004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fda15447640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:36:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fda15447640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd9f0009e80 con 0x7fd9f0009140 2024-09-10T16:36:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1722527648 0 0) 0x7fd9f0009e80 con 0x7fd9f0009140 2024-09-10T16:36:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 10 monclient(hunting): my global_id is 6498 2024-09-10T16:36:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9f00065d0 con 0x7fd9f0009140 2024-09-10T16:36:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 531644032 0 0) 0x7fd9f00065d0 con 0x7fd9f0009140 2024-09-10T16:36:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9f0009e80 con 0x7fd9f0009140 2024-09-10T16:36:35.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fda00004d20 con 0x7fd9f0009140 2024-09-10T16:36:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 10 monclient: dump: 2024-09-10T16:36:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.582 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.583 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1056129927 0 0) 0x7fd9f0009e80 con 0x7fd9f0009140 2024-09-10T16:36:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 --> v1:172.21.15.81:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd9f000c420 con 0x7fd9f0009140 2024-09-10T16:36:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 <== mon.0 v1:172.21.15.81:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7713 (unknown 0 0 1027492819) 0x7fda000061f0 con 0x7fd9f0009140 2024-09-10T16:36:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:36:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:36:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 >> v1:172.21.15.81:6789/0 conn(0x7fd9f0009140 legacy=0x7fd9f00095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fd9f77fe640 1 -- 172.21.15.81:0/188406327 >> v1:172.21.15.81:6789/0 conn(0x7fd9f0009140 legacy=0x7fd9f00095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:35.584 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:36:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:36:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "leader", 2024-09-10T16:36:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 44, 2024-09-10T16:36:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 405512, 2024-09-10T16:36:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:36:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:36:35.584 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:36:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:36:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:36:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:36:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:36:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:36:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:36:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:36:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-09-10T16:36:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:36:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:36:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:35.585 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:36:35.586 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:36:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:36:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:36:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:36:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:36:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:36:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:36:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:36:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:36:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:36:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:36:35.588 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:36:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:36:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:36:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:36:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:35.589 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:36:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:36:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:36:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:36:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.590 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:36:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:36:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:36:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.591 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:36:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:36:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:36:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.592 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:36:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:36:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:36:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:36:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.593 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:36:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:36:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:36:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.594 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:36:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:36:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:36:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:36:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:36:35.595 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:36:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:36:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:36:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.596 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:36:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:36:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:36:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:36:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.597 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.598 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:36:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:36:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:36:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:36:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:36:35.599 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:36:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:36:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:36:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.600 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:36:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:36:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:36:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:36:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.601 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:36:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:36:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:36:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:36:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:36:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:36:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.603 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:36:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:36:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.604 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:36:35.604 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:35.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fda15447640 1 -- 172.21.15.81:0/188406327 >> v1:172.21.15.189:6812/1108603242 conn(0x7fd9fc03d1e0 legacy=0x7fd9fc03f6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fda15447640 10 monclient: shutdown 2024-09-10T16:36:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fda15447640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fda15447640 1 -- 172.21.15.81:0/188406327 >> v1:172.21.15.81:6792/0 conn(0x7fda100a0a90 legacy=0x7fda1009a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fda0f7fe640 1 -- 172.21.15.81:0/188406327 reap_dead start 2024-09-10T16:36:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fda0f7fe640 1 -- 172.21.15.81:0/188406327 reap_dead start 2024-09-10T16:36:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fda15447640 1 -- 172.21.15.81:0/188406327 shutdown_connections 2024-09-10T16:36:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fda15447640 1 -- 172.21.15.81:0/188406327 >> 172.21.15.81:0/188406327 conn(0x7fda100a3fd0 msgr2=0x7fda10072890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fda15447640 1 -- 172.21.15.81:0/188406327 shutdown_connections 2024-09-10T16:36:35.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.563+0000 7fda15447640 1 -- 172.21.15.81:0/188406327 wait complete. 2024-09-10T16:36:35.606 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:36:35.607 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon b 2024-09-10T16:36:35.607 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.b mon_status 2024-09-10T16:36:35.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient: get_monmap_and_config 2024-09-10T16:36:35.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient: build_initial_monmap 2024-09-10T16:36:35.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient: monmap: 2024-09-10T16:36:35.724 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:35.725 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.725 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:35.726127+0000 2024-09-10T16:36:35.725 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:35.726127+0000 2024-09-10T16:36:35.725 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:35.725 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.725 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:35.725 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:35.725 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:35.725 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:35.726 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:35.726 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:35.726 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:35.726 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:35.726 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:35.726 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 1 Processor -- start 2024-09-10T16:36:35.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 1 -- start start 2024-09-10T16:36:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient: init 2024-09-10T16:36:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient: _add_conns ranks=[0,3,1,8,7,6,2,5,4] 2024-09-10T16:36:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient(hunting): picked mon.noname-a con 0x7f746406e990 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient(hunting): picked mon.noname-g con 0x7f74640a4600 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient(hunting): picked mon.noname-f con 0x7f74640a49e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:35.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f746406f7f0 con 0x7f746406e990 2024-09-10T16:36:35.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74640a5630 con 0x7f74640a49e0 2024-09-10T16:36:35.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7464070900 con 0x7f74640a4600 2024-09-10T16:36:35.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:35.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient(hunting): authenticate will time out at 1363.125587s 2024-09-10T16:36:35.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f746406e990 0x7f74640a3ef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37324/0 (socket says 172.21.15.81:37324) 2024-09-10T16:36:35.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746259c640 1 -- 172.21.15.81:0/209096794 learned_addr learned my addr 172.21.15.81:0/209096794 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:35.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 1 -- 172.21.15.81:0/209096794 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 717116554 0 0) 0x7f745c0014a0 con 0x7f746406e990 2024-09-10T16:36:35.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient(hunting): my global_id is 6507 2024-09-10T16:36:35.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 1 -- 172.21.15.81:0/209096794 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7444003530 con 0x7f746406e990 2024-09-10T16:36:35.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 1 -- 172.21.15.81:0/209096794 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2142911126 0 0) 0x7f7444003530 con 0x7f746406e990 2024-09-10T16:36:35.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 1 -- 172.21.15.81:0/209096794 >> v1:172.21.15.189:6790/0 conn(0x7f74640a4600 legacy=0x7f746413e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 1 -- 172.21.15.81:0/209096794 >> v1:172.21.15.189:6789/0 conn(0x7f74640a49e0 legacy=0x7f7464141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient: _finish_hunting 0 2024-09-10T16:36:35.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 1 monclient: found mon.noname-a 2024-09-10T16:36:35.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:35.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:36:35.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 1 -- 172.21.15.81:0/209096794 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7464070630 con 0x7f746406e990 2024-09-10T16:36:35.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient: _finish_auth 0 2024-09-10T16:36:35.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient: _check_auth_tickets 2024-09-10T16:36:35.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:35.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 1 -- 172.21.15.81:0/209096794 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f745c001d90 con 0x7f746406e990 2024-09-10T16:36:35.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:36:35.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient: dump: 2024-09-10T16:36:35.740 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.740 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.741 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.741 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.741 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.741 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.741 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.741 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.741 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.741 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.741 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.742 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.742 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.742 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.742 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.742 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 5 monclient: authenticate success, global_id 6507 2024-09-10T16:36:35.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 1 -- 172.21.15.81:0/209096794 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f745c001fb0 con 0x7f746406e990 2024-09-10T16:36:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 1 -- 172.21.15.81:0/209096794 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f745c004f70 con 0x7f746406e990 2024-09-10T16:36:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f746159a640 10 monclient: dump: 2024-09-10T16:36:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.743 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.744 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.744 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.744 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.744 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.744 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.744 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.744 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.744 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.744 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 4 set_mon_vals no callback set 2024-09-10T16:36:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient: shutdown 2024-09-10T16:36:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 1 -- 172.21.15.81:0/209096794 >> v1:172.21.15.81:6789/0 conn(0x7f746406e990 legacy=0x7f74640a3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 1 -- 172.21.15.81:0/209096794 shutdown_connections 2024-09-10T16:36:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 1 -- 172.21.15.81:0/209096794 >> 172.21.15.81:0/209096794 conn(0x7f74640a94f0 msgr2=0x7f74640a9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 1 -- 172.21.15.81:0/209096794 shutdown_connections 2024-09-10T16:36:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 1 -- 172.21.15.81:0/209096794 wait complete. 2024-09-10T16:36:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient: build_initial_monmap 2024-09-10T16:36:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 10 monclient: monmap: 2024-09-10T16:36:35.745 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:35.746 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:35.747 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 1 Processor -- start 2024-09-10T16:36:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.723+0000 7f74688d3640 1 -- start start 2024-09-10T16:36:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 10 monclient: init 2024-09-10T16:36:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 10 monclient: _add_conns ranks=[0,2,8,4,5,6,3,7,1] 2024-09-10T16:36:35.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 10 monclient(hunting): picked mon.noname-a con 0x7f746406e990 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:35.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 10 monclient(hunting): picked mon.noname-b con 0x7f74640a4600 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:35.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 10 monclient(hunting): picked mon.noname-e con 0x7f74640a49e0 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:35.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74640a7680 con 0x7f746406e990 2024-09-10T16:36:35.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74641286f0 con 0x7f74640a4600 2024-09-10T16:36:35.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7464127200 con 0x7f74640a49e0 2024-09-10T16:36:35.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:35.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 10 monclient(hunting): authenticate will time out at 1363.128459s 2024-09-10T16:36:35.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f746259c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f746406e990 0x7f7464125850 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37338/0 (socket says 172.21.15.81:37338) 2024-09-10T16:36:35.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f746259c640 1 -- 172.21.15.81:0/2858988432 learned_addr learned my addr 172.21.15.81:0/2858988432 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:35.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 321413352 0 0) 0x7f74640a7680 con 0x7f746406e990 2024-09-10T16:36:35.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): my global_id is 6516 2024-09-10T16:36:35.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7448003530 con 0x7f746406e990 2024-09-10T16:36:35.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 409175011 0 0) 0x7f7464127200 con 0x7f74640a49e0 2024-09-10T16:36:35.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): my global_id is 6533 2024-09-10T16:36:35.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74640a7680 con 0x7f74640a49e0 2024-09-10T16:36:35.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3708888139 0 0) 0x7f74641286f0 con 0x7f74640a4600 2024-09-10T16:36:35.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): my global_id is 144902 2024-09-10T16:36:35.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7464127200 con 0x7f74640a4600 2024-09-10T16:36:35.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1374853874 0 0) 0x7f7464127200 con 0x7f74640a4600 2024-09-10T16:36:35.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f74641286f0 con 0x7f74640a4600 2024-09-10T16:36:35.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2975507519 0 0) 0x7f7448003530 con 0x7f746406e990 2024-09-10T16:36:35.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7464127200 con 0x7f746406e990 2024-09-10T16:36:35.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f744c001a10 con 0x7f74640a4600 2024-09-10T16:36:35.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:35.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:35.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): dump: 2024-09-10T16:36:35.750 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.751 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.752 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3869626860 0 0) 0x7f74640a7680 con 0x7f74640a49e0 2024-09-10T16:36:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7448003530 con 0x7f74640a49e0 2024-09-10T16:36:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f745c0014d0 con 0x7f746406e990 2024-09-10T16:36:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): dump: 2024-09-10T16:36:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.752 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.753 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.753 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7454001960 con 0x7f74640a49e0 2024-09-10T16:36:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): dump: 2024-09-10T16:36:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.754 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.755 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1741356302 0 0) 0x7f74641286f0 con 0x7f74640a4600 2024-09-10T16:36:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 >> v1:172.21.15.81:6793/0 conn(0x7f74640a49e0 legacy=0x7f7464126670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 >> v1:172.21.15.81:6789/0 conn(0x7f746406e990 legacy=0x7f7464125850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient: _finish_hunting 0 2024-09-10T16:36:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 monclient: found mon.b 2024-09-10T16:36:35.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7464129560 con 0x7f74640a4600 2024-09-10T16:36:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient: _finish_auth 0 2024-09-10T16:36:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient: _check_auth_tickets 2024-09-10T16:36:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 5 monclient: authenticate success, global_id 144902 2024-09-10T16:36:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 10 monclient: _renew_subs 2024-09-10T16:36:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7464128020 con 0x7f74640a4600 2024-09-10T16:36:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 10 monclient: _renew_subs 2024-09-10T16:36:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:35.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f74641d7160 con 0x7f74640a4600 2024-09-10T16:36:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f744c001d30 con 0x7f74640a4600 2024-09-10T16:36:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f744c003bf0 con 0x7f74640a4600 2024-09-10T16:36:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f7460d99640 4 set_mon_vals no callback set 2024-09-10T16:36:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient: dump: 2024-09-10T16:36:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.757 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.758 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f74688d3640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f743c0065d0 con 0x7f743c002870 2024-09-10T16:36:35.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f744c00fb00 con 0x7f74640a4600 2024-09-10T16:36:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(323..323 src has 121..323) ==== 3898+0+0 (unknown 2315862761 0 0) 0x7f744c049bb0 con 0x7f74640a4600 2024-09-10T16:36:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2234845918 0 0) 0x7f743c0065d0 con 0x7f743c002870 2024-09-10T16:36:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient(hunting): my global_id is 144911 2024-09-10T16:36:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f74641286f0 con 0x7f743c002870 2024-09-10T16:36:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f7462d9d640 10 monclient: get_auth_request con 0x7f744803da00 auth_method 0 2024-09-10T16:36:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3562495120 0 0) 0x7f74641286f0 con 0x7f743c002870 2024-09-10T16:36:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f743c0065d0 con 0x7f743c002870 2024-09-10T16:36:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f745c0054a0 con 0x7f743c002870 2024-09-10T16:36:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:35.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient: dump: 2024-09-10T16:36:35.760 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.760 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.760 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.760 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.760 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.760 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.760 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.760 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.760 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.760 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.760 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.760 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.761 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.761 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.761 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.761 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3488545566 0 0) 0x7f743c0065d0 con 0x7f743c002870 2024-09-10T16:36:35.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f743c00a170 con 0x7f743c002870 2024-09-10T16:36:35.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f745c005640 con 0x7f743c002870 2024-09-10T16:36:35.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:35.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:35.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 >> v1:172.21.15.81:6790/0 conn(0x7f743c002870 legacy=0x7f743c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.727+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 >> v1:172.21.15.81:6790/0 conn(0x7f743c002870 legacy=0x7f743c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f74688d3640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:36:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f74688d3640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f743c009e80 con 0x7f743c009140 2024-09-10T16:36:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 362504324 0 0) 0x7f743c009e80 con 0x7f743c009140 2024-09-10T16:36:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 10 monclient(hunting): my global_id is 144920 2024-09-10T16:36:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f743c0065d0 con 0x7f743c009140 2024-09-10T16:36:35.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1777811287 0 0) 0x7f743c0065d0 con 0x7f743c009140 2024-09-10T16:36:35.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f743c009e80 con 0x7f743c009140 2024-09-10T16:36:35.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f745c005df0 con 0x7f743c009140 2024-09-10T16:36:35.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:35.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 10 monclient: dump: 2024-09-10T16:36:35.764 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.764 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.764 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.764 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.764 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.764 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.764 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.764 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.765 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.765 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.765 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.765 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.765 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.765 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.765 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.766 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 356527333 0 0) 0x7f743c009e80 con 0x7f743c009140 2024-09-10T16:36:35.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 --> v1:172.21.15.81:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f743c00c420 con 0x7f743c009140 2024-09-10T16:36:35.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 <== mon.2 v1:172.21.15.81:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 1470659828) 0x7f745c0072e0 con 0x7f743c009140 2024-09-10T16:36:35.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:36:35.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:36:35.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 >> v1:172.21.15.81:6790/0 conn(0x7f743c009140 legacy=0x7f743c0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f745affd640 1 -- 172.21.15.81:0/2858988432 >> v1:172.21.15.81:6790/0 conn(0x7f743c009140 legacy=0x7f743c0095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:35.767 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:36:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:36:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:36:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 44, 2024-09-10T16:36:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 138574, 2024-09-10T16:36:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:36:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:36:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:36:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:36:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:36:35.767 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:36:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:36:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:36:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:36:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:36:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 2, 2024-09-10T16:36:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:36:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:36:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:35.768 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:36:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:36:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:35.769 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:36:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:36:35.770 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:36:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:36:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:36:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:36:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:36:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:36:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:36:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:36:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:36:35.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:36:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:36:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:36:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:35.772 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:36:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:36:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:36:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:36:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.773 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:36:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:36:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:36:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.774 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:36:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:36:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:36:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.775 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:36:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:36:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:36:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:36:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.776 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:36:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:36:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:36:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:36:35.777 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:36:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:36:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:36:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:36:35.778 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:36:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:36:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:36:35.779 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:36:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:36:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:36:35.780 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:36:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:36:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:36:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:36:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.781 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:36:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:36:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:36:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.782 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:36:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:36:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:36:35.783 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:36:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:36:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:36:35.784 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:36:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:36:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:36:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:36:35.785 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:36:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:36:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:36:35.786 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:36:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:36:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:35.787 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:36:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:36:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.789 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:36:35.789 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:35.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f74688d3640 1 -- 172.21.15.81:0/2858988432 >> v1:172.21.15.189:6812/1108603242 conn(0x7f744803da00 legacy=0x7f744803fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f74688d3640 10 monclient: shutdown 2024-09-10T16:36:35.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f74688d3640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:35.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f74688d3640 1 -- 172.21.15.81:0/2858988432 >> v1:172.21.15.81:6790/0 conn(0x7f74640a4600 legacy=0x7f7464125f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f7462d9d640 1 -- 172.21.15.81:0/2858988432 reap_dead start 2024-09-10T16:36:35.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f7462d9d640 1 -- 172.21.15.81:0/2858988432 reap_dead start 2024-09-10T16:36:35.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f74688d3640 1 -- 172.21.15.81:0/2858988432 shutdown_connections 2024-09-10T16:36:35.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f74688d3640 1 -- 172.21.15.81:0/2858988432 >> 172.21.15.81:0/2858988432 conn(0x7f74640a94f0 msgr2=0x7f7464142850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:35.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f74688d3640 1 -- 172.21.15.81:0/2858988432 shutdown_connections 2024-09-10T16:36:35.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.735+0000 7f74688d3640 1 -- 172.21.15.81:0/2858988432 wait complete. 2024-09-10T16:36:35.792 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:36:35.792 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon c 2024-09-10T16:36:35.792 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.c mon_status 2024-09-10T16:36:35.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 10 monclient: get_monmap_and_config 2024-09-10T16:36:35.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 10 monclient: build_initial_monmap 2024-09-10T16:36:35.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 10 monclient: monmap: 2024-09-10T16:36:35.909 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:35.909 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.909 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:35.910647+0000 2024-09-10T16:36:35.909 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:35.910647+0000 2024-09-10T16:36:35.909 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:35.909 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.909 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:35.910 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:35.910 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 1 Processor -- start 2024-09-10T16:36:35.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 1 -- start start 2024-09-10T16:36:35.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 10 monclient: init 2024-09-10T16:36:35.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:35.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 10 monclient: _add_conns ranks=[8,1,4,6,2,0,7,3,5] 2024-09-10T16:36:35.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 10 monclient(hunting): picked mon.noname-e con 0x7fcdf00a9f30 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:35.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 10 monclient(hunting): picked mon.noname-f con 0x7fcdf00a4700 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:35.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 10 monclient(hunting): picked mon.noname-c con 0x7fcdf00a4b10 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf00a5d70 con 0x7fcdf00a4700 2024-09-10T16:36:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf00a57e0 con 0x7fcdf00a4b10 2024-09-10T16:36:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf006f610 con 0x7fcdf00a9f30 2024-09-10T16:36:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf7b70640 10 monclient(hunting): authenticate will time out at 1363.310849s 2024-09-10T16:36:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf510b640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fcdf00a4700 0x7fcdf013e3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.81:36514/0 (socket says 172.21.15.81:36514) 2024-09-10T16:36:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.907+0000 7fcdf510b640 1 -- 172.21.15.81:0/1887704919 learned_addr learned my addr 172.21.15.81:0/1887704919 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:35.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.911+0000 7fcdf490a640 1 -- 172.21.15.81:0/1887704919 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3896481968 0 0) 0x7fcdf00a5d70 con 0x7fcdf00a4700 2024-09-10T16:36:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.911+0000 7fcdf490a640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.911+0000 7fcdf490a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.911+0000 7fcdf490a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.911+0000 7fcdf490a640 10 monclient(hunting): my global_id is 164125 2024-09-10T16:36:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.911+0000 7fcdf490a640 1 -- 172.21.15.81:0/1887704919 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcddc003530 con 0x7fcdf00a4700 2024-09-10T16:36:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.911+0000 7fcdf490a640 1 -- 172.21.15.81:0/1887704919 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1032962729 0 0) 0x7fcdf006f610 con 0x7fcdf00a9f30 2024-09-10T16:36:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.911+0000 7fcdf490a640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.911+0000 7fcdf490a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.911+0000 7fcdf490a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.911+0000 7fcdf490a640 10 monclient(hunting): my global_id is 6542 2024-09-10T16:36:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.911+0000 7fcdf490a640 1 -- 172.21.15.81:0/1887704919 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdf00a5d70 con 0x7fcdf00a9f30 2024-09-10T16:36:35.918 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:35.918 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32786]: starting. 2024-09-10T16:36:35.918 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32786]: deleting pool ceph_test_rados_delete_pools_parallel.smithi189-32582 2024-09-10T16:36:35.918 INFO:teuthology.orchestra.run.smithi189.stdout:process_4_[32786]: shutting down. 2024-09-10T16:36:35.922 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:35.922 INFO:teuthology.orchestra.run.smithi189.stdout:******************************* 2024-09-10T16:36:35.922 INFO:teuthology.orchestra.run.smithi189.stdout:******* SUCCESS ********** 2024-09-10T16:36:35.926 DEBUG:teuthology.run_tasks:Unwinding manager mon_thrash 2024-09-10T16:36:35.938 INFO:tasks.mon_thrash:joining mon_thrasher 2024-09-10T16:36:35.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 1 -- 172.21.15.81:0/1887704919 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4233569999 0 0) 0x7fcddc003530 con 0x7fcdf00a4700 2024-09-10T16:36:35.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 1 -- 172.21.15.81:0/1887704919 >> v1:172.21.15.81:6793/0 conn(0x7fcdf00a9f30 legacy=0x7fcdf00a3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 1 -- 172.21.15.81:0/1887704919 >> v1:172.21.15.81:6791/0 conn(0x7fcdf00a4b10 legacy=0x7fcdf0141b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 10 monclient: _finish_hunting 0 2024-09-10T16:36:35.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 1 monclient: found mon.noname-f 2024-09-10T16:36:35.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:35.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 10 monclient: _send_mon_message to mon.noname-f at v1:172.21.15.189:6789/0 2024-09-10T16:36:35.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 1 -- 172.21.15.81:0/1887704919 --> v1:172.21.15.189:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf006f8f0 con 0x7fcdf00a4700 2024-09-10T16:36:35.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 10 monclient: _finish_auth 0 2024-09-10T16:36:35.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 10 monclient: _check_auth_tickets 2024-09-10T16:36:35.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:35.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 1 -- 172.21.15.81:0/1887704919 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcde8001bc0 con 0x7fcdf00a4700 2024-09-10T16:36:35.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 10 monclient: got monmap 1 from mon.noname-f (according to old e1) 2024-09-10T16:36:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 10 monclient: dump: 2024-09-10T16:36:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.945 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.946 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf7b70640 5 monclient: authenticate success, global_id 164125 2024-09-10T16:36:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf7b70640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 1 -- 172.21.15.81:0/1887704919 <== mon.1 v1:172.21.15.189:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcde8001d60 con 0x7fcdf00a4700 2024-09-10T16:36:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf7b70640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 1 -- 172.21.15.81:0/1887704919 <== mon.1 v1:172.21.15.189:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcde8001fd0 con 0x7fcdf00a4700 2024-09-10T16:36:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf7b70640 4 set_mon_vals no callback set 2024-09-10T16:36:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:36:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf490a640 10 monclient: dump: 2024-09-10T16:36:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.947 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.948 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf7b70640 10 monclient: shutdown 2024-09-10T16:36:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf7b70640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.931+0000 7fcdf7b70640 1 -- 172.21.15.81:0/1887704919 >> v1:172.21.15.189:6789/0 conn(0x7fcdf00a4700 legacy=0x7fcdf013e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 1 -- 172.21.15.81:0/1887704919 shutdown_connections 2024-09-10T16:36:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 1 -- 172.21.15.81:0/1887704919 >> 172.21.15.81:0/1887704919 conn(0x7fcdf009cbe0 msgr2=0x7fcdf00a95f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 1 -- 172.21.15.81:0/1887704919 shutdown_connections 2024-09-10T16:36:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 1 -- 172.21.15.81:0/1887704919 wait complete. 2024-09-10T16:36:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 monclient: build_initial_monmap 2024-09-10T16:36:35.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 monclient: monmap: 2024-09-10T16:36:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:35.949 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:35.950 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 1 Processor -- start 2024-09-10T16:36:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 1 -- start start 2024-09-10T16:36:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 monclient: init 2024-09-10T16:36:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 monclient: _add_conns ranks=[3,1,5,4,0,6,2,8,7] 2024-09-10T16:36:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 monclient(hunting): picked mon.noname-g con 0x7fcdf00a4700 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 monclient(hunting): picked mon.noname-f con 0x7fcdf00a4b10 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 monclient(hunting): picked mon.noname-h con 0x7fcdf00a9f30 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf0128260 con 0x7fcdf00a4b10 2024-09-10T16:36:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf00a8d60 con 0x7fcdf00a4700 2024-09-10T16:36:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcdf0126d70 con 0x7fcdf00a9f30 2024-09-10T16:36:35.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 monclient(hunting): authenticate will time out at 1363.337819s 2024-09-10T16:36:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf510b640 1 --1- >> v1:172.21.15.189:6789/0 conn(0x7fcdf00a4b10 0x7fcdf01d27b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.189:6789/0 says I am v1:172.21.15.81:36528/0 (socket says 172.21.15.81:36528) 2024-09-10T16:36:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf510b640 1 -- 172.21.15.81:0/2616677821 learned_addr learned my addr 172.21.15.81:0/2616677821 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2788609498 0 0) 0x7fcdf00a8d60 con 0x7fcdf00a4700 2024-09-10T16:36:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): my global_id is 164127 2024-09-10T16:36:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdd4003530 con 0x7fcdf00a4700 2024-09-10T16:36:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1409702457 0 0) 0x7fcdf0128260 con 0x7fcdf00a4b10 2024-09-10T16:36:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): my global_id is 164134 2024-09-10T16:36:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdf00a8d60 con 0x7fcdf00a4b10 2024-09-10T16:36:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1383376247 0 0) 0x7fcdf0126d70 con 0x7fcdf00a9f30 2024-09-10T16:36:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): my global_id is 164102 2024-09-10T16:36:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdf0128260 con 0x7fcdf00a9f30 2024-09-10T16:36:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2282061941 0 0) 0x7fcdd4003530 con 0x7fcdf00a4700 2024-09-10T16:36:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcdf0126d70 con 0x7fcdf00a4700 2024-09-10T16:36:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcdec0014d0 con 0x7fcdf00a4700 2024-09-10T16:36:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:35.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): got monmap 1 from mon.noname-g (according to old e1) 2024-09-10T16:36:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): dump: 2024-09-10T16:36:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.953 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.954 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3788972992 0 0) 0x7fcdf00a8d60 con 0x7fcdf00a4b10 2024-09-10T16:36:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcdd4003530 con 0x7fcdf00a4b10 2024-09-10T16:36:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcde8001a80 con 0x7fcdf00a4b10 2024-09-10T16:36:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): got monmap 1 from mon.f (according to old e1) 2024-09-10T16:36:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient(hunting): dump: 2024-09-10T16:36:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.954 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.955 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.955 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1741447442 0 0) 0x7fcdf0126d70 con 0x7fcdf00a4700 2024-09-10T16:36:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 >> v1:172.21.15.189:6791/0 conn(0x7fcdf00a9f30 legacy=0x7fcdf01d5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 >> v1:172.21.15.189:6789/0 conn(0x7fcdf00a4b10 legacy=0x7fcdf01d27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient: _finish_hunting 0 2024-09-10T16:36:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 monclient: found mon.g 2024-09-10T16:36:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:36:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.189:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdf01290d0 con 0x7fcdf00a4700 2024-09-10T16:36:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient: _finish_auth 0 2024-09-10T16:36:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient: _check_auth_tickets 2024-09-10T16:36:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 5 monclient: authenticate success, global_id 164127 2024-09-10T16:36:35.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 monclient: _renew_subs 2024-09-10T16:36:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:36:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.189:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcdf0128830 con 0x7fcdf00a4700 2024-09-10T16:36:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 monclient: _renew_subs 2024-09-10T16:36:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 monclient: _send_mon_message to mon.g at v1:172.21.15.189:6790/0 2024-09-10T16:36:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.189:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fcdf0125810 con 0x7fcdf00a4700 2024-09-10T16:36:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.3 v1:172.21.15.189:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcdec0038b0 con 0x7fcdf00a4700 2024-09-10T16:36:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.3 v1:172.21.15.189:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcdec003da0 con 0x7fcdf00a4700 2024-09-10T16:36:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:36:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde7fff640 4 set_mon_vals no callback set 2024-09-10T16:36:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcde67fc640 10 monclient: dump: 2024-09-10T16:36:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.957 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.958 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.959 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.935+0000 7fcdf7b70640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcdf7b70640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcdd80065d0 con 0x7fcdd8002870 2024-09-10T16:36:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.3 v1:172.21.15.189:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fcdec00fcb0 con 0x7fcdf00a4700 2024-09-10T16:36:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.3 v1:172.21.15.189:6790/0 8 ==== osd_map(324..324 src has 121..324) ==== 3506+0+0 (unknown 2961462200 0 0) 0x7fcdec049c00 con 0x7fcdf00a4700 2024-09-10T16:36:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 438005166 0 0) 0x7fcdd80065d0 con 0x7fcdd8002870 2024-09-10T16:36:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 10 monclient(hunting): my global_id is 144760 2024-09-10T16:36:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdf0126d70 con 0x7fcdd8002870 2024-09-10T16:36:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcdf610d640 10 monclient: get_auth_request con 0x7fcdd403d840 auth_method 0 2024-09-10T16:36:35.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1047814311 0 0) 0x7fcdf0126d70 con 0x7fcdd8002870 2024-09-10T16:36:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcdd80065d0 con 0x7fcdd8002870 2024-09-10T16:36:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcde8004eb0 con 0x7fcdd8002870 2024-09-10T16:36:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 10 monclient: dump: 2024-09-10T16:36:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.960 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.961 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2989985962 0 0) 0x7fcdd80065d0 con 0x7fcdd8002870 2024-09-10T16:36:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.81:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcdd800a170 con 0x7fcdd8002870 2024-09-10T16:36:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fcde8006390 con 0x7fcdd8002870 2024-09-10T16:36:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:35.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 >> v1:172.21.15.81:6791/0 conn(0x7fcdd8002870 legacy=0x7fcdd8004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.939+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 >> v1:172.21.15.81:6791/0 conn(0x7fcdd8002870 legacy=0x7fcdd8004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.943+0000 7fcdf7b70640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:36:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.943+0000 7fcdf7b70640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcdd8009e30 con 0x7fcdd80090f0 2024-09-10T16:36:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1417172807 0 0) 0x7fcdd8009e30 con 0x7fcdd80090f0 2024-09-10T16:36:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 10 monclient(hunting): _negotiate 2024-09-10T16:36:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:35.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 10 monclient(hunting): my global_id is 144769 2024-09-10T16:36:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcdd80065d0 con 0x7fcdd80090f0 2024-09-10T16:36:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 225148468 0 0) 0x7fcdd80065d0 con 0x7fcdd80090f0 2024-09-10T16:36:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcdd8009e30 con 0x7fcdd80090f0 2024-09-10T16:36:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcde80054b0 con 0x7fcdd80090f0 2024-09-10T16:36:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 10 monclient: dump: 2024-09-10T16:36:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:35.964 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:35.965 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3341690212 0 0) 0x7fcdd8009e30 con 0x7fcdd80090f0 2024-09-10T16:36:35.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 --> v1:172.21.15.81:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcdd800c400 con 0x7fcdd80090f0 2024-09-10T16:36:35.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 <== mon.4 v1:172.21.15.81:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 329092620) 0x7fcde8005800 con 0x7fcdd80090f0 2024-09-10T16:36:35.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:36:35.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:36:35.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 >> v1:172.21.15.81:6791/0 conn(0x7fcdd80090f0 legacy=0x7fcdd8009580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcde67fc640 1 -- 172.21.15.81:0/2616677821 >> v1:172.21.15.81:6791/0 conn(0x7fcdd80090f0 legacy=0x7fcdd8009580 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:35.966 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:36:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:36:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:36:35.966 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 44, 2024-09-10T16:36:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 138794, 2024-09-10T16:36:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:36:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:36:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:36:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:36:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:36:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:36:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:36:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:36:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:36:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:36:35.967 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.968 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-09-10T16:36:35.968 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:35.968 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:36:35.968 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:36:35.968 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:35.968 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:35.968 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:35.968 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:35.968 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:35.968 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:35.968 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:35.968 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:35.969 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:35.969 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:35.969 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:35.969 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.969 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:36:35.969 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:36:35.969 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:35.969 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:35.969 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:35.969 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:35.969 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:35.969 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:35.969 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:35.970 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:35.970 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:35.970 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:35.970 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:35.970 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.970 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.970 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:36:35.970 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:36:35.970 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:36:35.970 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:36:35.970 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:36:35.970 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:36:35.971 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:35.971 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:35.971 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:36:35.971 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:36:35.971 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:36:35.971 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:36:35.971 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:36:35.971 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:36:35.971 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:36:35.971 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:35.971 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:36:35.971 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:35.971 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:35.972 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:35.972 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:35.972 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:35.972 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:35.972 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:35.972 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:35.972 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:35.972 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:35.972 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:35.972 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.972 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:36:35.973 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.973 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:36:35.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.973 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:36:35.973 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:36:35.973 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.973 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.973 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.973 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:36:35.973 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.973 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.973 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:36:35.974 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:36:35.974 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.974 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.974 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.974 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.974 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:36:35.974 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:36:35.974 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.974 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.975 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:36:35.975 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.975 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.975 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.975 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:36:35.975 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:36:35.975 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.975 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.975 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.976 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.976 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:36:35.976 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:36:35.976 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.976 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.976 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.976 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:36:35.976 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.976 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.977 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:36:35.977 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:36:35.977 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.977 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.977 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.977 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:36:35.977 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:36:35.977 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.977 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.978 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:36:35.978 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.978 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.978 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:36:35.978 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:36:35.978 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.978 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.978 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.978 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.979 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:36:35.979 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:36:35.979 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.979 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:36:35.979 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.979 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.979 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:36:35.979 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:36:35.980 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.980 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.980 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.980 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:36:35.980 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:36:35.980 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.980 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.980 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:36:35.981 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.981 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.981 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.981 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:36:35.981 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:36:35.981 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.981 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.981 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.981 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.981 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.981 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:36:35.981 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:36:35.982 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.982 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:36:35.982 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.982 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.982 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.982 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:36:35.982 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:36:35.982 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.982 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.982 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.983 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:36:35.983 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:36:35.983 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.983 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.983 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.983 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:36:35.983 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.983 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.983 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.984 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:36:35.984 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:36:35.984 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.984 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.984 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.984 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.984 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:36:35.984 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:36:35.984 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:35.984 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:35.984 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.984 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:35.985 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:36:35.985 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:35.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.985 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:36:35.985 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:36:35.985 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:35.985 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:35.985 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:35.985 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.985 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.985 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:36:35.986 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:36:35.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.986 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:35.986 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:35.986 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:35.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.986 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.986 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:36:35.986 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.986 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:35.986 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:35.986 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:36:35.986 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.987 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:35.987 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": [ 2024-09-10T16:36:35.987 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:35.987 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:35.987 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:35.987 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:35.987 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:35.987 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:35.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:35.987 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:36:35.987 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:35.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcdf7b70640 1 -- 172.21.15.81:0/2616677821 >> v1:172.21.15.189:6812/1108603242 conn(0x7fcdd403d840 legacy=0x7fcdd403fd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcdf7b70640 10 monclient: shutdown 2024-09-10T16:36:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcdf7b70640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcdf7b70640 1 -- 172.21.15.81:0/2616677821 >> v1:172.21.15.189:6790/0 conn(0x7fcdf00a4700 legacy=0x7fcdf0141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcdf610d640 1 -- 172.21.15.81:0/2616677821 reap_dead start 2024-09-10T16:36:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcdf610d640 1 -- 172.21.15.81:0/2616677821 reap_dead start 2024-09-10T16:36:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcdf7b70640 1 -- 172.21.15.81:0/2616677821 shutdown_connections 2024-09-10T16:36:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcdf7b70640 1 -- 172.21.15.81:0/2616677821 >> 172.21.15.81:0/2616677821 conn(0x7fcdf009cbe0 msgr2=0x7fcdf00a2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcdf7b70640 1 -- 172.21.15.81:0/2616677821 shutdown_connections 2024-09-10T16:36:35.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:35.947+0000 7fcdf7b70640 1 -- 172.21.15.81:0/2616677821 wait complete. 2024-09-10T16:36:35.989 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:36:35.990 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon d 2024-09-10T16:36:35.990 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.d mon_status 2024-09-10T16:36:36.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.103+0000 7f4b086a5640 10 monclient: get_monmap_and_config 2024-09-10T16:36:36.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.103+0000 7f4b086a5640 10 monclient: build_initial_monmap 2024-09-10T16:36:36.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.103+0000 7f4b086a5640 10 monclient: monmap: 2024-09-10T16:36:36.108 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:36.108 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.108 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:36.109901+0000 2024-09-10T16:36:36.109 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:36.109901+0000 2024-09-10T16:36:36.109 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:36.109 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.109 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:36.109 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:36.109 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:36.109 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:36.109 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:36.109 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:36.109 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:36.109 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:36.109 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:36.110 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 1 Processor -- start 2024-09-10T16:36:36.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 1 -- start start 2024-09-10T16:36:36.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 10 monclient: init 2024-09-10T16:36:36.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:36.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 10 monclient: _add_conns ranks=[6,1,5,7,4,0,2,3,8] 2024-09-10T16:36:36.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 10 monclient(hunting): picked mon.noname-d con 0x7f4b0009ca10 addr v1:172.21.15.81:6792/0 2024-09-10T16:36:36.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 10 monclient(hunting): picked mon.noname-f con 0x7f4b000a56e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:36.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 10 monclient(hunting): picked mon.noname-h con 0x7f4b000a5b00 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:36.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b001362b0 con 0x7f4b000a56e0 2024-09-10T16:36:36.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b000a80b0 con 0x7f4b000a5b00 2024-09-10T16:36:36.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b0009de70 con 0x7f4b0009ca10 2024-09-10T16:36:36.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:36.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 10 monclient(hunting): authenticate will time out at 1363.509344s 2024-09-10T16:36:36.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b06441640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f4b0009ca10 0x7f4b00135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:40158/0 (socket says 172.21.15.81:40158) 2024-09-10T16:36:36.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b06441640 1 -- 172.21.15.81:0/611445213 learned_addr learned my addr 172.21.15.81:0/611445213 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:36.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 1 -- 172.21.15.81:0/611445213 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4205269121 0 0) 0x7f4b0009de70 con 0x7f4b0009ca10 2024-09-10T16:36:36.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient(hunting): my global_id is 144735 2024-09-10T16:36:36.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 1 -- 172.21.15.81:0/611445213 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aec003530 con 0x7f4b0009ca10 2024-09-10T16:36:36.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 1 -- 172.21.15.81:0/611445213 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3160424358 0 0) 0x7f4aec003530 con 0x7f4b0009ca10 2024-09-10T16:36:36.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 1 -- 172.21.15.81:0/611445213 >> v1:172.21.15.189:6791/0 conn(0x7f4b000a5b00 legacy=0x7f4b00141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 1 -- 172.21.15.81:0/611445213 >> v1:172.21.15.189:6789/0 conn(0x7f4b000a56e0 legacy=0x7f4b0013df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient: _finish_hunting 0 2024-09-10T16:36:36.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 1 monclient: found mon.noname-d 2024-09-10T16:36:36.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:36.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:36:36.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 1 -- 172.21.15.81:0/611445213 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0009e150 con 0x7f4b0009ca10 2024-09-10T16:36:36.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient: _finish_auth 0 2024-09-10T16:36:36.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient: _check_auth_tickets 2024-09-10T16:36:36.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:36.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 1 -- 172.21.15.81:0/611445213 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4afc001840 con 0x7f4b0009ca10 2024-09-10T16:36:36.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 5 monclient: authenticate success, global_id 144735 2024-09-10T16:36:36.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:36:36.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient: dump: 2024-09-10T16:36:36.119 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.119 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.119 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.119 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.120 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:36.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 1 -- 172.21.15.81:0/611445213 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4afc001a60 con 0x7f4b0009ca10 2024-09-10T16:36:36.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:36.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:36.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 1 -- 172.21.15.81:0/611445213 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4afc004bf0 con 0x7f4b0009ca10 2024-09-10T16:36:36.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 4 set_mon_vals no callback set 2024-09-10T16:36:36.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:36:36.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b0543f640 10 monclient: dump: 2024-09-10T16:36:36.121 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.121 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.121 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.121 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.121 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.122 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.122 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.122 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.122 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.122 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.122 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.122 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.122 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.122 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.122 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.122 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 10 monclient: shutdown 2024-09-10T16:36:36.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 1 -- 172.21.15.81:0/611445213 >> v1:172.21.15.81:6792/0 conn(0x7f4b0009ca10 legacy=0x7f4b00135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 1 -- 172.21.15.81:0/611445213 shutdown_connections 2024-09-10T16:36:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 1 -- 172.21.15.81:0/611445213 >> 172.21.15.81:0/611445213 conn(0x7f4b0006dc90 msgr2=0x7f4b000ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 1 -- 172.21.15.81:0/611445213 shutdown_connections 2024-09-10T16:36:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 1 -- 172.21.15.81:0/611445213 wait complete. 2024-09-10T16:36:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 10 monclient: build_initial_monmap 2024-09-10T16:36:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 10 monclient: monmap: 2024-09-10T16:36:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:36.123 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:36.124 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 1 Processor -- start 2024-09-10T16:36:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 1 -- start start 2024-09-10T16:36:36.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.107+0000 7f4b086a5640 10 monclient: init 2024-09-10T16:36:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 10 monclient: _add_conns ranks=[0,3,8,5,6,2,4,7,1] 2024-09-10T16:36:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 10 monclient(hunting): picked mon.noname-a con 0x7f4b0009ca10 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 10 monclient(hunting): picked mon.noname-g con 0x7f4b000a56e0 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 10 monclient(hunting): picked mon.noname-e con 0x7f4b000a5b00 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b000aaa30 con 0x7f4b0009ca10 2024-09-10T16:36:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b00131fd0 con 0x7f4b000a56e0 2024-09-10T16:36:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b001322b0 con 0x7f4b000a5b00 2024-09-10T16:36:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 10 monclient(hunting): authenticate will time out at 1363.512303s 2024-09-10T16:36:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b06441640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4b0009ca10 0x7f4b001cd5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37354/0 (socket says 172.21.15.81:37354) 2024-09-10T16:36:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b06441640 1 -- 172.21.15.81:0/3044853505 learned_addr learned my addr 172.21.15.81:0/3044853505 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:36.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3683514748 0 0) 0x7f4b001322b0 con 0x7f4b000a5b00 2024-09-10T16:36:36.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): my global_id is 6551 2024-09-10T16:36:36.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ae4003530 con 0x7f4b000a5b00 2024-09-10T16:36:36.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 984380058 0 0) 0x7f4b0009e150 con 0x7f4b0009ca10 2024-09-10T16:36:36.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): my global_id is 6525 2024-09-10T16:36:36.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b001322b0 con 0x7f4b0009ca10 2024-09-10T16:36:36.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2595980861 0 0) 0x7f4ae4003530 con 0x7f4b000a5b00 2024-09-10T16:36:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b0009e150 con 0x7f4b000a5b00 2024-09-10T16:36:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1298317118 0 0) 0x7f4b001322b0 con 0x7f4b0009ca10 2024-09-10T16:36:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4ae4003530 con 0x7f4b0009ca10 2024-09-10T16:36:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 522753604 0 0) 0x7f4b00131fd0 con 0x7f4b000a56e0 2024-09-10T16:36:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): my global_id is 164136 2024-09-10T16:36:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b001322b0 con 0x7f4b000a56e0 2024-09-10T16:36:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4af8001cd0 con 0x7f4b000a5b00 2024-09-10T16:36:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:36.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:36:36.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): dump: 2024-09-10T16:36:36.128 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.128 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.128 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.128 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.128 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.128 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.128 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.128 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.128 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.128 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.128 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.128 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.129 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.129 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.129 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.129 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:36.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4afc004b30 con 0x7f4b0009ca10 2024-09-10T16:36:36.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:36.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:36.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): dump: 2024-09-10T16:36:36.129 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.129 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.129 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.130 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.130 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.130 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.130 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.130 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.130 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.130 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.130 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.130 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.130 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.130 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.130 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.130 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 418891087 0 0) 0x7f4b0009e150 con 0x7f4b000a5b00 2024-09-10T16:36:36.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 >> v1:172.21.15.189:6790/0 conn(0x7f4b000a56e0 legacy=0x7f4b001cdcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 >> v1:172.21.15.81:6789/0 conn(0x7f4b0009ca10 legacy=0x7f4b001cd5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:36:36.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 monclient: found mon.e 2024-09-10T16:36:36.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:36.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:36:36.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b000aa520 con 0x7f4b000a5b00 2024-09-10T16:36:36.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient: _finish_auth 0 2024-09-10T16:36:36.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:36:36.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:36.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 5 monclient: authenticate success, global_id 6551 2024-09-10T16:36:36.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 10 monclient: _renew_subs 2024-09-10T16:36:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:36:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4b000aa180 con 0x7f4b000a5b00 2024-09-10T16:36:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 10 monclient: _renew_subs 2024-09-10T16:36:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:36:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4af8002030 con 0x7f4b000a5b00 2024-09-10T16:36:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f4b00131cf0 con 0x7f4b000a5b00 2024-09-10T16:36:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4af8003f70 con 0x7f4b000a5b00 2024-09-10T16:36:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient: dump: 2024-09-10T16:36:36.132 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.133 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.134 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b04c3e640 4 set_mon_vals no callback set 2024-09-10T16:36:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b086a5640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4b00130de0 con 0x7f4b00142d70 2024-09-10T16:36:36.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f4af800fe80 con 0x7f4b000a5b00 2024-09-10T16:36:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(324..324 src has 121..324) ==== 3506+0+0 (unknown 2961462200 0 0) 0x7f4af8049d80 con 0x7f4b000a5b00 2024-09-10T16:36:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834369234 0 0) 0x7f4afc001140 con 0x7f4b00142d70 2024-09-10T16:36:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient(hunting): my global_id is 144744 2024-09-10T16:36:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b0009e150 con 0x7f4b00142d70 2024-09-10T16:36:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4b05c40640 10 monclient: get_auth_request con 0x7f4ae403d6e0 auth_method 0 2024-09-10T16:36:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2389628636 0 0) 0x7f4b0009e150 con 0x7f4b00142d70 2024-09-10T16:36:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4afc001140 con 0x7f4b00142d70 2024-09-10T16:36:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4afc0051f0 con 0x7f4b00142d70 2024-09-10T16:36:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:36:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient: dump: 2024-09-10T16:36:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.136 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.137 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.137 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.137 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.137 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 3678753019 0 0) 0x7f4afc001140 con 0x7f4b00142d70 2024-09-10T16:36:36.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4b000008e0 con 0x7f4b00142d70 2024-09-10T16:36:36.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4afc0053b0 con 0x7f4b00142d70 2024-09-10T16:36:36.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:36.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:36.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 >> v1:172.21.15.81:6792/0 conn(0x7f4b00142d70 legacy=0x7f4b00136770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.111+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 >> v1:172.21.15.81:6792/0 conn(0x7f4b00142d70 legacy=0x7f4b00136770 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4b086a5640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:36:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4b086a5640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4b00132a40 con 0x7f4b0002e460 2024-09-10T16:36:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2559209165 0 0) 0x7f4b00132a40 con 0x7f4b0002e460 2024-09-10T16:36:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 10 monclient(hunting): my global_id is 144753 2024-09-10T16:36:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4afc001140 con 0x7f4b0002e460 2024-09-10T16:36:36.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 57018019 0 0) 0x7f4afc001140 con 0x7f4b0002e460 2024-09-10T16:36:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b00132a40 con 0x7f4b0002e460 2024-09-10T16:36:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4afc005be0 con 0x7f4b0002e460 2024-09-10T16:36:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:36:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 10 monclient: dump: 2024-09-10T16:36:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.141 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1856424122 0 0) 0x7f4b00132a40 con 0x7f4b0002e460 2024-09-10T16:36:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 --> v1:172.21.15.81:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4b0002e840 con 0x7f4b0002e460 2024-09-10T16:36:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 <== mon.6 v1:172.21.15.81:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 3140677535) 0x7f4afc0080e0 con 0x7f4b0002e460 2024-09-10T16:36:36.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:36:36.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:36:36.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 >> v1:172.21.15.81:6792/0 conn(0x7f4b0002e460 legacy=0x7f4b00136e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4af6ffd640 1 -- 172.21.15.81:0/3044853505 >> v1:172.21.15.81:6792/0 conn(0x7f4b0002e460 legacy=0x7f4b00136e80 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:36.142 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:36:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:36:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:36:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 44, 2024-09-10T16:36:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 138966, 2024-09-10T16:36:36.142 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-09-10T16:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:36:36.143 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:36:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.144 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:36:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:36:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.145 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:36:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:36:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:36:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:36:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:36:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:36:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:36:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:36:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:36:36.146 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:36:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:36:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:36:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:36:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:36:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.147 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:36:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:36:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:36:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:36:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.148 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:36:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:36:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:36:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.149 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:36:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:36:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:36:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.150 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:36:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:36:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:36:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:36:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.151 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:36:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:36:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:36:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.152 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:36:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:36:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:36:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:36:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:36:36.153 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:36:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:36:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:36:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.154 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:36:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:36:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:36:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:36:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.155 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:36:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:36:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:36:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:36:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:36:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:36:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.157 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:36:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:36:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:36:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:36:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:36:36.158 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:36:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:36:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.159 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:36:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:36:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:36:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.160 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:36:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:36:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:36:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:36:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:36.161 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:36:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:36:36.162 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 2 2024-09-10T16:36:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.163 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:36:36.163 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4b086a5640 1 -- 172.21.15.81:0/3044853505 >> v1:172.21.15.189:6812/1108603242 conn(0x7f4ae403d6e0 legacy=0x7f4ae403fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4b086a5640 10 monclient: shutdown 2024-09-10T16:36:36.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4b086a5640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4b086a5640 1 -- 172.21.15.81:0/3044853505 >> v1:172.21.15.81:6793/0 conn(0x7f4b000a5b00 legacy=0x7f4b001d5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4b06c42640 1 -- 172.21.15.81:0/3044853505 reap_dead start 2024-09-10T16:36:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4b06c42640 1 -- 172.21.15.81:0/3044853505 reap_dead start 2024-09-10T16:36:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4b086a5640 1 -- 172.21.15.81:0/3044853505 shutdown_connections 2024-09-10T16:36:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4b086a5640 1 -- 172.21.15.81:0/3044853505 >> 172.21.15.81:0/3044853505 conn(0x7f4b0006dc90 msgr2=0x7f4b000a82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4b086a5640 1 -- 172.21.15.81:0/3044853505 shutdown_connections 2024-09-10T16:36:36.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.119+0000 7f4b086a5640 1 -- 172.21.15.81:0/3044853505 wait complete. 2024-09-10T16:36:36.165 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:36:36.165 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon e 2024-09-10T16:36:36.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.e mon_status 2024-09-10T16:36:36.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.279+0000 7f4d35642640 10 monclient: get_monmap_and_config 2024-09-10T16:36:36.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.279+0000 7f4d35642640 10 monclient: build_initial_monmap 2024-09-10T16:36:36.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.279+0000 7f4d35642640 10 monclient: monmap: 2024-09-10T16:36:36.283 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:36.283 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:36.285038+0000 2024-09-10T16:36:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:36.285038+0000 2024-09-10T16:36:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:36.284 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:36.285 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:36.285 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:36.285 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 1 Processor -- start 2024-09-10T16:36:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 1 -- start start 2024-09-10T16:36:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient: init 2024-09-10T16:36:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient: _add_conns ranks=[6,8,1,7,5,2,0,3,4] 2024-09-10T16:36:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient(hunting): picked mon.noname-d con 0x7f4d3009e9d0 addr v1:172.21.15.81:6792/0 2024-09-10T16:36:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient(hunting): picked mon.noname-e con 0x7f4d3009f4c0 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient(hunting): picked mon.noname-f con 0x7f4d3013bf80 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:36.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3009fd40 con 0x7f4d3013bf80 2024-09-10T16:36:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d300a01c0 con 0x7f4d3009e9d0 2024-09-10T16:36:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3009fb00 con 0x7f4d3009f4c0 2024-09-10T16:36:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient(hunting): authenticate will time out at 1363.684918s 2024-09-10T16:36:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2effd640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f4d3009e9d0 0x7f4d3009edb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:40176/0 (socket says 172.21.15.81:40176) 2024-09-10T16:36:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2effd640 1 -- 172.21.15.81:0/3237832730 learned_addr learned my addr 172.21.15.81:0/3237832730 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 1 -- 172.21.15.81:0/3237832730 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3894521677 0 0) 0x7f4d3009fb00 con 0x7f4d3009f4c0 2024-09-10T16:36:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient(hunting): my global_id is 6560 2024-09-10T16:36:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 1 -- 172.21.15.81:0/3237832730 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d18003450 con 0x7f4d3009f4c0 2024-09-10T16:36:36.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 1 -- 172.21.15.81:0/3237832730 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1162540843 0 0) 0x7f4d300a01c0 con 0x7f4d3009e9d0 2024-09-10T16:36:36.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient(hunting): my global_id is 144762 2024-09-10T16:36:36.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 1 -- 172.21.15.81:0/3237832730 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d3009fb00 con 0x7f4d3009e9d0 2024-09-10T16:36:36.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 1 -- 172.21.15.81:0/3237832730 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3471796991 0 0) 0x7f4d18003450 con 0x7f4d3009f4c0 2024-09-10T16:36:36.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 1 -- 172.21.15.81:0/3237832730 >> v1:172.21.15.81:6792/0 conn(0x7f4d3009e9d0 legacy=0x7f4d3009edb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 1 -- 172.21.15.81:0/3237832730 >> v1:172.21.15.189:6789/0 conn(0x7f4d3013bf80 legacy=0x7f4d3013e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient: _finish_hunting 0 2024-09-10T16:36:36.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 1 monclient: found mon.noname-e 2024-09-10T16:36:36.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:36.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:36:36.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 1 -- 172.21.15.81:0/3237832730 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3009ff40 con 0x7f4d3009f4c0 2024-09-10T16:36:36.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient: _finish_auth 0 2024-09-10T16:36:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient: _check_auth_tickets 2024-09-10T16:36:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 1 -- 172.21.15.81:0/3237832730 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4d24001860 con 0x7f4d3009f4c0 2024-09-10T16:36:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:36:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient: dump: 2024-09-10T16:36:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.295 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.296 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.296 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.296 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.296 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.296 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.296 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.296 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.296 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 5 monclient: authenticate success, global_id 6560 2024-09-10T16:36:36.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:36.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 1 -- 172.21.15.81:0/3237832730 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d24001a80 con 0x7f4d3009f4c0 2024-09-10T16:36:36.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:36.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 1 -- 172.21.15.81:0/3237832730 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4d24003960 con 0x7f4d3009f4c0 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 4 set_mon_vals no callback set 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d2dffb640 10 monclient: dump: 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.297 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.298 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient: shutdown 2024-09-10T16:36:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 1 -- 172.21.15.81:0/3237832730 >> v1:172.21.15.81:6793/0 conn(0x7f4d3009f4c0 legacy=0x7f4d3013a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 1 -- 172.21.15.81:0/3237832730 shutdown_connections 2024-09-10T16:36:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 1 -- 172.21.15.81:0/3237832730 >> 172.21.15.81:0/3237832730 conn(0x7f4d300a3fd0 msgr2=0x7f4d300a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 1 -- 172.21.15.81:0/3237832730 shutdown_connections 2024-09-10T16:36:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 1 -- 172.21.15.81:0/3237832730 wait complete. 2024-09-10T16:36:36.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient: build_initial_monmap 2024-09-10T16:36:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient: monmap: 2024-09-10T16:36:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:36.299 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:36.300 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 1 Processor -- start 2024-09-10T16:36:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 1 -- start start 2024-09-10T16:36:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient: init 2024-09-10T16:36:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient: _add_conns ranks=[6,5,8,7,4,1,0,3,2] 2024-09-10T16:36:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.283+0000 7f4d35642640 10 monclient(hunting): picked mon.noname-d con 0x7f4d3009e9d0 addr v1:172.21.15.81:6792/0 2024-09-10T16:36:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 10 monclient(hunting): picked mon.noname-h con 0x7f4d3009f4c0 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:36.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 10 monclient(hunting): picked mon.noname-e con 0x7f4d3013bf80 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:36.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3008edc0 con 0x7f4d3009f4c0 2024-09-10T16:36:36.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d30074630 con 0x7f4d3009e9d0 2024-09-10T16:36:36.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d3009da60 con 0x7f4d3013bf80 2024-09-10T16:36:36.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:36.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 10 monclient(hunting): authenticate will time out at 1363.688066s 2024-09-10T16:36:36.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d2effd640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f4d3009e9d0 0x7f4d3008dfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:40182/0 (socket says 172.21.15.81:40182) 2024-09-10T16:36:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d2effd640 1 -- 172.21.15.81:0/210475222 learned_addr learned my addr 172.21.15.81:0/210475222 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3454812051 0 0) 0x7f4d30074630 con 0x7f4d3009e9d0 2024-09-10T16:36:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): my global_id is 144771 2024-09-10T16:36:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d1c003530 con 0x7f4d3009e9d0 2024-09-10T16:36:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 168721840 0 0) 0x7f4d3009da60 con 0x7f4d3013bf80 2024-09-10T16:36:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): my global_id is 6569 2024-09-10T16:36:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d30074630 con 0x7f4d3013bf80 2024-09-10T16:36:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 815848967 0 0) 0x7f4d1c003530 con 0x7f4d3009e9d0 2024-09-10T16:36:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d3009da60 con 0x7f4d3009e9d0 2024-09-10T16:36:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4d20001bc0 con 0x7f4d3009e9d0 2024-09-10T16:36:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:36:36.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): dump: 2024-09-10T16:36:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.304 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.305 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3386921462 0 0) 0x7f4d30074630 con 0x7f4d3013bf80 2024-09-10T16:36:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d1c003530 con 0x7f4d3013bf80 2024-09-10T16:36:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4d28001c80 con 0x7f4d3013bf80 2024-09-10T16:36:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): dump: 2024-09-10T16:36:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.305 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.306 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1908424899 0 0) 0x7f4d3009da60 con 0x7f4d3009e9d0 2024-09-10T16:36:36.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 >> v1:172.21.15.81:6793/0 conn(0x7f4d3013bf80 legacy=0x7f4d301d1930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 >> v1:172.21.15.189:6791/0 conn(0x7f4d3009f4c0 legacy=0x7f4d3008e6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: _finish_hunting 0 2024-09-10T16:36:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 monclient: found mon.d 2024-09-10T16:36:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d3013b920 con 0x7f4d3009e9d0 2024-09-10T16:36:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: _finish_auth 0 2024-09-10T16:36:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: _check_auth_tickets 2024-09-10T16:36:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 5 monclient: authenticate success, global_id 144771 2024-09-10T16:36:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 10 monclient: _renew_subs 2024-09-10T16:36:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:36.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4d300740a0 con 0x7f4d3009e9d0 2024-09-10T16:36:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 10 monclient: _renew_subs 2024-09-10T16:36:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f4d301d3050 con 0x7f4d3009e9d0 2024-09-10T16:36:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4d20004aa0 con 0x7f4d3009e9d0 2024-09-10T16:36:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4d20004f90 con 0x7f4d3009e9d0 2024-09-10T16:36:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:36:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d2d7fa640 4 set_mon_vals no callback set 2024-09-10T16:36:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: dump: 2024-09-10T16:36:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.308 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.309 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d35642640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4d100065d0 con 0x7f4d10002870 2024-09-10T16:36:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f4d20010ea0 con 0x7f4d3009e9d0 2024-09-10T16:36:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(324..324 src has 121..324) ==== 3506+0+0 (unknown 2961462200 0 0) 0x7f4d2004acf0 con 0x7f4d3009e9d0 2024-09-10T16:36:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3220632226 0 0) 0x7f4d100065d0 con 0x7f4d10002870 2024-09-10T16:36:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): my global_id is 6578 2024-09-10T16:36:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d3009da60 con 0x7f4d10002870 2024-09-10T16:36:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2121461577 0 0) 0x7f4d3009da60 con 0x7f4d10002870 2024-09-10T16:36:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d100065d0 con 0x7f4d10002870 2024-09-10T16:36:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4d24003980 con 0x7f4d10002870 2024-09-10T16:36:36.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: dump: 2024-09-10T16:36:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.311 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.312 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d2f7fe640 10 monclient: get_auth_request con 0x7f4d1c03d760 auth_method 0 2024-09-10T16:36:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2565916545 0 0) 0x7f4d100065d0 con 0x7f4d10002870 2024-09-10T16:36:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d1000a170 con 0x7f4d10002870 2024-09-10T16:36:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d2e7fc640 1 -- 172.21.15.81:0/210475222 >> v1:172.21.15.81:6793/0 conn(0x7f4d10002870 legacy=0x7f4d10004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 17 2024-09-10T16:36:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d2e7fc640 1 -- 172.21.15.81:0/210475222 >> v1:172.21.15.81:6793/0 conn(0x7f4d10002870 legacy=0x7f4d10004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-10T16:36:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d2e7fc640 1 --1- 172.21.15.81:0/210475222 >> v1:172.21.15.81:6793/0 conn(0x7f4d10002870 0x7f4d10004d10 :-1 s=OPENED pgs=507 cs=1 l=1).handle_message read tag failed 2024-09-10T16:36:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d2e7fc640 1 --1- 172.21.15.81:0/210475222 >> v1:172.21.15.81:6793/0 conn(0x7f4d10002870 0x7f4d10004d10 :-1 s=OPENED pgs=507 cs=1 l=1).fault on lossy channel, failing 2024-09-10T16:36:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 >> v1:172.21.15.81:6793/0 conn(0x7f4d10002870 legacy=0x7f4d10004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 >> v1:172.21.15.81:6793/0 conn(0x7f4d10002870 legacy=0x7f4d10004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:36.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4d100065d0 con 0x7f4d1c045630 2024-09-10T16:36:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3329252370 0 0) 0x7f4d100065d0 con 0x7f4d1c045630 2024-09-10T16:36:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient(hunting): my global_id is 6587 2024-09-10T16:36:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d3009da60 con 0x7f4d1c045630 2024-09-10T16:36:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2452033198 0 0) 0x7f4d3009da60 con 0x7f4d1c045630 2024-09-10T16:36:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d100065d0 con 0x7f4d1c045630 2024-09-10T16:36:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4d24001cd0 con 0x7f4d1c045630 2024-09-10T16:36:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: dump: 2024-09-10T16:36:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.314 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.315 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 445397646 0 0) 0x7f4d100065d0 con 0x7f4d1c045630 2024-09-10T16:36:36.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6793/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4d1c044fe0 con 0x7f4d1c045630 2024-09-10T16:36:36.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f4d24007480 con 0x7f4d1c045630 2024-09-10T16:36:36.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:36.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:36.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 >> v1:172.21.15.81:6793/0 conn(0x7f4d1c045630 legacy=0x7f4d1c043c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.287+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 >> v1:172.21.15.81:6793/0 conn(0x7f4d1c045630 legacy=0x7f4d1c043c40 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:36.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d35642640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:36:36.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d35642640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f4d10009e40 con 0x7f4d10009120 2024-09-10T16:36:36.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3161947005 0 0) 0x7f4d10009e40 con 0x7f4d10009120 2024-09-10T16:36:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 10 monclient(hunting): my global_id is 6596 2024-09-10T16:36:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d100065d0 con 0x7f4d10009120 2024-09-10T16:36:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 208103097 0 0) 0x7f4d100065d0 con 0x7f4d10009120 2024-09-10T16:36:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4d10009e40 con 0x7f4d10009120 2024-09-10T16:36:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4d240055b0 con 0x7f4d10009120 2024-09-10T16:36:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 10 monclient: dump: 2024-09-10T16:36:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.317 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.318 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2804191551 0 0) 0x7f4d10009e40 con 0x7f4d10009120 2024-09-10T16:36:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 --> v1:172.21.15.81:6793/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f4d1000c400 con 0x7f4d10009120 2024-09-10T16:36:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 <== mon.8 v1:172.21.15.81:6793/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7711 (unknown 0 0 4194935466) 0x7f4d24007630 con 0x7f4d10009120 2024-09-10T16:36:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:36:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:36:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 >> v1:172.21.15.81:6793/0 conn(0x7f4d10009120 legacy=0x7f4d10009590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d177fe640 1 -- 172.21.15.81:0/210475222 >> v1:172.21.15.81:6793/0 conn(0x7f4d10009120 legacy=0x7f4d10009590 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d2f7fe640 1 -- 172.21.15.81:0/210475222 reap_dead start 2024-09-10T16:36:36.319 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:36.319 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:36:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:36:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:36:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 44, 2024-09-10T16:36:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 406256, 2024-09-10T16:36:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:36:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:36:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:36:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:36:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:36:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:36:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:36:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:36:36.320 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:36:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:36:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-09-10T16:36:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:36:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:36:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.321 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:36:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:36:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.322 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:36:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:36:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:36:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:36:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:36:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:36:36.323 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:36:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:36:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:36:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:36:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:36:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:36:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:36:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:36:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.324 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:36:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:36:36.325 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:36:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:36:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:36:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:36:36.326 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:36:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:36:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:36:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:36:36.327 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:36:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:36:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:36:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:36:36.328 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:36:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:36:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:36:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.329 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:36:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:36:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:36:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:36:36.330 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:36:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:36:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:36:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:36:36.331 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:36:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:36:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:36:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:36:36.332 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:36:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:36:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:36:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.333 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:36:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:36:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:36:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:36:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:36:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:36:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:36:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:36:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:36:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:36:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.336 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:36:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:36:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:36:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:36:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:36:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.337 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:36:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:36:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": [ 2024-09-10T16:36:36.338 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:36:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 3 2024-09-10T16:36:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.339 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:36:36.340 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d35642640 1 -- 172.21.15.81:0/210475222 >> v1:172.21.15.189:6812/1108603242 conn(0x7f4d1c03d760 legacy=0x7f4d1c03fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d35642640 10 monclient: shutdown 2024-09-10T16:36:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d35642640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d35642640 1 -- 172.21.15.81:0/210475222 >> v1:172.21.15.81:6792/0 conn(0x7f4d3009e9d0 legacy=0x7f4d3008dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d35642640 1 -- 172.21.15.81:0/210475222 shutdown_connections 2024-09-10T16:36:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d35642640 1 -- 172.21.15.81:0/210475222 >> 172.21.15.81:0/210475222 conn(0x7f4d300a3fd0 msgr2=0x7f4d3009a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d35642640 1 -- 172.21.15.81:0/210475222 shutdown_connections 2024-09-10T16:36:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.295+0000 7f4d35642640 1 -- 172.21.15.81:0/210475222 wait complete. 2024-09-10T16:36:36.342 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:36:36.342 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon f 2024-09-10T16:36:36.342 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.f mon_status 2024-09-10T16:36:36.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.455+0000 7f095e416640 10 monclient: get_monmap_and_config 2024-09-10T16:36:36.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.455+0000 7f095e416640 10 monclient: build_initial_monmap 2024-09-10T16:36:36.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.455+0000 7f095e416640 10 monclient: monmap: 2024-09-10T16:36:36.459 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:36.459 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.459 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:36.460496+0000 2024-09-10T16:36:36.459 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:36.460496+0000 2024-09-10T16:36:36.459 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:36.459 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.459 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:36.459 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:36.460 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:36.460 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:36.460 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:36.460 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:36.460 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:36.460 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:36.460 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:36.460 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.455+0000 7f095e416640 1 Processor -- start 2024-09-10T16:36:36.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.455+0000 7f095e416640 1 -- start start 2024-09-10T16:36:36.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.455+0000 7f095e416640 10 monclient: init 2024-09-10T16:36:36.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.455+0000 7f095e416640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.455+0000 7f095e416640 10 monclient: _add_conns ranks=[2,6,1,0,7,8,4,5,3] 2024-09-10T16:36:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.455+0000 7f095e416640 10 monclient(hunting): picked mon.noname-b con 0x7f09580a0a90 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.455+0000 7f095e416640 10 monclient(hunting): picked mon.noname-d con 0x7f09580a35f0 addr v1:172.21.15.81:6792/0 2024-09-10T16:36:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.455+0000 7f095e416640 10 monclient(hunting): picked mon.noname-f con 0x7f09580a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.455+0000 7f095e416640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f095809df70 con 0x7f09580a3a40 2024-09-10T16:36:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f095809fa30 con 0x7f09580a0a90 2024-09-10T16:36:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f095809fd10 con 0x7f09580a35f0 2024-09-10T16:36:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 10 monclient(hunting): authenticate will time out at 1363.860039s 2024-09-10T16:36:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f0957fff640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f09580a0a90 0x7f09580a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34176/0 (socket says 172.21.15.81:34176) 2024-09-10T16:36:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f0957fff640 1 -- 172.21.15.81:0/4102688644 learned_addr learned my addr 172.21.15.81:0/4102688644 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 1 -- 172.21.15.81:0/4102688644 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 53874400 0 0) 0x7f095809fa30 con 0x7f09580a0a90 2024-09-10T16:36:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient(hunting): my global_id is 144929 2024-09-10T16:36:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 1 -- 172.21.15.81:0/4102688644 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0944003530 con 0x7f09580a0a90 2024-09-10T16:36:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 1 -- 172.21.15.81:0/4102688644 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3685699891 0 0) 0x7f095809fd10 con 0x7f09580a35f0 2024-09-10T16:36:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient(hunting): my global_id is 144780 2024-09-10T16:36:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 1 -- 172.21.15.81:0/4102688644 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f095809fa30 con 0x7f09580a35f0 2024-09-10T16:36:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 1 -- 172.21.15.81:0/4102688644 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3242819133 0 0) 0x7f0944003530 con 0x7f09580a0a90 2024-09-10T16:36:36.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 1 -- 172.21.15.81:0/4102688644 >> v1:172.21.15.81:6792/0 conn(0x7f09580a35f0 legacy=0x7f095813c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 1 -- 172.21.15.81:0/4102688644 >> v1:172.21.15.189:6789/0 conn(0x7f09580a3a40 legacy=0x7f095813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient: _finish_hunting 0 2024-09-10T16:36:36.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 1 monclient: found mon.noname-b 2024-09-10T16:36:36.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:36.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:36:36.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 1 -- 172.21.15.81:0/4102688644 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095809fff0 con 0x7f09580a0a90 2024-09-10T16:36:36.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient: _finish_auth 0 2024-09-10T16:36:36.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient: _check_auth_tickets 2024-09-10T16:36:36.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:36.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 5 monclient: authenticate success, global_id 144929 2024-09-10T16:36:36.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 1 -- 172.21.15.81:0/4102688644 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0948001840 con 0x7f09580a0a90 2024-09-10T16:36:36.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:36.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:36.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient: dump: 2024-09-10T16:36:36.471 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.471 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.471 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.471 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.471 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.471 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.471 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.471 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.471 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.472 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 1 -- 172.21.15.81:0/4102688644 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0948001a60 con 0x7f09580a0a90 2024-09-10T16:36:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 1 -- 172.21.15.81:0/4102688644 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0948004bf0 con 0x7f09580a0a90 2024-09-10T16:36:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:36.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 4 set_mon_vals no callback set 2024-09-10T16:36:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09577fe640 10 monclient: dump: 2024-09-10T16:36:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.473 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.474 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 10 monclient: shutdown 2024-09-10T16:36:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 1 -- 172.21.15.81:0/4102688644 >> v1:172.21.15.81:6790/0 conn(0x7f09580a0a90 legacy=0x7f09580a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 1 -- 172.21.15.81:0/4102688644 shutdown_connections 2024-09-10T16:36:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 1 -- 172.21.15.81:0/4102688644 >> 172.21.15.81:0/4102688644 conn(0x7f09580a3fd0 msgr2=0x7f09580a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 1 -- 172.21.15.81:0/4102688644 shutdown_connections 2024-09-10T16:36:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 1 -- 172.21.15.81:0/4102688644 wait complete. 2024-09-10T16:36:36.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 10 monclient: build_initial_monmap 2024-09-10T16:36:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 10 monclient: monmap: 2024-09-10T16:36:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:36.475 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:36.476 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 1 Processor -- start 2024-09-10T16:36:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 1 -- start start 2024-09-10T16:36:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 10 monclient: init 2024-09-10T16:36:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 10 monclient: _add_conns ranks=[1,2,4,5,0,7,6,8,3] 2024-09-10T16:36:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 10 monclient(hunting): picked mon.noname-f con 0x7f09580a0a90 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 10 monclient(hunting): picked mon.noname-b con 0x7f09580a35f0 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 10 monclient(hunting): picked mon.noname-c con 0x7f09580a3a40 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:36.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f095806f8e0 con 0x7f09580a0a90 2024-09-10T16:36:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f09580a4780 con 0x7f09580a35f0 2024-09-10T16:36:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f095809cb10 con 0x7f09580a3a40 2024-09-10T16:36:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095e416640 10 monclient(hunting): authenticate will time out at 1363.863247s 2024-09-10T16:36:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f094f7fe640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f09580a35f0 0x7f09581d2f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34188/0 (socket says 172.21.15.81:34188) 2024-09-10T16:36:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f094f7fe640 1 -- 172.21.15.81:0/3217974700 learned_addr learned my addr 172.21.15.81:0/3217974700 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f095c9b3640 1 --1- 172.21.15.81:0/3217974700 >> v1:172.21.15.81:6791/0 conn(0x7f09580a3a40 0x7f09581d6650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:49086/0 (socket says 172.21.15.81:49086) 2024-09-10T16:36:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2524894971 0 0) 0x7f09580a4780 con 0x7f09580a35f0 2024-09-10T16:36:36.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): my global_id is 144938 2024-09-10T16:36:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0938003530 con 0x7f09580a35f0 2024-09-10T16:36:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4165610340 0 0) 0x7f095809cb10 con 0x7f09580a3a40 2024-09-10T16:36:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): my global_id is 144778 2024-09-10T16:36:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f09580a4780 con 0x7f09580a3a40 2024-09-10T16:36:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1511424088 0 0) 0x7f09580a4780 con 0x7f09580a3a40 2024-09-10T16:36:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f095809cb10 con 0x7f09580a3a40 2024-09-10T16:36:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0950001d60 con 0x7f09580a3a40 2024-09-10T16:36:36.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:36.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:36:36.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): dump: 2024-09-10T16:36:36.479 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.479 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.479 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.479 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.479 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.479 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.479 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.479 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.479 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.479 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1139477882 0 0) 0x7f0938003530 con 0x7f09580a35f0 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f09580a4780 con 0x7f09580a35f0 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f09400014f0 con 0x7f09580a35f0 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.459+0000 7f09557fa640 10 monclient(hunting): dump: 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.480 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.481 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.482 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175699401 0 0) 0x7f095806f8e0 con 0x7f09580a0a90 2024-09-10T16:36:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient(hunting): my global_id is 164170 2024-09-10T16:36:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0938003530 con 0x7f09580a0a90 2024-09-10T16:36:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1854245009 0 0) 0x7f095809cb10 con 0x7f09580a3a40 2024-09-10T16:36:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 >> v1:172.21.15.81:6790/0 conn(0x7f09580a35f0 legacy=0x7f09581d2f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 >> v1:172.21.15.189:6789/0 conn(0x7f09580a0a90 legacy=0x7f09581cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient: _finish_hunting 0 2024-09-10T16:36:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 monclient: found mon.c 2024-09-10T16:36:36.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09581b6e00 con 0x7f09580a3a40 2024-09-10T16:36:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient: _finish_auth 0 2024-09-10T16:36:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient: _check_auth_tickets 2024-09-10T16:36:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f095e416640 5 monclient: authenticate success, global_id 144778 2024-09-10T16:36:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f095e416640 10 monclient: _renew_subs 2024-09-10T16:36:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f095e416640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f095e416640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f09581bb310 con 0x7f09580a3a40 2024-09-10T16:36:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f095e416640 10 monclient: _renew_subs 2024-09-10T16:36:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f095e416640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f095e416640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f09581b6b20 con 0x7f09580a3a40 2024-09-10T16:36:36.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0950002060 con 0x7f09580a3a40 2024-09-10T16:36:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0950003f90 con 0x7f09580a3a40 2024-09-10T16:36:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f0956ffd640 4 set_mon_vals no callback set 2024-09-10T16:36:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient: dump: 2024-09-10T16:36:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.484 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.485 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f095e416640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f095e416640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f093c0065d0 con 0x7f093c002870 2024-09-10T16:36:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f0950004130 con 0x7f09580a3a40 2024-09-10T16:36:36.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(324..324 src has 121..324) ==== 3506+0+0 (unknown 2961462200 0 0) 0x7f095004aea0 con 0x7f09580a3a40 2024-09-10T16:36:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f094f7fe640 10 monclient: get_auth_request con 0x7f093803d780 auth_method 0 2024-09-10T16:36:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3321669711 0 0) 0x7f093c0065d0 con 0x7f093c002870 2024-09-10T16:36:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient(hunting): my global_id is 164179 2024-09-10T16:36:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f095809cb10 con 0x7f093c002870 2024-09-10T16:36:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2621868917 0 0) 0x7f095809cb10 con 0x7f093c002870 2024-09-10T16:36:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f093c0065d0 con 0x7f093c002870 2024-09-10T16:36:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0948004c30 con 0x7f093c002870 2024-09-10T16:36:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:36:36.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient: dump: 2024-09-10T16:36:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.487 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.488 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.488 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 354779260 0 0) 0x7f093c0065d0 con 0x7f093c002870 2024-09-10T16:36:36.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.189:6789/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f093c00a170 con 0x7f093c002870 2024-09-10T16:36:36.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7f0948001620 con 0x7f093c002870 2024-09-10T16:36:36.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:36.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:36.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 >> v1:172.21.15.189:6789/0 conn(0x7f093c002870 legacy=0x7f093c004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.463+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 >> v1:172.21.15.189:6789/0 conn(0x7f093c002870 legacy=0x7f093c004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f095e416640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:36:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f095e416640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7f093c009e80 con 0x7f093c009140 2024-09-10T16:36:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2833712513 0 0) 0x7f093c009e80 con 0x7f093c009140 2024-09-10T16:36:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 10 monclient(hunting): my global_id is 164188 2024-09-10T16:36:36.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f093c0065d0 con 0x7f093c009140 2024-09-10T16:36:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.1 v1:172.21.15.189:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1541732504 0 0) 0x7f093c0065d0 con 0x7f093c009140 2024-09-10T16:36:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.189:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f093c009e80 con 0x7f093c009140 2024-09-10T16:36:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.1 v1:172.21.15.189:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0948005000 con 0x7f093c009140 2024-09-10T16:36:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 10 monclient: got monmap 1 from mon.f (according to old e1) 2024-09-10T16:36:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 10 monclient: dump: 2024-09-10T16:36:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.491 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.492 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.1 v1:172.21.15.189:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2218446306 0 0) 0x7f093c009e80 con 0x7f093c009140 2024-09-10T16:36:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 --> v1:172.21.15.189:6789/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7f093c00c420 con 0x7f093c009140 2024-09-10T16:36:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 <== mon.1 v1:172.21.15.189:6789/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7542 (unknown 0 0 1251848830) 0x7f09480051e0 con 0x7f093c009140 2024-09-10T16:36:36.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:36:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:36:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 >> v1:172.21.15.189:6789/0 conn(0x7f093c009140 legacy=0x7f093c0095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.471+0000 7f09557fa640 1 -- 172.21.15.81:0/3217974700 >> v1:172.21.15.189:6789/0 conn(0x7f093c009140 legacy=0x7f093c0095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:36.493 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:36:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:36:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:36:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 44, 2024-09-10T16:36:36.493 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 9835, 2024-09-10T16:36:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:36:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:36:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:36:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:36:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:36:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:36:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:36:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:36:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:36:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:36:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-09-10T16:36:36.494 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:36:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:36:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.495 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:36:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:36:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.496 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:36:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:36:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:36:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:36:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:36:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:36:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:36:36.497 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.498 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:36:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:36:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:36:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:36:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.499 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:36:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:36:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:36:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:36:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:36:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:36:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.501 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:36:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:36:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:36:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:36:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:36:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:36:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:36:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.503 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:36:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:36:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:36:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:36:36.504 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:36:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:36:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:36:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:36:36.505 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:36:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:36:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:36:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:36:36.506 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:36:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:36:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:36:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.507 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:36:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:36:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:36:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:36:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:36:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:36:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:36:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:36:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:36:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:36:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:36:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:36:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:36:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:36:36.511 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:36:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:36:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:36:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.512 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:36:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.513 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:36:36.513 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:36.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.475+0000 7f095e416640 1 -- 172.21.15.81:0/3217974700 >> v1:172.21.15.189:6812/1108603242 conn(0x7f093803d780 legacy=0x7f093803fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.475+0000 7f095e416640 10 monclient: shutdown 2024-09-10T16:36:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.475+0000 7f095e416640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.475+0000 7f095e416640 1 -- 172.21.15.81:0/3217974700 >> v1:172.21.15.81:6791/0 conn(0x7f09580a3a40 legacy=0x7f09581d6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.475+0000 7f095c9b3640 1 -- 172.21.15.81:0/3217974700 reap_dead start 2024-09-10T16:36:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.475+0000 7f095c9b3640 1 -- 172.21.15.81:0/3217974700 reap_dead start 2024-09-10T16:36:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.475+0000 7f095e416640 1 -- 172.21.15.81:0/3217974700 shutdown_connections 2024-09-10T16:36:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.475+0000 7f095e416640 1 -- 172.21.15.81:0/3217974700 >> 172.21.15.81:0/3217974700 conn(0x7f09580a3fd0 msgr2=0x7f095809a9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:36.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.475+0000 7f095e416640 1 -- 172.21.15.81:0/3217974700 shutdown_connections 2024-09-10T16:36:36.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.475+0000 7f095e416640 1 -- 172.21.15.81:0/3217974700 wait complete. 2024-09-10T16:36:36.516 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:36:36.516 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon g 2024-09-10T16:36:36.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.g mon_status 2024-09-10T16:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 10 monclient: get_monmap_and_config 2024-09-10T16:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 10 monclient: build_initial_monmap 2024-09-10T16:36:36.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 10 monclient: monmap: 2024-09-10T16:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:36.634156+0000 2024-09-10T16:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:36.634156+0000 2024-09-10T16:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:36.633 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:36.634 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:36.634 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 1 Processor -- start 2024-09-10T16:36:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 1 -- start start 2024-09-10T16:36:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 10 monclient: init 2024-09-10T16:36:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 10 monclient: _add_conns ranks=[3,4,8,7,1,0,5,6,2] 2024-09-10T16:36:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 10 monclient(hunting): picked mon.noname-g con 0x7fd6481328c0 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 10 monclient(hunting): picked mon.noname-c con 0x7fd64809e7a0 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 10 monclient(hunting): picked mon.noname-e con 0x7fd64813f730 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd64806d540 con 0x7fd6481328c0 2024-09-10T16:36:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd64806d860 con 0x7fd64809e7a0 2024-09-10T16:36:36.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd64809d520 con 0x7fd64813f730 2024-09-10T16:36:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 10 monclient(hunting): authenticate will time out at 1364.033618s 2024-09-10T16:36:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64dab6640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fd64809e7a0 0x7fd64813e010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:49098/0 (socket says 172.21.15.81:49098) 2024-09-10T16:36:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64dab6640 1 -- 172.21.15.81:0/786287563 learned_addr learned my addr 172.21.15.81:0/786287563 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 1 -- 172.21.15.81:0/786287563 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3815917637 0 0) 0x7fd64806d860 con 0x7fd64809e7a0 2024-09-10T16:36:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient(hunting): my global_id is 144787 2024-09-10T16:36:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 1 -- 172.21.15.81:0/786287563 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd634003530 con 0x7fd64809e7a0 2024-09-10T16:36:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 1 -- 172.21.15.81:0/786287563 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3576322645 0 0) 0x7fd64809d520 con 0x7fd64813f730 2024-09-10T16:36:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient(hunting): my global_id is 6605 2024-09-10T16:36:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 1 -- 172.21.15.81:0/786287563 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd64806d860 con 0x7fd64813f730 2024-09-10T16:36:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 1 -- 172.21.15.81:0/786287563 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1408727728 0 0) 0x7fd634003530 con 0x7fd64809e7a0 2024-09-10T16:36:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 1 -- 172.21.15.81:0/786287563 >> v1:172.21.15.81:6793/0 conn(0x7fd64813f730 legacy=0x7fd648141b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 1 -- 172.21.15.81:0/786287563 >> v1:172.21.15.189:6790/0 conn(0x7fd6481328c0 legacy=0x7fd648132ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient: _finish_hunting 0 2024-09-10T16:36:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 1 monclient: found mon.noname-c 2024-09-10T16:36:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:36:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 1 -- 172.21.15.81:0/786287563 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd64809d800 con 0x7fd64809e7a0 2024-09-10T16:36:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient: _finish_auth 0 2024-09-10T16:36:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient: _check_auth_tickets 2024-09-10T16:36:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 1 -- 172.21.15.81:0/786287563 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd638001840 con 0x7fd64809e7a0 2024-09-10T16:36:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 5 monclient: authenticate success, global_id 144787 2024-09-10T16:36:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:36:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient: dump: 2024-09-10T16:36:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.644 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.645 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 1 -- 172.21.15.81:0/786287563 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd6380019e0 con 0x7fd64809e7a0 2024-09-10T16:36:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 4 set_mon_vals no callback set 2024-09-10T16:36:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 1 -- 172.21.15.81:0/786287563 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd638004bf0 con 0x7fd64809e7a0 2024-09-10T16:36:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd64d2b5640 10 monclient: dump: 2024-09-10T16:36:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.647 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 10 monclient: shutdown 2024-09-10T16:36:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 1 -- 172.21.15.81:0/786287563 >> v1:172.21.15.81:6791/0 conn(0x7fd64809e7a0 legacy=0x7fd64813e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 1 -- 172.21.15.81:0/786287563 shutdown_connections 2024-09-10T16:36:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 1 -- 172.21.15.81:0/786287563 >> 172.21.15.81:0/786287563 conn(0x7fd6480a47e0 msgr2=0x7fd6480a4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 1 -- 172.21.15.81:0/786287563 shutdown_connections 2024-09-10T16:36:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.631+0000 7fd65051b640 1 -- 172.21.15.81:0/786287563 wait complete. 2024-09-10T16:36:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 monclient: build_initial_monmap 2024-09-10T16:36:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 monclient: monmap: 2024-09-10T16:36:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:36.649 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 1 Processor -- start 2024-09-10T16:36:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 1 -- start start 2024-09-10T16:36:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 monclient: init 2024-09-10T16:36:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:36.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 monclient: _add_conns ranks=[2,7,5,8,6,1,0,4,3] 2024-09-10T16:36:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 monclient(hunting): picked mon.noname-b con 0x7fd64809e7a0 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 monclient(hunting): picked mon.noname-i con 0x7fd6481328c0 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 monclient(hunting): picked mon.noname-h con 0x7fd64813f730 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd648142b40 con 0x7fd64809e7a0 2024-09-10T16:36:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6480a1e90 con 0x7fd64813f730 2024-09-10T16:36:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd648135ab0 con 0x7fd6481328c0 2024-09-10T16:36:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 monclient(hunting): authenticate will time out at 1364.037322s 2024-09-10T16:36:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd64e2b7640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fd64809e7a0 0x7fd64813e0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34200/0 (socket says 172.21.15.81:34200) 2024-09-10T16:36:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd64e2b7640 1 -- 172.21.15.81:0/328039404 learned_addr learned my addr 172.21.15.81:0/328039404 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1458922216 0 0) 0x7fd644001280 con 0x7fd64809e7a0 2024-09-10T16:36:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): my global_id is 144947 2024-09-10T16:36:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd62c003560 con 0x7fd64809e7a0 2024-09-10T16:36:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2776627429 0 0) 0x7fd62c003560 con 0x7fd64809e7a0 2024-09-10T16:36:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd644001280 con 0x7fd64809e7a0 2024-09-10T16:36:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd644003620 con 0x7fd64809e7a0 2024-09-10T16:36:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): dump: 2024-09-10T16:36:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.652 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3499659692 0 0) 0x7fd6480a1e90 con 0x7fd64813f730 2024-09-10T16:36:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): my global_id is 164129 2024-09-10T16:36:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd62c003560 con 0x7fd64813f730 2024-09-10T16:36:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3111000240 0 0) 0x7fd648135ab0 con 0x7fd6481328c0 2024-09-10T16:36:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): my global_id is 164131 2024-09-10T16:36:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6480a1e90 con 0x7fd6481328c0 2024-09-10T16:36:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1445970243 0 0) 0x7fd644001280 con 0x7fd64809e7a0 2024-09-10T16:36:36.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 >> v1:172.21.15.189:6792/0 conn(0x7fd6481328c0 legacy=0x7fd6481d27a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 >> v1:172.21.15.189:6791/0 conn(0x7fd64813f730 legacy=0x7fd6481d5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient: _finish_hunting 0 2024-09-10T16:36:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 monclient: found mon.b 2024-09-10T16:36:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd648136350 con 0x7fd64809e7a0 2024-09-10T16:36:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient: _finish_auth 0 2024-09-10T16:36:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient: _check_auth_tickets 2024-09-10T16:36:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 5 monclient: authenticate success, global_id 144947 2024-09-10T16:36:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 monclient: _renew_subs 2024-09-10T16:36:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd648134b50 con 0x7fd64809e7a0 2024-09-10T16:36:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 monclient: _renew_subs 2024-09-10T16:36:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd648133940 con 0x7fd64809e7a0 2024-09-10T16:36:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd644003af0 con 0x7fd64809e7a0 2024-09-10T16:36:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd6440040e0 con 0x7fd64809e7a0 2024-09-10T16:36:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd64cab4640 4 set_mon_vals no callback set 2024-09-10T16:36:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient: dump: 2024-09-10T16:36:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.656 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.656 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd65051b640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd6300065d0 con 0x7fd630002870 2024-09-10T16:36:36.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fd644004300 con 0x7fd64809e7a0 2024-09-10T16:36:36.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(324..324 src has 121..324) ==== 3506+0+0 (unknown 2961462200 0 0) 0x7fd64404b030 con 0x7fd64809e7a0 2024-09-10T16:36:36.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd64eab8640 10 monclient: get_auth_request con 0x7fd62c03d180 auth_method 0 2024-09-10T16:36:36.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 316076880 0 0) 0x7fd6300065d0 con 0x7fd630002870 2024-09-10T16:36:36.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 10 monclient(hunting): my global_id is 164154 2024-09-10T16:36:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.635+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd644001280 con 0x7fd630002870 2024-09-10T16:36:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.639+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1533952289 0 0) 0x7fd644001280 con 0x7fd630002870 2024-09-10T16:36:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.639+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd6300065d0 con 0x7fd630002870 2024-09-10T16:36:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.639+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd638001430 con 0x7fd630002870 2024-09-10T16:36:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.639+0000 7fd63effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.639+0000 7fd63effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:36:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.639+0000 7fd63effd640 10 monclient: dump: 2024-09-10T16:36:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.661 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.662 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.639+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2054602318 0 0) 0x7fd6300065d0 con 0x7fd630002870 2024-09-10T16:36:36.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.639+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.189:6790/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd63000a170 con 0x7fd630002870 2024-09-10T16:36:36.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.639+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.3 v1:172.21.15.189:6790/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fd6380016e0 con 0x7fd630002870 2024-09-10T16:36:36.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.639+0000 7fd63effd640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:36.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.639+0000 7fd63effd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:36.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.639+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 >> v1:172.21.15.189:6790/0 conn(0x7fd630002870 legacy=0x7fd630004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.639+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 >> v1:172.21.15.189:6790/0 conn(0x7fd630002870 legacy=0x7fd630004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.643+0000 7fd65051b640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:36:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.643+0000 7fd65051b640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fd630009e80 con 0x7fd630009140 2024-09-10T16:36:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1750654881 0 0) 0x7fd630009e80 con 0x7fd630009140 2024-09-10T16:36:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 10 monclient(hunting): my global_id is 164163 2024-09-10T16:36:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd6300065d0 con 0x7fd630009140 2024-09-10T16:36:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.3 v1:172.21.15.189:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 3741415423 0 0) 0x7fd6300065d0 con 0x7fd630009140 2024-09-10T16:36:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.189:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd630009e80 con 0x7fd630009140 2024-09-10T16:36:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.3 v1:172.21.15.189:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd638001cd0 con 0x7fd630009140 2024-09-10T16:36:36.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 10 monclient: got monmap 1 from mon.g (according to old e1) 2024-09-10T16:36:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 10 monclient: dump: 2024-09-10T16:36:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.666 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.667 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.3 v1:172.21.15.189:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 4266500179 0 0) 0x7fd630009e80 con 0x7fd630009140 2024-09-10T16:36:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 --> v1:172.21.15.189:6790/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fd63000c420 con 0x7fd630009140 2024-09-10T16:36:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 <== mon.3 v1:172.21.15.189:6790/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 2365050654) 0x7fd638007060 con 0x7fd630009140 2024-09-10T16:36:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:36:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:36:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 >> v1:172.21.15.189:6790/0 conn(0x7fd630009140 legacy=0x7fd6300095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd63effd640 1 -- 172.21.15.81:0/328039404 >> v1:172.21.15.189:6790/0 conn(0x7fd630009140 legacy=0x7fd6300095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:36.668 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:36:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:36:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:36:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 44, 2024-09-10T16:36:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 10011, 2024-09-10T16:36:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:36:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:36:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:36:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:36:36.668 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:36:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:36:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:36:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:36:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:36:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:36:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-09-10T16:36:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:36:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:36:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.669 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:36:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:36:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.670 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:36:36.671 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:36:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:36:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:36:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:36:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:36:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:36:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:36:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:36:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:36:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:36:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:36:36.672 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:36:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:36:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.673 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:36:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:36:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:36:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:36:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:36:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:36:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:36:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:36:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:36:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.675 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:36:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:36:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:36:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:36:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:36:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:36:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.677 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:36:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:36:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:36:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:36:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.678 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:36:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:36:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:36:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.679 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:36:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:36:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:36:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:36:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:36:36.680 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:36:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:36:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:36:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.681 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:36:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:36:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:36:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:36:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:36:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:36:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:36:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.683 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:36:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:36:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:36:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:36:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:36:36.684 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:36:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:36:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:36:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:36:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:36:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:36:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:36:36.686 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:36:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.688 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:36:36.688 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd65051b640 1 -- 172.21.15.81:0/328039404 >> v1:172.21.15.189:6812/1108603242 conn(0x7fd62c03d180 legacy=0x7fd62c03f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd65051b640 10 monclient: shutdown 2024-09-10T16:36:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd65051b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd65051b640 1 -- 172.21.15.81:0/328039404 >> v1:172.21.15.81:6790/0 conn(0x7fd64809e7a0 legacy=0x7fd64813e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd64eab8640 1 -- 172.21.15.81:0/328039404 reap_dead start 2024-09-10T16:36:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd64eab8640 1 -- 172.21.15.81:0/328039404 reap_dead start 2024-09-10T16:36:36.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd65051b640 1 -- 172.21.15.81:0/328039404 shutdown_connections 2024-09-10T16:36:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd65051b640 1 -- 172.21.15.81:0/328039404 >> 172.21.15.81:0/328039404 conn(0x7fd6480a47e0 msgr2=0x7fd6480a2f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd65051b640 1 -- 172.21.15.81:0/328039404 shutdown_connections 2024-09-10T16:36:36.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.647+0000 7fd65051b640 1 -- 172.21.15.81:0/328039404 wait complete. 2024-09-10T16:36:36.690 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:36:36.690 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon h 2024-09-10T16:36:36.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.h mon_status 2024-09-10T16:36:36.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.807+0000 7fcbfa318640 10 monclient: get_monmap_and_config 2024-09-10T16:36:36.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.807+0000 7fcbfa318640 10 monclient: build_initial_monmap 2024-09-10T16:36:36.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.807+0000 7fcbfa318640 10 monclient: monmap: 2024-09-10T16:36:36.812 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:36.812 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:36.813896+0000 2024-09-10T16:36:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:36.813896+0000 2024-09-10T16:36:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:36.814 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 1 Processor -- start 2024-09-10T16:36:36.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 1 -- start start 2024-09-10T16:36:36.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 10 monclient: init 2024-09-10T16:36:36.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:36.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 10 monclient: _add_conns ranks=[4,7,8,0,3,2,5,1,6] 2024-09-10T16:36:36.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 10 monclient(hunting): picked mon.noname-c con 0x7fcbf40a0a90 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:36.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 10 monclient(hunting): picked mon.noname-i con 0x7fcbf40a35f0 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:36.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 10 monclient(hunting): picked mon.noname-e con 0x7fcbf40a3a40 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:36.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf409df70 con 0x7fcbf40a0a90 2024-09-10T16:36:36.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf409fa30 con 0x7fcbf40a35f0 2024-09-10T16:36:36.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf409fd10 con 0x7fcbf40a3a40 2024-09-10T16:36:36.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:36.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 10 monclient(hunting): authenticate will time out at 1364.213341s 2024-09-10T16:36:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf88b5640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fcbf40a3a40 0x7fcbf413fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35162/0 (socket says 172.21.15.81:35162) 2024-09-10T16:36:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf88b5640 1 -- 172.21.15.81:0/2490438404 learned_addr learned my addr 172.21.15.81:0/2490438404 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf3fff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fcbf40a0a90 0x7fcbf40a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:49106/0 (socket says 172.21.15.81:49106) 2024-09-10T16:36:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 1 -- 172.21.15.81:0/2490438404 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3099349068 0 0) 0x7fcbf409df70 con 0x7fcbf40a0a90 2024-09-10T16:36:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient(hunting): my global_id is 144796 2024-09-10T16:36:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 1 -- 172.21.15.81:0/2490438404 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbdc003530 con 0x7fcbf40a0a90 2024-09-10T16:36:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 1 -- 172.21.15.81:0/2490438404 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2222608551 0 0) 0x7fcbf409fd10 con 0x7fcbf40a3a40 2024-09-10T16:36:36.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient(hunting): my global_id is 6614 2024-09-10T16:36:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 1 -- 172.21.15.81:0/2490438404 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbf409df70 con 0x7fcbf40a3a40 2024-09-10T16:36:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 1 -- 172.21.15.81:0/2490438404 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2606313676 0 0) 0x7fcbdc003530 con 0x7fcbf40a0a90 2024-09-10T16:36:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 1 -- 172.21.15.81:0/2490438404 >> v1:172.21.15.81:6793/0 conn(0x7fcbf40a3a40 legacy=0x7fcbf413fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 1 -- 172.21.15.81:0/2490438404 >> v1:172.21.15.189:6792/0 conn(0x7fcbf40a35f0 legacy=0x7fcbf413c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:36:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 1 monclient: found mon.noname-c 2024-09-10T16:36:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:36:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 1 -- 172.21.15.81:0/2490438404 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf409fff0 con 0x7fcbf40a0a90 2024-09-10T16:36:36.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient: _finish_auth 0 2024-09-10T16:36:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:36:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 1 -- 172.21.15.81:0/2490438404 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcbe4001860 con 0x7fcbf40a0a90 2024-09-10T16:36:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 5 monclient: authenticate success, global_id 144796 2024-09-10T16:36:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:36:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient: dump: 2024-09-10T16:36:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.823 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.824 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.825 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 1 -- 172.21.15.81:0/2490438404 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcbe4001a80 con 0x7fcbf40a0a90 2024-09-10T16:36:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 1 -- 172.21.15.81:0/2490438404 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcbe4004b30 con 0x7fcbf40a0a90 2024-09-10T16:36:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 4 set_mon_vals no callback set 2024-09-10T16:36:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbf2ffd640 10 monclient: dump: 2024-09-10T16:36:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.825 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.826 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.826 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.826 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.826 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.826 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.826 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.826 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.826 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.826 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.826 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.826 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.826 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.826 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 10 monclient: shutdown 2024-09-10T16:36:36.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:36.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 1 -- 172.21.15.81:0/2490438404 >> v1:172.21.15.81:6791/0 conn(0x7fcbf40a0a90 legacy=0x7fcbf40a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 1 -- 172.21.15.81:0/2490438404 shutdown_connections 2024-09-10T16:36:36.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 1 -- 172.21.15.81:0/2490438404 >> 172.21.15.81:0/2490438404 conn(0x7fcbf40a3fd0 msgr2=0x7fcbf40a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:36.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 1 -- 172.21.15.81:0/2490438404 shutdown_connections 2024-09-10T16:36:36.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 1 -- 172.21.15.81:0/2490438404 wait complete. 2024-09-10T16:36:36.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 10 monclient: build_initial_monmap 2024-09-10T16:36:36.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 10 monclient: monmap: 2024-09-10T16:36:36.827 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:36.827 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:36.827 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:36.828 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:36.828 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:36.828 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:36.828 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:36.828 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:36.828 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:36.828 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:36.828 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:36.828 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:36.828 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:36.828 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:36.829 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 1 Processor -- start 2024-09-10T16:36:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 1 -- start start 2024-09-10T16:36:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.811+0000 7fcbfa318640 10 monclient: init 2024-09-10T16:36:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 10 monclient: _add_conns ranks=[4,7,5,3,6,8,0,1,2] 2024-09-10T16:36:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 10 monclient(hunting): picked mon.noname-c con 0x7fcbf40a0a90 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 10 monclient(hunting): picked mon.noname-i con 0x7fcbf40a35f0 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 10 monclient(hunting): picked mon.noname-h con 0x7fcbf40a3a40 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf4096980 con 0x7fcbf40a0a90 2024-09-10T16:36:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf4096c60 con 0x7fcbf40a3a40 2024-09-10T16:36:36.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcbf4096f40 con 0x7fcbf40a35f0 2024-09-10T16:36:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 10 monclient(hunting): authenticate will time out at 1364.216307s 2024-09-10T16:36:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf3fff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fcbf40a0a90 0x7fcbf409a750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:49108/0 (socket says 172.21.15.81:49108) 2024-09-10T16:36:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf3fff640 1 -- 172.21.15.81:0/2373508686 learned_addr learned my addr 172.21.15.81:0/2373508686 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2753884445 0 0) 0x7fcbf4096980 con 0x7fcbf40a0a90 2024-09-10T16:36:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient(hunting): my global_id is 144805 2024-09-10T16:36:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbe0003530 con 0x7fcbf40a0a90 2024-09-10T16:36:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1964067016 0 0) 0x7fcbe0003530 con 0x7fcbf40a0a90 2024-09-10T16:36:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcbf4096980 con 0x7fcbf40a0a90 2024-09-10T16:36:36.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcbe4004b30 con 0x7fcbf40a0a90 2024-09-10T16:36:36.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:36.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:36:36.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient(hunting): dump: 2024-09-10T16:36:36.831 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.831 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.831 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.831 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.831 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.831 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.831 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.831 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.831 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.831 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.832 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.832 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.832 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.832 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.832 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.832 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:36.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 814915825 0 0) 0x7fcbf4096980 con 0x7fcbf40a0a90 2024-09-10T16:36:36.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 >> v1:172.21.15.189:6792/0 conn(0x7fcbf40a35f0 legacy=0x7fcbf41d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 >> v1:172.21.15.189:6791/0 conn(0x7fcbf40a3a40 legacy=0x7fcbf41d4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:36:36.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 monclient: found mon.c 2024-09-10T16:36:36.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:36.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:36.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbf409ae60 con 0x7fcbf40a0a90 2024-09-10T16:36:36.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient: _finish_auth 0 2024-09-10T16:36:36.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:36:36.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:36.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 5 monclient: authenticate success, global_id 144805 2024-09-10T16:36:36.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 10 monclient: _renew_subs 2024-09-10T16:36:36.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:36.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 1 -- 172.21.15.81:0/2373508686 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fcbf4094fc0 con 0x7fcbf40a0a90 2024-09-10T16:36:36.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 10 monclient: _renew_subs 2024-09-10T16:36:36.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:36.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 1 -- 172.21.15.81:0/2373508686 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fcbf41cbc40 con 0x7fcbf40a0a90 2024-09-10T16:36:36.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fcbe4001a60 con 0x7fcbf40a0a90 2024-09-10T16:36:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcbe4005170 con 0x7fcbf40a0a90 2024-09-10T16:36:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf27fc640 4 set_mon_vals no callback set 2024-09-10T16:36:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient: dump: 2024-09-10T16:36:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.834 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.835 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.835 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.835 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.835 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.835 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.835 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.835 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.835 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.835 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:36.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbfa318640 1 -- 172.21.15.81:0/2373508686 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcbd40065d0 con 0x7fcbd4002870 2024-09-10T16:36:36.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fcbe4011080 con 0x7fcbf40a0a90 2024-09-10T16:36:36.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(324..324 src has 121..324) ==== 3506+0+0 (unknown 2961462200 0 0) 0x7fcbe404aff0 con 0x7fcbf40a0a90 2024-09-10T16:36:36.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf88b5640 10 monclient: get_auth_request con 0x7fcbe003cfa0 auth_method 0 2024-09-10T16:36:36.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1363334638 0 0) 0x7fcbd40065d0 con 0x7fcbd4002870 2024-09-10T16:36:36.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient(hunting): my global_id is 164147 2024-09-10T16:36:36.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbf4096980 con 0x7fcbd4002870 2024-09-10T16:36:36.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2600035658 0 0) 0x7fcbf4096980 con 0x7fcbd4002870 2024-09-10T16:36:36.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcbd40065d0 con 0x7fcbd4002870 2024-09-10T16:36:36.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcbe8001870 con 0x7fcbd4002870 2024-09-10T16:36:36.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:36:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 10 monclient: dump: 2024-09-10T16:36:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.837 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.838 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 725773230 0 0) 0x7fcbd40065d0 con 0x7fcbd4002870 2024-09-10T16:36:36.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.815+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 --> v1:172.21.15.189:6791/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcbd400a170 con 0x7fcbd4002870 2024-09-10T16:36:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.819+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fcbe8001c50 con 0x7fcbd4002870 2024-09-10T16:36:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.819+0000 7fcbf0ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.819+0000 7fcbf0ff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.819+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 >> v1:172.21.15.189:6791/0 conn(0x7fcbd4002870 legacy=0x7fcbd4004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.819+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 >> v1:172.21.15.189:6791/0 conn(0x7fcbd4002870 legacy=0x7fcbd4004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.823+0000 7fcbfa318640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:36:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.823+0000 7fcbfa318640 1 -- 172.21.15.81:0/2373508686 --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fcbd4009e80 con 0x7fcbd4009140 2024-09-10T16:36:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.823+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2624580917 0 0) 0x7fcbd4009e80 con 0x7fcbd4009140 2024-09-10T16:36:36.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.823+0000 7fcbf0ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.823+0000 7fcbf0ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.823+0000 7fcbf0ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.823+0000 7fcbf0ff9640 10 monclient(hunting): my global_id is 164156 2024-09-10T16:36:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.823+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcbd40065d0 con 0x7fcbd4009140 2024-09-10T16:36:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.823+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.5 v1:172.21.15.189:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2956877034 0 0) 0x7fcbd40065d0 con 0x7fcbd4009140 2024-09-10T16:36:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.823+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 --> v1:172.21.15.189:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fcbd4009e80 con 0x7fcbd4009140 2024-09-10T16:36:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.823+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.5 v1:172.21.15.189:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fcbe8003bf0 con 0x7fcbd4009140 2024-09-10T16:36:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.823+0000 7fcbf0ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.823+0000 7fcbf0ff9640 10 monclient: got monmap 1 from mon.h (according to old e1) 2024-09-10T16:36:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.823+0000 7fcbf0ff9640 10 monclient: dump: 2024-09-10T16:36:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:36.841 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:36.842 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:36.842 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.5 v1:172.21.15.189:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 1150917173 0 0) 0x7fcbd4009e80 con 0x7fcbd4009140 2024-09-10T16:36:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 --> v1:172.21.15.189:6791/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fcbd400c420 con 0x7fcbd4009140 2024-09-10T16:36:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 <== mon.5 v1:172.21.15.189:6791/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 3579737026) 0x7fcbe8003e10 con 0x7fcbd4009140 2024-09-10T16:36:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbf0ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:36:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbf0ff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:36:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 >> v1:172.21.15.189:6791/0 conn(0x7fcbd4009140 legacy=0x7fcbd40095d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbf0ff9640 1 -- 172.21.15.81:0/2373508686 >> v1:172.21.15.189:6791/0 conn(0x7fcbd4009140 legacy=0x7fcbd40095d0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:36.843 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:36.843 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:36:36.844 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:36:36.844 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:36:36.844 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 44, 2024-09-10T16:36:36.844 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 10183, 2024-09-10T16:36:36.844 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:36:36.844 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:36:36.844 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:36:36.844 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:36:36.844 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:36:36.844 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:36:36.844 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:36:36.845 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:36:36.845 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:36:36.845 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:36:36.845 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.845 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 3, 2024-09-10T16:36:36.845 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:36.845 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:36:36.845 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:36:36.845 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.845 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.846 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.846 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.846 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.846 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.846 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.846 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.846 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.846 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.846 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.846 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.846 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:36:36.847 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:36:36.847 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.847 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.847 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.847 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.847 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.847 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.847 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.847 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.847 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.847 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.847 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.848 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.849 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.849 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:36:36.849 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:36:36.849 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:36:36.849 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:36:36.849 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:36:36.849 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:36:36.849 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:36.850 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:36.850 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:36:36.850 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:36:36.850 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:36:36.850 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:36:36.850 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:36:36.850 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:36:36.850 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:36:36.850 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:36.850 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:36:36.850 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:36.850 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:36:36.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:36:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:36:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:36:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:36:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.852 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:36:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:36:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:36:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:36:36.853 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:36:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:36:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:36:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.854 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:36:36.855 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:36:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:36:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:36:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.856 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:36:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:36:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:36:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.857 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:36:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:36:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:36:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:36:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:36:36.858 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:36:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:36:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:36:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.859 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:36:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:36:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:36:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:36:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.860 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:36:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:36:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:36:36.861 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:36:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:36:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:36:36.862 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:36:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:36:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:36:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:36:36.863 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:36:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:36:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:36:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:36.864 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:36:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:36:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.865 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:36:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:36.866 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:36:36.866 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbfa318640 1 -- 172.21.15.81:0/2373508686 >> v1:172.21.15.189:6812/1108603242 conn(0x7fcbe003cfa0 legacy=0x7fcbe003f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbfa318640 10 monclient: shutdown 2024-09-10T16:36:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbfa318640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbfa318640 1 -- 172.21.15.81:0/2373508686 >> v1:172.21.15.81:6791/0 conn(0x7fcbf40a0a90 legacy=0x7fcbf409a750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbf88b5640 1 -- 172.21.15.81:0/2373508686 reap_dead start 2024-09-10T16:36:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbf88b5640 1 -- 172.21.15.81:0/2373508686 reap_dead start 2024-09-10T16:36:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbfa318640 1 -- 172.21.15.81:0/2373508686 shutdown_connections 2024-09-10T16:36:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbfa318640 1 -- 172.21.15.81:0/2373508686 >> 172.21.15.81:0/2373508686 conn(0x7fcbf40a3fd0 msgr2=0x7fcbf4074250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbfa318640 1 -- 172.21.15.81:0/2373508686 shutdown_connections 2024-09-10T16:36:36.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.827+0000 7fcbfa318640 1 -- 172.21.15.81:0/2373508686 wait complete. 2024-09-10T16:36:36.869 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:36:36.869 INFO:tasks.mon_thrash.mon_thrasher:waiting for quorum size 9 for mon i 2024-09-10T16:36:36.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mon.i mon_status 2024-09-10T16:36:36.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient: get_monmap_and_config 2024-09-10T16:36:36.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient: build_initial_monmap 2024-09-10T16:36:36.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient: monmap: 2024-09-10T16:36:36.989 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:36.989 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:36.989 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:36.990178+0000 2024-09-10T16:36:36.989 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:36.990178+0000 2024-09-10T16:36:36.989 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:36.989 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:36.989 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:36.989 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:36.989 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:36.989 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:36.989 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:36.989 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:36.989 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:36.990 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:36.990 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:36.990 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:36.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 1 Processor -- start 2024-09-10T16:36:36.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 1 -- start start 2024-09-10T16:36:36.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient: init 2024-09-10T16:36:36.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:36.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient: _add_conns ranks=[2,8,7,4,5,3,1,0,6] 2024-09-10T16:36:36.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient(hunting): picked mon.noname-b con 0x7fae7409ca10 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:36.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient(hunting): picked mon.noname-e con 0x7fae740a56e0 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:36.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient(hunting): picked mon.noname-i con 0x7fae740a5b00 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:36.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae741362b0 con 0x7fae7409ca10 2024-09-10T16:36:36.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae740a80b0 con 0x7fae740a5b00 2024-09-10T16:36:36.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7409de70 con 0x7fae740a56e0 2024-09-10T16:36:36.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:36.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient(hunting): authenticate will time out at 1364.389527s 2024-09-10T16:36:36.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae73fff640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fae7409ca10 0x7fae74135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34212/0 (socket says 172.21.15.81:34212) 2024-09-10T16:36:36.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae73fff640 1 -- 172.21.15.81:0/2206644470 learned_addr learned my addr 172.21.15.81:0/2206644470 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:36.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 1 -- 172.21.15.81:0/2206644470 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1562622522 0 0) 0x7fae741362b0 con 0x7fae7409ca10 2024-09-10T16:36:36.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient(hunting): my global_id is 144956 2024-09-10T16:36:36.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 1 -- 172.21.15.81:0/2206644470 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae5c003530 con 0x7fae7409ca10 2024-09-10T16:36:36.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 1 -- 172.21.15.81:0/2206644470 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1690015669 0 0) 0x7fae7409de70 con 0x7fae740a56e0 2024-09-10T16:36:36.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:36.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:36.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:36.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient(hunting): my global_id is 6623 2024-09-10T16:36:36.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 1 -- 172.21.15.81:0/2206644470 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae741362b0 con 0x7fae740a56e0 2024-09-10T16:36:36.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 1 -- 172.21.15.81:0/2206644470 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3040802187 0 0) 0x7fae741362b0 con 0x7fae740a56e0 2024-09-10T16:36:36.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 1 -- 172.21.15.81:0/2206644470 >> v1:172.21.15.189:6792/0 conn(0x7fae740a5b00 legacy=0x7fae74141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 1 -- 172.21.15.81:0/2206644470 >> v1:172.21.15.81:6790/0 conn(0x7fae7409ca10 legacy=0x7fae74135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:36.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:36:36.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 1 monclient: found mon.noname-e 2024-09-10T16:36:36.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:36.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:36:36.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 1 -- 172.21.15.81:0/2206644470 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae7409e150 con 0x7fae740a56e0 2024-09-10T16:36:36.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient: _finish_auth 0 2024-09-10T16:36:36.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:36:36.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:36.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 1 -- 172.21.15.81:0/2206644470 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fae68001820 con 0x7fae740a56e0 2024-09-10T16:36:36.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:36.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:36:36.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient: dump: 2024-09-10T16:36:37.000 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:37.000 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:37.000 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.000 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.000 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:37.000 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:37.000 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:37.000 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:37.000 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:37.000 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:37.000 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:37.000 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:37.000 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:37.001 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 5 monclient: authenticate success, global_id 6623 2024-09-10T16:36:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 1 -- 172.21.15.81:0/2206644470 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae680019c0 con 0x7fae740a56e0 2024-09-10T16:36:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 4 set_mon_vals no callback set 2024-09-10T16:36:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 1 -- 172.21.15.81:0/2206644470 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fae68003960 con 0x7fae740a56e0 2024-09-10T16:36:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae72ffd640 10 monclient: dump: 2024-09-10T16:36:37.001 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:37.002 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:37.002 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.002 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.002 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:37.002 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:37.002 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:37.002 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:37.002 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:37.002 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:37.002 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:37.002 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:37.002 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:37.002 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:37.003 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:37.003 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:37.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient: shutdown 2024-09-10T16:36:37.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:37.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 1 -- 172.21.15.81:0/2206644470 >> v1:172.21.15.81:6793/0 conn(0x7fae740a56e0 legacy=0x7fae7413df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:37.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 1 -- 172.21.15.81:0/2206644470 shutdown_connections 2024-09-10T16:36:37.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 1 -- 172.21.15.81:0/2206644470 >> 172.21.15.81:0/2206644470 conn(0x7fae7406dc90 msgr2=0x7fae740ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:37.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 1 -- 172.21.15.81:0/2206644470 shutdown_connections 2024-09-10T16:36:37.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 1 -- 172.21.15.81:0/2206644470 wait complete. 2024-09-10T16:36:37.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient: build_initial_monmap 2024-09-10T16:36:37.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.987+0000 7fae7a79f640 10 monclient: monmap: 2024-09-10T16:36:37.003 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:37.003 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:37.004 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:37.005 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 1 Processor -- start 2024-09-10T16:36:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 1 -- start start 2024-09-10T16:36:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 10 monclient: init 2024-09-10T16:36:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 10 monclient: _add_conns ranks=[5,4,0,8,7,6,2,1,3] 2024-09-10T16:36:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 10 monclient(hunting): picked mon.noname-h con 0x7fae7409ca10 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 10 monclient(hunting): picked mon.noname-c con 0x7fae740a56e0 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 10 monclient(hunting): picked mon.noname-a con 0x7fae740a5b00 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae74132cb0 con 0x7fae740a5b00 2024-09-10T16:36:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7409f4b0 con 0x7fae740a56e0 2024-09-10T16:36:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae7409f790 con 0x7fae7409ca10 2024-09-10T16:36:37.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:37.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 10 monclient(hunting): authenticate will time out at 1364.392861s 2024-09-10T16:36:37.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae78d3c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fae740a5b00 0x7fae741d5830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37370/0 (socket says 172.21.15.81:37370) 2024-09-10T16:36:37.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae78d3c640 1 -- 172.21.15.81:0/934157713 learned_addr learned my addr 172.21.15.81:0/934157713 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:37.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 507565991 0 0) 0x7fae74132cb0 con 0x7fae740a5b00 2024-09-10T16:36:37.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:37.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:37.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:37.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): my global_id is 6534 2024-09-10T16:36:37.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae60003530 con 0x7fae740a5b00 2024-09-10T16:36:37.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1897963342 0 0) 0x7fae7409f4b0 con 0x7fae740a56e0 2024-09-10T16:36:37.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:37.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): my global_id is 144814 2024-09-10T16:36:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae74132cb0 con 0x7fae740a56e0 2024-09-10T16:36:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3006087717 0 0) 0x7fae60003530 con 0x7fae740a5b00 2024-09-10T16:36:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae7409f4b0 con 0x7fae740a5b00 2024-09-10T16:36:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fae6c001e40 con 0x7fae740a5b00 2024-09-10T16:36:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:36:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): dump: 2024-09-10T16:36:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.007 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:37.008 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:37.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:37.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2497711896 0 0) 0x7fae7409f790 con 0x7fae7409ca10 2024-09-10T16:36:37.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:37.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:37.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:37.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): my global_id is 164165 2024-09-10T16:36:37.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae60003530 con 0x7fae7409ca10 2024-09-10T16:36:37.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1107040569 0 0) 0x7fae74132cb0 con 0x7fae740a56e0 2024-09-10T16:36:37.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae7409f790 con 0x7fae740a56e0 2024-09-10T16:36:37.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 809346285 0 0) 0x7fae7409f4b0 con 0x7fae740a5b00 2024-09-10T16:36:37.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 >> v1:172.21.15.189:6791/0 conn(0x7fae7409ca10 legacy=0x7fae741c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:37.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 >> v1:172.21.15.81:6791/0 conn(0x7fae740a56e0 legacy=0x7fae741ca6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:37.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:36:37.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 monclient: found mon.a 2024-09-10T16:36:37.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:37.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:37.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae741cadb0 con 0x7fae740a5b00 2024-09-10T16:36:37.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient: _finish_auth 0 2024-09-10T16:36:37.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:36:37.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:37.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 5 monclient: authenticate success, global_id 6534 2024-09-10T16:36:37.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 10 monclient: _renew_subs 2024-09-10T16:36:37.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:37.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fae741329e0 con 0x7fae740a5b00 2024-09-10T16:36:37.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 10 monclient: _renew_subs 2024-09-10T16:36:37.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fae74131e80 con 0x7fae740a5b00 2024-09-10T16:36:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fae6c003c50 con 0x7fae740a5b00 2024-09-10T16:36:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fae6c004200 con 0x7fae740a5b00 2024-09-10T16:36:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae727fc640 4 set_mon_vals no callback set 2024-09-10T16:36:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient: dump: 2024-09-10T16:36:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.011 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:37.012 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:37.012 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae7a79f640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fae540065d0 con 0x7fae54002870 2024-09-10T16:36:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fae6c004420 con 0x7fae740a5b00 2024-09-10T16:36:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(324..324 src has 121..324) ==== 3506+0+0 (unknown 2961462200 0 0) 0x7fae6c04b1a0 con 0x7fae740a5b00 2024-09-10T16:36:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2327835638 0 0) 0x7fae540065d0 con 0x7fae54002870 2024-09-10T16:36:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 10 monclient(hunting): my global_id is 164167 2024-09-10T16:36:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae7409f4b0 con 0x7fae54002870 2024-09-10T16:36:37.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae737fe640 10 monclient: get_auth_request con 0x7fae6003d290 auth_method 0 2024-09-10T16:36:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.991+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 1009029633 0 0) 0x7fae7409f4b0 con 0x7fae54002870 2024-09-10T16:36:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.995+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae540065d0 con 0x7fae54002870 2024-09-10T16:36:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.995+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fae640013b0 con 0x7fae54002870 2024-09-10T16:36:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.995+0000 7fae70ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.995+0000 7fae70ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:36:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.995+0000 7fae70ff9640 10 monclient: dump: 2024-09-10T16:36:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.014 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:37.015 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:37.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.995+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 140189298 0 0) 0x7fae540065d0 con 0x7fae54002870 2024-09-10T16:36:37.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.995+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.189:6792/0 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fae5400a170 con 0x7fae54002870 2024-09-10T16:36:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.995+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.7 v1:172.21.15.189:6792/0 5 ==== command_reply(tid 1: 0 ) ==== 8+0+9324 (unknown 0 0 4045327437) 0x7fae640016b0 con 0x7fae54002870 2024-09-10T16:36:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.995+0000 7fae70ff9640 10 monclient: handle_command_reply 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.995+0000 7fae70ff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.995+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 >> v1:172.21.15.189:6792/0 conn(0x7fae54002870 legacy=0x7fae54004d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.995+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 >> v1:172.21.15.189:6792/0 conn(0x7fae54002870 legacy=0x7fae54004d10 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.999+0000 7fae7a79f640 10 start_mon_command cmd=[{"prefix": "mon_status"}] 2024-09-10T16:36:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:36.999+0000 7fae7a79f640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 1) -- 0x7fae54009e60 con 0x7fae54009120 2024-09-10T16:36:37.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 624113082 0 0) 0x7fae54009e60 con 0x7fae54009120 2024-09-10T16:36:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 10 monclient(hunting): my global_id is 164176 2024-09-10T16:36:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae540065d0 con 0x7fae54009120 2024-09-10T16:36:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.7 v1:172.21.15.189:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 390+0+0 (unknown 2589571778 0 0) 0x7fae540065d0 con 0x7fae54009120 2024-09-10T16:36:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.189:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fae54009e60 con 0x7fae54009120 2024-09-10T16:36:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.7 v1:172.21.15.189:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fae64004d20 con 0x7fae54009120 2024-09-10T16:36:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 10 monclient: got monmap 1 from mon.i (according to old e1) 2024-09-10T16:36:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 10 monclient: dump: 2024-09-10T16:36:37.018 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:37.019 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:37.020 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.7 v1:172.21.15.189:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 206+0+0 (unknown 2750606044 0 0) 0x7fae54009e60 con 0x7fae54009120 2024-09-10T16:36:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 --> v1:172.21.15.189:6792/0 -- command(tid 2: {"prefix": "mon_status"}) -- 0x7fae5400c400 con 0x7fae54009120 2024-09-10T16:36:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 <== mon.7 v1:172.21.15.189:6792/0 5 ==== command_reply(tid 2: 0 ) ==== 8+0+7543 (unknown 0 0 2522739192) 0x7fae64006150 con 0x7fae54009120 2024-09-10T16:36:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 10 monclient: handle_command_reply 2 [{"prefix": "mon_status"}] 2024-09-10T16:36:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:36:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 >> v1:172.21.15.189:6792/0 conn(0x7fae54009120 legacy=0x7fae540095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:37.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae70ff9640 1 -- 172.21.15.81:0/934157713 >> v1:172.21.15.189:6792/0 conn(0x7fae54009120 legacy=0x7fae540095b0 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-10T16:36:37.020 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:37.020 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:36:37.021 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:36:37.021 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "peon", 2024-09-10T16:36:37.021 INFO:teuthology.orchestra.run.smithi081.stdout: "election_epoch": 44, 2024-09-10T16:36:37.021 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 10355, 2024-09-10T16:36:37.021 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum": [ 2024-09-10T16:36:37.021 INFO:teuthology.orchestra.run.smithi081.stdout: 0, 2024-09-10T16:36:37.021 INFO:teuthology.orchestra.run.smithi081.stdout: 1, 2024-09-10T16:36:37.021 INFO:teuthology.orchestra.run.smithi081.stdout: 2, 2024-09-10T16:36:37.021 INFO:teuthology.orchestra.run.smithi081.stdout: 3, 2024-09-10T16:36:37.021 INFO:teuthology.orchestra.run.smithi081.stdout: 4, 2024-09-10T16:36:37.021 INFO:teuthology.orchestra.run.smithi081.stdout: 5, 2024-09-10T16:36:37.021 INFO:teuthology.orchestra.run.smithi081.stdout: 6, 2024-09-10T16:36:37.022 INFO:teuthology.orchestra.run.smithi081.stdout: 7, 2024-09-10T16:36:37.022 INFO:teuthology.orchestra.run.smithi081.stdout: 8 2024-09-10T16:36:37.022 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:37.022 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_age": 4, 2024-09-10T16:36:37.022 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:37.022 INFO:teuthology.orchestra.run.smithi081.stdout: "required_con": "2450521708007866372", 2024-09-10T16:36:37.022 INFO:teuthology.orchestra.run.smithi081.stdout: "required_mon": [ 2024-09-10T16:36:37.022 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:37.022 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:37.022 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:37.022 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:37.022 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:37.022 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:37.023 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:37.023 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:37.023 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:37.023 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:37.023 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:37.023 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:37.023 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_con": "4540719139924082687", 2024-09-10T16:36:37.023 INFO:teuthology.orchestra.run.smithi081.stdout: "quorum_mon": [ 2024-09-10T16:36:37.023 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:37.023 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:37.023 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:37.023 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:37.023 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:37.023 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:37.024 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:37.024 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:37.024 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:37.024 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:37.024 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:37.024 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:37.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.024 INFO:teuthology.orchestra.run.smithi081.stdout: "outside_quorum": [], 2024-09-10T16:36:37.024 INFO:teuthology.orchestra.run.smithi081.stdout: "extra_probe_peers": [], 2024-09-10T16:36:37.024 INFO:teuthology.orchestra.run.smithi081.stdout: "sync_provider": [], 2024-09-10T16:36:37.024 INFO:teuthology.orchestra.run.smithi081.stdout: "monmap": { 2024-09-10T16:36:37.024 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 1, 2024-09-10T16:36:37.024 INFO:teuthology.orchestra.run.smithi081.stdout: "fsid": "9dc0ccd6-5839-4e7c-a06b-dacc65254ee8", 2024-09-10T16:36:37.025 INFO:teuthology.orchestra.run.smithi081.stdout: "modified": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:37.025 INFO:teuthology.orchestra.run.smithi081.stdout: "created": "2024-09-10T16:29:22.909160Z", 2024-09-10T16:36:37.025 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release": 19, 2024-09-10T16:36:37.025 INFO:teuthology.orchestra.run.smithi081.stdout: "min_mon_release_name": "squid", 2024-09-10T16:36:37.025 INFO:teuthology.orchestra.run.smithi081.stdout: "election_strategy": 3, 2024-09-10T16:36:37.025 INFO:teuthology.orchestra.run.smithi081.stdout: "disallowed_leaders: ": "", 2024-09-10T16:36:37.025 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false, 2024-09-10T16:36:37.025 INFO:teuthology.orchestra.run.smithi081.stdout: "tiebreaker_mon": "", 2024-09-10T16:36:37.025 INFO:teuthology.orchestra.run.smithi081.stdout: "removed_ranks: ": "", 2024-09-10T16:36:37.025 INFO:teuthology.orchestra.run.smithi081.stdout: "features": { 2024-09-10T16:36:37.025 INFO:teuthology.orchestra.run.smithi081.stdout: "persistent": [ 2024-09-10T16:36:37.025 INFO:teuthology.orchestra.run.smithi081.stdout: "kraken", 2024-09-10T16:36:37.025 INFO:teuthology.orchestra.run.smithi081.stdout: "luminous", 2024-09-10T16:36:37.026 INFO:teuthology.orchestra.run.smithi081.stdout: "mimic", 2024-09-10T16:36:37.026 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap-prune", 2024-09-10T16:36:37.026 INFO:teuthology.orchestra.run.smithi081.stdout: "nautilus", 2024-09-10T16:36:37.026 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus", 2024-09-10T16:36:37.026 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific", 2024-09-10T16:36:37.026 INFO:teuthology.orchestra.run.smithi081.stdout: "elector-pinging", 2024-09-10T16:36:37.026 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy", 2024-09-10T16:36:37.026 INFO:teuthology.orchestra.run.smithi081.stdout: "reef", 2024-09-10T16:36:37.026 INFO:teuthology.orchestra.run.smithi081.stdout: "squid" 2024-09-10T16:36:37.026 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:37.026 INFO:teuthology.orchestra.run.smithi081.stdout: "optional": [] 2024-09-10T16:36:37.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.026 INFO:teuthology.orchestra.run.smithi081.stdout: "mons": [ 2024-09-10T16:36:37.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.027 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 0, 2024-09-10T16:36:37.027 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "a", 2024-09-10T16:36:37.027 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:37.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:37.027 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.027 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:37.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789", 2024-09-10T16:36:37.027 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:37.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:37.027 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:37.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.027 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6789/0", 2024-09-10T16:36:37.028 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6789/0", 2024-09-10T16:36:37.028 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:37.028 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:37.028 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:37.028 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.028 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 1, 2024-09-10T16:36:37.028 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "f", 2024-09-10T16:36:37.028 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:37.028 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:37.028 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:37.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789", 2024-09-10T16:36:37.029 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:37.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:37.029 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:37.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.029 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6789/0", 2024-09-10T16:36:37.029 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6789/0", 2024-09-10T16:36:37.029 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:37.029 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:37.029 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:37.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.029 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 2, 2024-09-10T16:36:37.030 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "b", 2024-09-10T16:36:37.030 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:37.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:37.030 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.030 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:37.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790", 2024-09-10T16:36:37.030 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:37.030 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:37.030 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:37.030 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.030 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6790/0", 2024-09-10T16:36:37.030 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6790/0", 2024-09-10T16:36:37.031 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:37.031 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:37.031 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:37.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.031 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 3, 2024-09-10T16:36:37.031 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "g", 2024-09-10T16:36:37.031 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:37.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:37.031 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:37.031 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790", 2024-09-10T16:36:37.031 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:37.032 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:37.032 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:37.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.032 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6790/0", 2024-09-10T16:36:37.032 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6790/0", 2024-09-10T16:36:37.032 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:37.032 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:37.032 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:37.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.032 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.032 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 4, 2024-09-10T16:36:37.032 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "c", 2024-09-10T16:36:37.033 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:37.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:37.033 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.033 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:37.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791", 2024-09-10T16:36:37.033 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:37.033 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:37.033 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:37.033 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.033 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6791/0", 2024-09-10T16:36:37.033 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6791/0", 2024-09-10T16:36:37.033 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:37.033 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:37.034 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:37.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.034 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 5, 2024-09-10T16:36:37.034 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "h", 2024-09-10T16:36:37.034 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:37.034 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:37.034 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:37.034 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791", 2024-09-10T16:36:37.034 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:37.034 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:37.034 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:37.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6791/0", 2024-09-10T16:36:37.035 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6791/0", 2024-09-10T16:36:37.035 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:37.035 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:37.035 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:37.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.035 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 6, 2024-09-10T16:36:37.035 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "d", 2024-09-10T16:36:37.035 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:37.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:37.035 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:37.035 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792", 2024-09-10T16:36:37.036 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:37.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:37.036 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:37.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.036 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6792/0", 2024-09-10T16:36:37.036 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6792/0", 2024-09-10T16:36:37.036 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:37.036 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:37.036 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:37.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.036 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 7, 2024-09-10T16:36:37.037 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "i", 2024-09-10T16:36:37.037 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:37.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:37.037 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:37.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792", 2024-09-10T16:36:37.037 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:37.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:37.037 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:37.037 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.037 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.189:6792/0", 2024-09-10T16:36:37.037 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.189:6792/0", 2024-09-10T16:36:37.037 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:37.037 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:37.038 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:37.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.038 INFO:teuthology.orchestra.run.smithi081.stdout: "rank": 8, 2024-09-10T16:36:37.038 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "e", 2024-09-10T16:36:37.038 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addrs": { 2024-09-10T16:36:37.038 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-10T16:36:37.038 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.038 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-10T16:36:37.038 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793", 2024-09-10T16:36:37.038 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 0 2024-09-10T16:36:37.038 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:37.039 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:37.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.039 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.81:6793/0", 2024-09-10T16:36:37.039 INFO:teuthology.orchestra.run.smithi081.stdout: "public_addr": "172.21.15.81:6793/0", 2024-09-10T16:36:37.039 INFO:teuthology.orchestra.run.smithi081.stdout: "priority": 0, 2024-09-10T16:36:37.039 INFO:teuthology.orchestra.run.smithi081.stdout: "weight": 0, 2024-09-10T16:36:37.039 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_location": "{}" 2024-09-10T16:36:37.039 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:37.039 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:37.039 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.039 INFO:teuthology.orchestra.run.smithi081.stdout: "feature_map": { 2024-09-10T16:36:37.039 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": [ 2024-09-10T16:36:37.039 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: "client": [ 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: "features": "0x3f03dffffffdffff", 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: "release": "squid", 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 1 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout: "stretch_mode": false 2024-09-10T16:36:37.040 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:37.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae7a79f640 1 -- 172.21.15.81:0/934157713 >> v1:172.21.15.189:6812/1108603242 conn(0x7fae6003d290 legacy=0x7fae6003f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:37.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae7a79f640 10 monclient: shutdown 2024-09-10T16:36:37.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae7a79f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:37.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae7a79f640 1 -- 172.21.15.81:0/934157713 >> v1:172.21.15.81:6789/0 conn(0x7fae740a5b00 legacy=0x7fae741d5830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:37.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae78d3c640 1 -- 172.21.15.81:0/934157713 reap_dead start 2024-09-10T16:36:37.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae78d3c640 1 -- 172.21.15.81:0/934157713 reap_dead start 2024-09-10T16:36:37.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae7a79f640 1 -- 172.21.15.81:0/934157713 shutdown_connections 2024-09-10T16:36:37.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae7a79f640 1 -- 172.21.15.81:0/934157713 >> 172.21.15.81:0/934157713 conn(0x7fae7406dc90 msgr2=0x7fae740a82a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:37.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae7a79f640 1 -- 172.21.15.81:0/934157713 shutdown_connections 2024-09-10T16:36:37.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.003+0000 7fae7a79f640 1 -- 172.21.15.81:0/934157713 wait complete. 2024-09-10T16:36:37.043 INFO:tasks.mon_thrash.mon_thrasher:final quorum is size 9 2024-09-10T16:36:37.043 INFO:tasks.mon_thrash.mon_thrasher:triggering scrub 2024-09-10T16:36:37.043 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mon scrub 2024-09-10T16:36:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.155+0000 7fa2cd82a640 10 monclient: get_monmap_and_config 2024-09-10T16:36:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.155+0000 7fa2cd82a640 10 monclient: build_initial_monmap 2024-09-10T16:36:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.155+0000 7fa2cd82a640 10 monclient: monmap: 2024-09-10T16:36:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:37.161868+0000 2024-09-10T16:36:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:37.161868+0000 2024-09-10T16:36:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:37.161 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:37.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 1 Processor -- start 2024-09-10T16:36:37.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 1 -- start start 2024-09-10T16:36:37.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 10 monclient: init 2024-09-10T16:36:37.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:37.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 10 monclient: _add_conns ranks=[0,8,2,7,4,6,3,5,1] 2024-09-10T16:36:37.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 10 monclient(hunting): picked mon.noname-a con 0x7fa2c80a5510 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:37.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 10 monclient(hunting): picked mon.noname-e con 0x7fa2c8135bf0 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:37.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 10 monclient(hunting): picked mon.noname-b con 0x7fa2c8136060 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:37.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c809d7e0 con 0x7fa2c80a5510 2024-09-10T16:36:37.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c809dac0 con 0x7fa2c8136060 2024-09-10T16:36:37.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c809dda0 con 0x7fa2c8135bf0 2024-09-10T16:36:37.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:37.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 10 monclient(hunting): authenticate will time out at 1364.561381s 2024-09-10T16:36:37.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c6ffd640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fa2c80a5510 0x7fa2c80a58f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37376/0 (socket says 172.21.15.81:37376) 2024-09-10T16:36:37.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c6ffd640 1 -- 172.21.15.81:0/2190338061 learned_addr learned my addr 172.21.15.81:0/2190338061 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:37.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 1 -- 172.21.15.81:0/2190338061 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 301231989 0 0) 0x7fa2c809d7e0 con 0x7fa2c80a5510 2024-09-10T16:36:37.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:37.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:37.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:37.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient(hunting): my global_id is 6543 2024-09-10T16:36:37.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 1 -- 172.21.15.81:0/2190338061 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2b0003530 con 0x7fa2c80a5510 2024-09-10T16:36:37.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 1 -- 172.21.15.81:0/2190338061 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 612425814 0 0) 0x7fa2c809dda0 con 0x7fa2c8135bf0 2024-09-10T16:36:37.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:37.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:37.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:37.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient(hunting): my global_id is 6632 2024-09-10T16:36:37.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 1 -- 172.21.15.81:0/2190338061 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2c809d7e0 con 0x7fa2c8135bf0 2024-09-10T16:36:37.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 1 -- 172.21.15.81:0/2190338061 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3937785871 0 0) 0x7fa2c809dac0 con 0x7fa2c8136060 2024-09-10T16:36:37.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:37.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:37.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:37.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient(hunting): my global_id is 144965 2024-09-10T16:36:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 1 -- 172.21.15.81:0/2190338061 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2c809dda0 con 0x7fa2c8136060 2024-09-10T16:36:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 1 -- 172.21.15.81:0/2190338061 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2056245152 0 0) 0x7fa2b0003530 con 0x7fa2c80a5510 2024-09-10T16:36:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 1 -- 172.21.15.81:0/2190338061 >> v1:172.21.15.81:6793/0 conn(0x7fa2c8135bf0 legacy=0x7fa2c813de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 1 -- 172.21.15.81:0/2190338061 >> v1:172.21.15.81:6790/0 conn(0x7fa2c8136060 legacy=0x7fa2c8141560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:36:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 1 monclient: found mon.noname-a 2024-09-10T16:36:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:36:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 1 -- 172.21.15.81:0/2190338061 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c809cca0 con 0x7fa2c80a5510 2024-09-10T16:36:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient: _finish_auth 0 2024-09-10T16:36:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:36:37.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 1 -- 172.21.15.81:0/2190338061 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa2b8001840 con 0x7fa2c80a5510 2024-09-10T16:36:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:36:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient: dump: 2024-09-10T16:36:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:37.172 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:37.173 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 5 monclient: authenticate success, global_id 6543 2024-09-10T16:36:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 1 -- 172.21.15.81:0/2190338061 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa2b8001a60 con 0x7fa2c80a5510 2024-09-10T16:36:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 1 -- 172.21.15.81:0/2190338061 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa2b8001d50 con 0x7fa2c80a5510 2024-09-10T16:36:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:37.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 4 set_mon_vals no callback set 2024-09-10T16:36:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2c5ffb640 10 monclient: dump: 2024-09-10T16:36:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:37.175 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 10 monclient: shutdown 2024-09-10T16:36:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2190338061 >> v1:172.21.15.81:6789/0 conn(0x7fa2c80a5510 legacy=0x7fa2c80a58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2190338061 shutdown_connections 2024-09-10T16:36:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2190338061 >> 172.21.15.81:0/2190338061 conn(0x7fa2c806dae0 msgr2=0x7fa2c80ab8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2190338061 shutdown_connections 2024-09-10T16:36:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2190338061 wait complete. 2024-09-10T16:36:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 10 monclient: build_initial_monmap 2024-09-10T16:36:37.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 10 monclient: monmap: 2024-09-10T16:36:37.176 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:37.176 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:37.176 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:37.176 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:37.176 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:37.176 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:37.176 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:37.176 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:37.176 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:37.176 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:37.176 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:37.176 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:37.177 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 1 Processor -- start 2024-09-10T16:36:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 1 -- start start 2024-09-10T16:36:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.159+0000 7fa2cd82a640 10 monclient: init 2024-09-10T16:36:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 10 monclient: _add_conns ranks=[5,4,7,0,8,2,1,3,6] 2024-09-10T16:36:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 10 monclient(hunting): picked mon.noname-h con 0x7fa2c80a5510 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 10 monclient(hunting): picked mon.noname-c con 0x7fa2c8135bf0 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 10 monclient(hunting): picked mon.noname-i con 0x7fa2c8136060 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c80a6600 con 0x7fa2c8135bf0 2024-09-10T16:36:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c80a22e0 con 0x7fa2c80a5510 2024-09-10T16:36:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2c80a1080 con 0x7fa2c8136060 2024-09-10T16:36:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 10 monclient(hunting): authenticate will time out at 1364.564471s 2024-09-10T16:36:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2c67fc640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fa2c8135bf0 0x7fa2c80a4910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:49140/0 (socket says 172.21.15.81:49140) 2024-09-10T16:36:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2c67fc640 1 -- 172.21.15.81:0/2214342073 learned_addr learned my addr 172.21.15.81:0/2214342073 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 630702924 0 0) 0x7fa2c80a6600 con 0x7fa2c8135bf0 2024-09-10T16:36:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient(hunting): my global_id is 144823 2024-09-10T16:36:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2b4003530 con 0x7fa2c8135bf0 2024-09-10T16:36:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3278291289 0 0) 0x7fa2b4003530 con 0x7fa2c8135bf0 2024-09-10T16:36:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa2c80a6600 con 0x7fa2c8135bf0 2024-09-10T16:36:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa2bc001c00 con 0x7fa2c8135bf0 2024-09-10T16:36:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:36:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient(hunting): dump: 2024-09-10T16:36:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:37.180 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:37.180 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:37.180 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:37.180 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:37.180 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:37.180 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:37.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:37.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3075813182 0 0) 0x7fa2c80a6600 con 0x7fa2c8135bf0 2024-09-10T16:36:37.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 >> v1:172.21.15.189:6792/0 conn(0x7fa2c8136060 legacy=0x7fa2c81d56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:37.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 >> v1:172.21.15.189:6791/0 conn(0x7fa2c80a5510 legacy=0x7fa2c81cd350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:37.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient: _finish_hunting 0 2024-09-10T16:36:37.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 1 monclient: found mon.c 2024-09-10T16:36:37.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:37.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2c80a3100 con 0x7fa2c8135bf0 2024-09-10T16:36:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient: _finish_auth 0 2024-09-10T16:36:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient: _check_auth_tickets 2024-09-10T16:36:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 5 monclient: authenticate success, global_id 144823 2024-09-10T16:36:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 10 monclient: _renew_subs 2024-09-10T16:36:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2214342073 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa2c80a1be0 con 0x7fa2c8135bf0 2024-09-10T16:36:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 10 monclient: _renew_subs 2024-09-10T16:36:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2214342073 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa2c80a51f0 con 0x7fa2c8135bf0 2024-09-10T16:36:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa2bc0038b0 con 0x7fa2c8135bf0 2024-09-10T16:36:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:37.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa2bc003e60 con 0x7fa2c8135bf0 2024-09-10T16:36:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2c57fa640 4 set_mon_vals no callback set 2024-09-10T16:36:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 10 monclient: dump: 2024-09-10T16:36:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:37.183 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2214342073 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a8005090 con 0x7fa2c8135bf0 2024-09-10T16:36:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fa2bc004000 con 0x7fa2c8135bf0 2024-09-10T16:36:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(324..324 src has 121..324) ==== 3506+0+0 (unknown 2961462200 0 0) 0x7fa2bc04af60 con 0x7fa2c8135bf0 2024-09-10T16:36:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.163+0000 7fa2c6ffd640 10 monclient: get_auth_request con 0x7fa2b403d040 auth_method 0 2024-09-10T16:36:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.167+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7fa2bc016dc0 con 0x7fa2c8135bf0 2024-09-10T16:36:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.167+0000 7fa2affff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.167+0000 7fa2affff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:37.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.407+0000 7fa2cd82a640 10 start_mon_command cmd=[{"prefix": "mon scrub"}] 2024-09-10T16:36:37.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.407+0000 7fa2cd82a640 10 monclient: _send_command 2 [{"prefix": "mon scrub"}] 2024-09-10T16:36:37.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.407+0000 7fa2cd82a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:37.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.407+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2214342073 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "mon scrub"} v 0) -- 0x7fa2a8005c50 con 0x7fa2c8135bf0 2024-09-10T16:36:37.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.407+0000 7fa2affff640 1 -- 172.21.15.81:0/2214342073 <== mon.4 v1:172.21.15.81:6791/0 10 ==== mon_command_ack([{"prefix": "mon scrub"}]=0 v0) ==== 57+0+0 (unknown 246732539 0 0) 0x7fa2bc0166c0 con 0x7fa2c8135bf0 2024-09-10T16:36:37.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.407+0000 7fa2affff640 10 monclient: handle_mon_command_ack 2 [{"prefix": "mon scrub"}] 2024-09-10T16:36:37.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.407+0000 7fa2affff640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:36:37.414 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.414 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=9,kv=12,logm=55} crc {auth=928960290,config=1097430493,health=1703444597,kv=2369092401,logm=115731710}) 2024-09-10T16:36:37.414 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {auth=25,config=2,health=11,kv=13,logm=49} crc {auth=1099938730,config=1097430493,health=3602034646,kv=3059684873,logm=2657185035}) 2024-09-10T16:36:37.414 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.414 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=9,kv=12,logm=55} crc {auth=928960290,config=1097430493,health=1703444597,kv=2369092401,logm=115731710}) 2024-09-10T16:36:37.414 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {auth=24,config=2,health=12,kv=11,logm=51} crc {auth=262907752,config=1097430493,health=2627697767,kv=1091194264,logm=759515118}) 2024-09-10T16:36:37.414 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.414 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=9,kv=12,logm=55} crc {auth=928960290,config=1097430493,health=1703444597,kv=2369092401,logm=115731710}) 2024-09-10T16:36:37.414 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {auth=24,config=2,health=11,kv=13,logm=50} crc {auth=288616178,config=1097430493,health=895249892,kv=3059684873,logm=996732612}) 2024-09-10T16:36:37.414 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.414 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=9,kv=12,logm=55} crc {auth=928960290,config=1097430493,health=1703444597,kv=2369092401,logm=115731710}) 2024-09-10T16:36:37.415 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {auth=24,config=2,health=12,kv=13,logm=49} crc {auth=2773742039,config=1097430493,health=1361790972,kv=3059684873,logm=108238395}) 2024-09-10T16:36:37.415 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.415 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=9,kv=12,logm=55} crc {auth=928960290,config=1097430493,health=1703444597,kv=2369092401,logm=115731710}) 2024-09-10T16:36:37.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.411+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2214342073 >> v1:172.21.15.189:6812/1108603242 conn(0x7fa2b403d040 legacy=0x7fa2b403f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:37.415 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {auth=24,config=2,health=11,kv=12,logm=51} crc {auth=1349050304,config=1097430493,health=3602034646,kv=2748603262,logm=3336566315}) 2024-09-10T16:36:37.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.411+0000 7fa2cd82a640 10 monclient: shutdown 2024-09-10T16:36:37.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.411+0000 7fa2cd82a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:37.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.411+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2214342073 >> v1:172.21.15.81:6791/0 conn(0x7fa2c8135bf0 legacy=0x7fa2c80a4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:37.416 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.416 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=9,kv=12,logm=55} crc {auth=928960290,config=1097430493,health=1703444597,kv=2369092401,logm=115731710}) 2024-09-10T16:36:37.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.411+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2214342073 shutdown_connections 2024-09-10T16:36:37.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.411+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2214342073 >> 172.21.15.81:0/2214342073 conn(0x7fa2c806dae0 msgr2=0x7fa2c80a7380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:37.417 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {auth=24,config=2,health=11,kv=12,logm=51} crc {auth=1170757407,config=1097430494,health=3602034646,kv=2748603262,logm=3206301894}) 2024-09-10T16:36:37.417 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.417 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=9,kv=12,logm=55} crc {auth=928960290,config=1097430493,health=1703444597,kv=2369092401,logm=115731710}) 2024-09-10T16:36:37.418 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {auth=25,config=2,health=12,kv=12,logm=49} crc {auth=3070408018,config=1097430493,health=1361790972,kv=3059684873,logm=463288527}) 2024-09-10T16:36:37.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.411+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2214342073 shutdown_connections 2024-09-10T16:36:37.418 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.418 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {auth=22,config=2,health=9,kv=12,logm=55} crc {auth=928960290,config=1097430493,health=1703444597,kv=2369092401,logm=115731710}) 2024-09-10T16:36:37.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:37.411+0000 7fa2cd82a640 1 -- 172.21.15.81:0/2214342073 wait complete. 2024-09-10T16:36:37.421 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.411+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {auth=22,config=2,health=12,kv=13,logm=51} crc {auth=4235407944,config=1097430493,health=1361790972,kv=2786628694,logm=3536340097}) 2024-09-10T16:36:37.421 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.421 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1542358993}) 2024-09-10T16:36:37.421 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2750453917}) 2024-09-10T16:36:37.421 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.421 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1542358993}) 2024-09-10T16:36:37.421 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3487019256}) 2024-09-10T16:36:37.421 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.421 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1542358993}) 2024-09-10T16:36:37.421 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3600950955}) 2024-09-10T16:36:37.421 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.422 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1542358993}) 2024-09-10T16:36:37.422 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3934528867}) 2024-09-10T16:36:37.422 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.422 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1542358993}) 2024-09-10T16:36:37.422 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2631312587}) 2024-09-10T16:36:37.422 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.422 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1542358993}) 2024-09-10T16:36:37.422 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1482018225}) 2024-09-10T16:36:37.422 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.422 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1542358993}) 2024-09-10T16:36:37.422 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4093136703}) 2024-09-10T16:36:37.422 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.422 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1542358993}) 2024-09-10T16:36:37.423 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.415+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1577665947}) 2024-09-10T16:36:37.424 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.425 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152609395}) 2024-09-10T16:36:37.425 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1264124936}) 2024-09-10T16:36:37.425 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.425 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152609395}) 2024-09-10T16:36:37.425 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1573333335}) 2024-09-10T16:36:37.425 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.425 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152609395}) 2024-09-10T16:36:37.425 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1422932281}) 2024-09-10T16:36:37.425 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.425 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152609395}) 2024-09-10T16:36:37.425 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=12640516}) 2024-09-10T16:36:37.425 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.425 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152609395}) 2024-09-10T16:36:37.426 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=555213448}) 2024-09-10T16:36:37.426 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.426 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152609395}) 2024-09-10T16:36:37.426 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2470776728}) 2024-09-10T16:36:37.426 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.426 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152609395}) 2024-09-10T16:36:37.426 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1292596009}) 2024-09-10T16:36:37.426 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.426 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3152609395}) 2024-09-10T16:36:37.426 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.419+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1063600742}) 2024-09-10T16:36:37.430 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.430 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051544639}) 2024-09-10T16:36:37.430 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1782944119}) 2024-09-10T16:36:37.430 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.430 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051544639}) 2024-09-10T16:36:37.430 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3600055773}) 2024-09-10T16:36:37.430 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.430 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051544639}) 2024-09-10T16:36:37.431 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2496921744}) 2024-09-10T16:36:37.431 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.431 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051544639}) 2024-09-10T16:36:37.431 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3645798447}) 2024-09-10T16:36:37.431 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.431 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051544639}) 2024-09-10T16:36:37.431 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1903623727}) 2024-09-10T16:36:37.431 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.431 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051544639}) 2024-09-10T16:36:37.431 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=4022640739}) 2024-09-10T16:36:37.431 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.431 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051544639}) 2024-09-10T16:36:37.431 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3442025542}) 2024-09-10T16:36:37.432 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.432 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1051544639}) 2024-09-10T16:36:37.432 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.423+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=899043259}) 2024-09-10T16:36:37.432 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.432 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=999960072}) 2024-09-10T16:36:37.432 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2719227714}) 2024-09-10T16:36:37.432 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.432 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=999960072}) 2024-09-10T16:36:37.432 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1689977224}) 2024-09-10T16:36:37.432 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.432 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=999960072}) 2024-09-10T16:36:37.432 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1376414946}) 2024-09-10T16:36:37.432 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.433 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=999960072}) 2024-09-10T16:36:37.433 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=853754736}) 2024-09-10T16:36:37.433 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.433 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=999960072}) 2024-09-10T16:36:37.433 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3753658141}) 2024-09-10T16:36:37.433 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.433 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=999960072}) 2024-09-10T16:36:37.433 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=351630144}) 2024-09-10T16:36:37.433 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.433 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=999960072}) 2024-09-10T16:36:37.433 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3040020604}) 2024-09-10T16:36:37.433 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.433 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=999960072}) 2024-09-10T16:36:37.434 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.427+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1211251131}) 2024-09-10T16:36:37.435 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.436 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2614613870}) 2024-09-10T16:36:37.436 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2709823925}) 2024-09-10T16:36:37.436 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.436 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2614613870}) 2024-09-10T16:36:37.436 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=756795714}) 2024-09-10T16:36:37.436 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.436 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2614613870}) 2024-09-10T16:36:37.436 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4088549286}) 2024-09-10T16:36:37.436 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.436 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2614613870}) 2024-09-10T16:36:37.436 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2679688284}) 2024-09-10T16:36:37.436 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.437 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2614613870}) 2024-09-10T16:36:37.437 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2190939295}) 2024-09-10T16:36:37.437 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.437 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2614613870}) 2024-09-10T16:36:37.437 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=853043847}) 2024-09-10T16:36:37.437 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.437 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2614613870}) 2024-09-10T16:36:37.437 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3592703276}) 2024-09-10T16:36:37.437 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.437 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2614613870}) 2024-09-10T16:36:37.437 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1590259911}) 2024-09-10T16:36:37.438 INFO:tasks.mon_thrash.mon_thrasher:waiting for 1.0 secs before continuing thrashing 2024-09-10T16:36:37.441 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.441 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347463837}) 2024-09-10T16:36:37.441 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3927326342}) 2024-09-10T16:36:37.441 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.442 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347463837}) 2024-09-10T16:36:37.442 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2753327609}) 2024-09-10T16:36:37.442 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.442 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347463837}) 2024-09-10T16:36:37.442 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2415549850}) 2024-09-10T16:36:37.442 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.442 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347463837}) 2024-09-10T16:36:37.442 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1022022057}) 2024-09-10T16:36:37.442 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.442 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347463837}) 2024-09-10T16:36:37.442 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=510471472}) 2024-09-10T16:36:37.442 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.442 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347463837}) 2024-09-10T16:36:37.443 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2346381675}) 2024-09-10T16:36:37.443 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.443 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347463837}) 2024-09-10T16:36:37.443 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1195888170}) 2024-09-10T16:36:37.443 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.443 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3347463837}) 2024-09-10T16:36:37.443 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.431+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1506505114}) 2024-09-10T16:36:37.443 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.443 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359024293}) 2024-09-10T16:36:37.443 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2153391656}) 2024-09-10T16:36:37.443 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.443 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359024293}) 2024-09-10T16:36:37.443 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1456698982}) 2024-09-10T16:36:37.443 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.444 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359024293}) 2024-09-10T16:36:37.444 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3022316681}) 2024-09-10T16:36:37.444 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.444 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359024293}) 2024-09-10T16:36:37.444 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3716065896}) 2024-09-10T16:36:37.444 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.444 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359024293}) 2024-09-10T16:36:37.444 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3757716846}) 2024-09-10T16:36:37.444 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.444 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359024293}) 2024-09-10T16:36:37.444 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1980316648}) 2024-09-10T16:36:37.444 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.444 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359024293}) 2024-09-10T16:36:37.445 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1706623584}) 2024-09-10T16:36:37.445 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.445 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2359024293}) 2024-09-10T16:36:37.445 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.435+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2461727850}) 2024-09-10T16:36:37.448 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.448 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3981346518}) 2024-09-10T16:36:37.448 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2434770224}) 2024-09-10T16:36:37.448 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.448 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3981346518}) 2024-09-10T16:36:37.448 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1764270920}) 2024-09-10T16:36:37.448 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.448 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3981346518}) 2024-09-10T16:36:37.448 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1149845820}) 2024-09-10T16:36:37.449 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.449 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3981346518}) 2024-09-10T16:36:37.449 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3107505577}) 2024-09-10T16:36:37.449 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.449 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3981346518}) 2024-09-10T16:36:37.449 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=292972064}) 2024-09-10T16:36:37.449 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.449 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3981346518}) 2024-09-10T16:36:37.449 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3370488343}) 2024-09-10T16:36:37.449 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.449 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3981346518}) 2024-09-10T16:36:37.449 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2125610131}) 2024-09-10T16:36:37.449 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.449 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3981346518}) 2024-09-10T16:36:37.450 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.439+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1509083223}) 2024-09-10T16:36:37.450 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.450 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2038981340}) 2024-09-10T16:36:37.450 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=108215251}) 2024-09-10T16:36:37.450 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.450 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2038981340}) 2024-09-10T16:36:37.450 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1600202767}) 2024-09-10T16:36:37.450 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.450 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2038981340}) 2024-09-10T16:36:37.450 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=157631092}) 2024-09-10T16:36:37.450 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.450 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2038981340}) 2024-09-10T16:36:37.450 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3296228455}) 2024-09-10T16:36:37.451 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.451 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2038981340}) 2024-09-10T16:36:37.451 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=56922421}) 2024-09-10T16:36:37.451 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.451 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2038981340}) 2024-09-10T16:36:37.451 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1303434978}) 2024-09-10T16:36:37.451 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.451 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2038981340}) 2024-09-10T16:36:37.451 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=762492177}) 2024-09-10T16:36:37.451 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.451 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2038981340}) 2024-09-10T16:36:37.451 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.443+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2401057903}) 2024-09-10T16:36:37.454 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=803258690}) 2024-09-10T16:36:37.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=782429654}) 2024-09-10T16:36:37.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=803258690}) 2024-09-10T16:36:37.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=1565001816}) 2024-09-10T16:36:37.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=803258690}) 2024-09-10T16:36:37.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3551919365}) 2024-09-10T16:36:37.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=803258690}) 2024-09-10T16:36:37.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=4102954395}) 2024-09-10T16:36:37.455 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=803258690}) 2024-09-10T16:36:37.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=2675794645}) 2024-09-10T16:36:37.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=803258690}) 2024-09-10T16:36:37.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=813085758}) 2024-09-10T16:36:37.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=803258690}) 2024-09-10T16:36:37.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1289418617}) 2024-09-10T16:36:37.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=803258690}) 2024-09-10T16:36:37.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.447+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3751873275}) 2024-09-10T16:36:37.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=22050414}) 2024-09-10T16:36:37.456 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3458752610}) 2024-09-10T16:36:37.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=22050414}) 2024-09-10T16:36:37.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=857105709}) 2024-09-10T16:36:37.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=22050414}) 2024-09-10T16:36:37.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2606223013}) 2024-09-10T16:36:37.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=22050414}) 2024-09-10T16:36:37.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=133184848}) 2024-09-10T16:36:37.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=22050414}) 2024-09-10T16:36:37.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3282009997}) 2024-09-10T16:36:37.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.457 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=22050414}) 2024-09-10T16:36:37.458 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=607394945}) 2024-09-10T16:36:37.458 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.458 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=22050414}) 2024-09-10T16:36:37.458 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=4129881506}) 2024-09-10T16:36:37.458 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.458 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=22050414}) 2024-09-10T16:36:37.458 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3301706084}) 2024-09-10T16:36:37.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=64625795}) 2024-09-10T16:36:37.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3677203228}) 2024-09-10T16:36:37.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.461 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=64625795}) 2024-09-10T16:36:37.462 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=243224073}) 2024-09-10T16:36:37.462 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.462 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=64625795}) 2024-09-10T16:36:37.462 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2290526104}) 2024-09-10T16:36:37.462 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.462 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=64625795}) 2024-09-10T16:36:37.462 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2295299690}) 2024-09-10T16:36:37.462 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.462 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=64625795}) 2024-09-10T16:36:37.462 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1616715115}) 2024-09-10T16:36:37.462 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.462 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=64625795}) 2024-09-10T16:36:37.462 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2110710847}) 2024-09-10T16:36:37.462 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.463 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=64625795}) 2024-09-10T16:36:37.463 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=2946499352}) 2024-09-10T16:36:37.463 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.463 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=64625795}) 2024-09-10T16:36:37.463 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.451+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=3064449054}) 2024-09-10T16:36:37.463 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.463 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2930855303}) 2024-09-10T16:36:37.463 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3533825395}) 2024-09-10T16:36:37.463 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.463 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2930855303}) 2024-09-10T16:36:37.463 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2255122955}) 2024-09-10T16:36:37.463 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.464 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2930855303}) 2024-09-10T16:36:37.464 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=1928441653}) 2024-09-10T16:36:37.464 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.464 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2930855303}) 2024-09-10T16:36:37.464 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2875411064}) 2024-09-10T16:36:37.464 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.464 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2930855303}) 2024-09-10T16:36:37.464 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=604100731}) 2024-09-10T16:36:37.464 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.464 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2930855303}) 2024-09-10T16:36:37.465 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2926414436}) 2024-09-10T16:36:37.465 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.465 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2930855303}) 2024-09-10T16:36:37.465 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1794334291}) 2024-09-10T16:36:37.465 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.465 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2930855303}) 2024-09-10T16:36:37.465 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.455+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2893419390}) 2024-09-10T16:36:37.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3411100723}) 2024-09-10T16:36:37.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3405695842}) 2024-09-10T16:36:37.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3411100723}) 2024-09-10T16:36:37.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=3514772839}) 2024-09-10T16:36:37.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3411100723}) 2024-09-10T16:36:37.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2024817931}) 2024-09-10T16:36:37.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3411100723}) 2024-09-10T16:36:37.470 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1265127317}) 2024-09-10T16:36:37.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3411100723}) 2024-09-10T16:36:37.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1375531102}) 2024-09-10T16:36:37.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3411100723}) 2024-09-10T16:36:37.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3329216916}) 2024-09-10T16:36:37.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3411100723}) 2024-09-10T16:36:37.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3745164035}) 2024-09-10T16:36:37.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3411100723}) 2024-09-10T16:36:37.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.459+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2594910963}) 2024-09-10T16:36:37.471 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807283863}) 2024-09-10T16:36:37.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=1652388255}) 2024-09-10T16:36:37.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807283863}) 2024-09-10T16:36:37.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2281011024}) 2024-09-10T16:36:37.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807283863}) 2024-09-10T16:36:37.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2103383263}) 2024-09-10T16:36:37.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807283863}) 2024-09-10T16:36:37.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=896728238}) 2024-09-10T16:36:37.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807283863}) 2024-09-10T16:36:37.472 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1603220663}) 2024-09-10T16:36:37.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807283863}) 2024-09-10T16:36:37.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3850025574}) 2024-09-10T16:36:37.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807283863}) 2024-09-10T16:36:37.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3934404157}) 2024-09-10T16:36:37.473 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.476 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=807283863}) 2024-09-10T16:36:37.476 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.463+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1281561585}) 2024-09-10T16:36:37.476 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.476 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645690705}) 2024-09-10T16:36:37.476 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3161593166}) 2024-09-10T16:36:37.476 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.476 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645690705}) 2024-09-10T16:36:37.476 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2828531151}) 2024-09-10T16:36:37.476 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.476 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645690705}) 2024-09-10T16:36:37.476 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=412500406}) 2024-09-10T16:36:37.476 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.476 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645690705}) 2024-09-10T16:36:37.477 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=791826583}) 2024-09-10T16:36:37.477 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.477 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645690705}) 2024-09-10T16:36:37.477 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=824627855}) 2024-09-10T16:36:37.477 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.477 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645690705}) 2024-09-10T16:36:37.477 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=3124017170}) 2024-09-10T16:36:37.477 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.477 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645690705}) 2024-09-10T16:36:37.477 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1475041980}) 2024-09-10T16:36:37.477 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.477 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2645690705}) 2024-09-10T16:36:37.477 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=430123627}) 2024-09-10T16:36:37.485 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.485 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638884310}) 2024-09-10T16:36:37.485 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=694597176}) 2024-09-10T16:36:37.485 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.485 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638884310}) 2024-09-10T16:36:37.485 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2262416521}) 2024-09-10T16:36:37.485 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.485 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638884310}) 2024-09-10T16:36:37.485 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=3282253401}) 2024-09-10T16:36:37.485 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.486 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638884310}) 2024-09-10T16:36:37.486 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=2164969470}) 2024-09-10T16:36:37.486 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.486 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638884310}) 2024-09-10T16:36:37.486 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4130667165}) 2024-09-10T16:36:37.486 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.486 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638884310}) 2024-09-10T16:36:37.486 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=221558801}) 2024-09-10T16:36:37.486 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.486 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638884310}) 2024-09-10T16:36:37.486 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3095695276}) 2024-09-10T16:36:37.486 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.486 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=3638884310}) 2024-09-10T16:36:37.487 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.467+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=2130910129}) 2024-09-10T16:36:37.487 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.487 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2736730782}) 2024-09-10T16:36:37.487 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=2307729303}) 2024-09-10T16:36:37.487 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.487 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2736730782}) 2024-09-10T16:36:37.487 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2954207800}) 2024-09-10T16:36:37.487 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.487 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2736730782}) 2024-09-10T16:36:37.487 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2480742876}) 2024-09-10T16:36:37.487 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.487 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2736730782}) 2024-09-10T16:36:37.487 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1247343276}) 2024-09-10T16:36:37.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2736730782}) 2024-09-10T16:36:37.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=4234017883}) 2024-09-10T16:36:37.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2736730782}) 2024-09-10T16:36:37.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=945390658}) 2024-09-10T16:36:37.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2736730782}) 2024-09-10T16:36:37.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=3478056890}) 2024-09-10T16:36:37.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2736730782}) 2024-09-10T16:36:37.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.471+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=4139249506}) 2024-09-10T16:36:37.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.488 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=431384301}) 2024-09-10T16:36:37.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3156838673}) 2024-09-10T16:36:37.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=431384301}) 2024-09-10T16:36:37.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=4264484498}) 2024-09-10T16:36:37.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=431384301}) 2024-09-10T16:36:37.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=701462479}) 2024-09-10T16:36:37.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=431384301}) 2024-09-10T16:36:37.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1852529772}) 2024-09-10T16:36:37.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=431384301}) 2024-09-10T16:36:37.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=139847661}) 2024-09-10T16:36:37.489 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=431384301}) 2024-09-10T16:36:37.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=1186438676}) 2024-09-10T16:36:37.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=431384301}) 2024-09-10T16:36:37.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1576484925}) 2024-09-10T16:36:37.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=431384301}) 2024-09-10T16:36:37.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.475+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1485345577}) 2024-09-10T16:36:37.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1455417235}) 2024-09-10T16:36:37.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=3998791419}) 2024-09-10T16:36:37.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.490 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1455417235}) 2024-09-10T16:36:37.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2560435867}) 2024-09-10T16:36:37.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1455417235}) 2024-09-10T16:36:37.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=4255014963}) 2024-09-10T16:36:37.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1455417235}) 2024-09-10T16:36:37.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=1071793866}) 2024-09-10T16:36:37.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1455417235}) 2024-09-10T16:36:37.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=3007194080}) 2024-09-10T16:36:37.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1455417235}) 2024-09-10T16:36:37.491 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=2850921341}) 2024-09-10T16:36:37.492 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.492 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1455417235}) 2024-09-10T16:36:37.492 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=1251875900}) 2024-09-10T16:36:37.492 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.492 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=1455417235}) 2024-09-10T16:36:37.492 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=1985745396}) 2024-09-10T16:36:37.492 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.492 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2661980845}) 2024-09-10T16:36:37.492 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=100} crc {logm=758039606}) 2024-09-10T16:36:37.492 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.492 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2661980845}) 2024-09-10T16:36:37.492 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=100} crc {logm=2744783469}) 2024-09-10T16:36:37.492 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.493 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2661980845}) 2024-09-10T16:36:37.493 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=100} crc {logm=2847161821}) 2024-09-10T16:36:37.493 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.493 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2661980845}) 2024-09-10T16:36:37.493 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=100} crc {logm=3702754023}) 2024-09-10T16:36:37.493 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.493 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2661980845}) 2024-09-10T16:36:37.493 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=100} crc {logm=1762514513}) 2024-09-10T16:36:37.493 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.493 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2661980845}) 2024-09-10T16:36:37.493 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=100} crc {logm=698919020}) 2024-09-10T16:36:37.493 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.493 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2661980845}) 2024-09-10T16:36:37.493 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=100} crc {logm=809811698}) 2024-09-10T16:36:37.494 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.494 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=100} crc {logm=2661980845}) 2024-09-10T16:36:37.494 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.479+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=100} crc {logm=169810241}) 2024-09-10T16:36:37.501 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.501 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=15,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=20,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=24} crc {logm=3752900259,mdsmap=4195066828,mgr=733959874,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3732729449,mon_config_key=1767330934,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=3192592186}) 2024-09-10T16:36:37.501 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {logm=14,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=18,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=29} crc {logm=2902899967,mdsmap=4195066828,mgr=4187094213,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1071005212,mon_config_key=38872982,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=767382689}) 2024-09-10T16:36:37.501 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.501 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=15,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=20,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=24} crc {logm=3752900259,mdsmap=4195066828,mgr=733959874,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3732729449,mon_config_key=1767330934,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=3192592186}) 2024-09-10T16:36:37.501 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {logm=15,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=20,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=25} crc {logm=3752900259,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3831995370,mon_config_key=2525955760,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=693604037}) 2024-09-10T16:36:37.501 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.501 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=15,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=20,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=24} crc {logm=3752900259,mdsmap=4195066828,mgr=733959874,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3732729449,mon_config_key=1767330934,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=3192592186}) 2024-09-10T16:36:37.501 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {logm=14,mdsmap=2,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=20,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=28} crc {logm=2751540943,mdsmap=1169610815,mgr=3893960851,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=211571822,mon_config_key=1767330934,monmap=65596682,nvmeofgw=598337686,osd_metadata=2942599198,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=3612462471}) 2024-09-10T16:36:37.502 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.502 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=15,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=20,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=24} crc {logm=3752900259,mdsmap=4195066828,mgr=733959874,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3732729449,mon_config_key=1767330934,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=3192592186}) 2024-09-10T16:36:37.502 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {logm=15,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=12,mon_config_key=20,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=25} crc {logm=1741862781,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=1028019466,mon_config_key=1767330934,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=2185843057}) 2024-09-10T16:36:37.502 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.502 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=15,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=20,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=24} crc {logm=3752900259,mdsmap=4195066828,mgr=733959874,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3732729449,mon_config_key=1767330934,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=3192592186}) 2024-09-10T16:36:37.502 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {logm=14,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=19,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=26} crc {logm=3853974969,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3732729449,mon_config_key=1838001000,monmap=65596682,nvmeofgw=598337686,osd_metadata=1974373829,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=2223411403}) 2024-09-10T16:36:37.502 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.502 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=15,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=20,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=24} crc {logm=3752900259,mdsmap=4195066828,mgr=733959874,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3732729449,mon_config_key=1767330934,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=3192592186}) 2024-09-10T16:36:37.502 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {logm=14,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=11,mon_config_key=19,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=28} crc {logm=588316439,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3656156727,mon_config_key=2064446897,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=3800166712}) 2024-09-10T16:36:37.502 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.502 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=15,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=20,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=24} crc {logm=3752900259,mdsmap=4195066828,mgr=733959874,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3732729449,mon_config_key=1767330934,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=3192592186}) 2024-09-10T16:36:37.502 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {logm=14,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=19,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=26} crc {logm=1609706030,mdsmap=4195066828,mgr=1301684236,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3732729449,mon_config_key=3477899374,monmap=65596682,nvmeofgw=598337686,osd_metadata=643485708,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=2512054561}) 2024-09-10T16:36:37.502 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.503 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {logm=15,mdsmap=3,mgr=8,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=20,monmap=3,nvmeofgw=3,osd_metadata=6,osd_pg_creating=1,osd_snap=2,osdmap=24} crc {logm=3752900259,mdsmap=4195066828,mgr=733959874,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3732729449,mon_config_key=1767330934,monmap=65596682,nvmeofgw=598337686,osd_metadata=3154382413,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=3192592186}) 2024-09-10T16:36:37.503 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.483+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {logm=14,mdsmap=3,mgr=7,mgr_command_descs=1,mgr_metadata=1,mgrstat=13,mon_config_key=20,monmap=3,nvmeofgw=3,osd_metadata=5,osd_pg_creating=1,osd_snap=2,osdmap=27} crc {logm=3931910665,mdsmap=4195066828,mgr=3374101859,mgr_command_descs=2308730518,mgr_metadata=1162624872,mgrstat=3732729449,mon_config_key=1767330934,monmap=65596682,nvmeofgw=598337686,osd_metadata=2338151426,osd_pg_creating=2671089276,osd_snap=4133920409,osdmap=3889616287}) 2024-09-10T16:36:37.503 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.503 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3429513555}) 2024-09-10T16:36:37.503 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3194826033}) 2024-09-10T16:36:37.503 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.503 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3429513555}) 2024-09-10T16:36:37.503 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=2189179149}) 2024-09-10T16:36:37.503 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.503 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3429513555}) 2024-09-10T16:36:37.503 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=470452306}) 2024-09-10T16:36:37.503 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.503 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3429513555}) 2024-09-10T16:36:37.504 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=948918548}) 2024-09-10T16:36:37.504 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.504 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3429513555}) 2024-09-10T16:36:37.504 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=3529247640}) 2024-09-10T16:36:37.504 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.504 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3429513555}) 2024-09-10T16:36:37.504 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=2216894565}) 2024-09-10T16:36:37.504 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.504 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3429513555}) 2024-09-10T16:36:37.504 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1454987870}) 2024-09-10T16:36:37.504 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.504 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3429513555}) 2024-09-10T16:36:37.504 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.487+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=3216279318}) 2024-09-10T16:36:37.504 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3302952360}) 2024-09-10T16:36:37.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=100} crc {osdmap=3512198912}) 2024-09-10T16:36:37.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3302952360}) 2024-09-10T16:36:37.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=100} crc {osdmap=459453059}) 2024-09-10T16:36:37.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3302952360}) 2024-09-10T16:36:37.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=100} crc {osdmap=2083892027}) 2024-09-10T16:36:37.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3302952360}) 2024-09-10T16:36:37.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=100} crc {osdmap=3636876488}) 2024-09-10T16:36:37.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.505 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3302952360}) 2024-09-10T16:36:37.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=100} crc {osdmap=3973864123}) 2024-09-10T16:36:37.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3302952360}) 2024-09-10T16:36:37.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=100} crc {osdmap=32000890}) 2024-09-10T16:36:37.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3302952360}) 2024-09-10T16:36:37.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=100} crc {osdmap=1409081041}) 2024-09-10T16:36:37.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=100} crc {osdmap=3302952360}) 2024-09-10T16:36:37.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=100} crc {osdmap=4280594193}) 2024-09-10T16:36:37.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.491+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=84} crc {osdmap=3472858838}) 2024-09-10T16:36:37.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.1 ScrubResult(keys {osdmap=86} crc {osdmap=530650501}) 2024-09-10T16:36:37.506 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=84} crc {osdmap=3472858838}) 2024-09-10T16:36:37.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.2 ScrubResult(keys {osdmap=83} crc {osdmap=1124721065}) 2024-09-10T16:36:37.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=84} crc {osdmap=3472858838}) 2024-09-10T16:36:37.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.3 ScrubResult(keys {osdmap=86} crc {osdmap=2895568707}) 2024-09-10T16:36:37.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=84} crc {osdmap=3472858838}) 2024-09-10T16:36:37.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.4 ScrubResult(keys {osdmap=83} crc {osdmap=3807933563}) 2024-09-10T16:36:37.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=84} crc {osdmap=3472858838}) 2024-09-10T16:36:37.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.5 ScrubResult(keys {osdmap=87} crc {osdmap=1140710278}) 2024-09-10T16:36:37.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.507 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=84} crc {osdmap=3472858838}) 2024-09-10T16:36:37.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.6 ScrubResult(keys {osdmap=85} crc {osdmap=1311745285}) 2024-09-10T16:36:37.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=84} crc {osdmap=3472858838}) 2024-09-10T16:36:37.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.7 ScrubResult(keys {osdmap=87} crc {osdmap=2229418119}) 2024-09-10T16:36:37.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : scrub mismatch 2024-09-10T16:36:37.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.0 ScrubResult(keys {osdmap=84} crc {osdmap=3472858838}) 2024-09-10T16:36:37.508 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-10T16:36:37.495+0000 7f1663bf9640 -1 log_channel(cluster) log [ERR] : mon.8 ScrubResult(keys {osdmap=83} crc {osdmap=3224713215}) 2024-09-10T16:36:38.439 INFO:tasks.mon_thrash.ceph_manager:waiting for quorum size 9 2024-09-10T16:36:38.439 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph quorum_status 2024-09-10T16:36:38.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 10 monclient: get_monmap_and_config 2024-09-10T16:36:38.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 10 monclient: build_initial_monmap 2024-09-10T16:36:38.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 10 monclient: monmap: 2024-09-10T16:36:38.570 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:38.570 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:38.570 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:38.571432+0000 2024-09-10T16:36:38.570 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:38.571432+0000 2024-09-10T16:36:38.570 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:38.570 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:38.570 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:38.570 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:38.570 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:38.571 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:38.571 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:38.571 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:38.571 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:38.571 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:38.571 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:38.571 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:38.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 1 Processor -- start 2024-09-10T16:36:38.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 1 -- start start 2024-09-10T16:36:38.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 10 monclient: init 2024-09-10T16:36:38.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:38.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 10 monclient: _add_conns ranks=[8,3,1,6,5,2,4,0,7] 2024-09-10T16:36:38.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 10 monclient(hunting): picked mon.noname-e con 0x7f1b781328c0 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:38.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 10 monclient(hunting): picked mon.noname-g con 0x7f1b7809e7a0 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:38.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 10 monclient(hunting): picked mon.noname-f con 0x7f1b7813f730 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:38.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7806d540 con 0x7f1b7813f730 2024-09-10T16:36:38.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7806d860 con 0x7f1b7809e7a0 2024-09-10T16:36:38.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7809d520 con 0x7f1b781328c0 2024-09-10T16:36:38.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:38.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7c955640 10 monclient(hunting): authenticate will time out at 1365.971067s 2024-09-10T16:36:38.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7659c640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f1b781328c0 0x7f1b78132ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35186/0 (socket says 172.21.15.81:35186) 2024-09-10T16:36:38.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7659c640 1 -- 172.21.15.81:0/2615923191 learned_addr learned my addr 172.21.15.81:0/2615923191 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:38.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 1 -- 172.21.15.81:0/2615923191 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1495981100 0 0) 0x7f1b7809d520 con 0x7f1b781328c0 2024-09-10T16:36:38.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 10 monclient(hunting): _negotiate 2024-09-10T16:36:38.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:38.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:38.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 10 monclient(hunting): my global_id is 6641 2024-09-10T16:36:38.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 1 -- 172.21.15.81:0/2615923191 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b64003530 con 0x7f1b781328c0 2024-09-10T16:36:38.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 1 -- 172.21.15.81:0/2615923191 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3944661896 0 0) 0x7f1b64003530 con 0x7f1b781328c0 2024-09-10T16:36:38.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 1 -- 172.21.15.81:0/2615923191 >> v1:172.21.15.189:6790/0 conn(0x7f1b7809e7a0 legacy=0x7f1b7813e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:38.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 1 -- 172.21.15.81:0/2615923191 >> v1:172.21.15.189:6789/0 conn(0x7f1b7813f730 legacy=0x7f1b78141b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:38.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 10 monclient: _finish_hunting 0 2024-09-10T16:36:38.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 1 monclient: found mon.noname-e 2024-09-10T16:36:38.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:36:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 1 -- 172.21.15.81:0/2615923191 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b7809d800 con 0x7f1b781328c0 2024-09-10T16:36:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 10 monclient: _finish_auth 0 2024-09-10T16:36:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 10 monclient: _check_auth_tickets 2024-09-10T16:36:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 1 -- 172.21.15.81:0/2615923191 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1b68001840 con 0x7f1b781328c0 2024-09-10T16:36:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.567+0000 7f1b7559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7559a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:36:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7559a640 10 monclient: dump: 2024-09-10T16:36:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:38.576 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:38.577 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:38.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 5 monclient: authenticate success, global_id 6641 2024-09-10T16:36:38.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:38.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7559a640 1 -- 172.21.15.81:0/2615923191 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1b68001a60 con 0x7f1b781328c0 2024-09-10T16:36:38.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7559a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:38.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7559a640 1 -- 172.21.15.81:0/2615923191 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1b68004bf0 con 0x7f1b781328c0 2024-09-10T16:36:38.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:38.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7559a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:38.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7559a640 10 monclient: dump: 2024-09-10T16:36:38.578 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:38.578 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:38.578 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.578 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.578 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:38.578 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:38.579 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 4 set_mon_vals no callback set 2024-09-10T16:36:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient: shutdown 2024-09-10T16:36:38.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 1 -- 172.21.15.81:0/2615923191 >> v1:172.21.15.81:6793/0 conn(0x7f1b781328c0 legacy=0x7f1b78132ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 1 -- 172.21.15.81:0/2615923191 shutdown_connections 2024-09-10T16:36:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 1 -- 172.21.15.81:0/2615923191 >> 172.21.15.81:0/2615923191 conn(0x7f1b780a47e0 msgr2=0x7f1b780a4bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 1 -- 172.21.15.81:0/2615923191 shutdown_connections 2024-09-10T16:36:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 1 -- 172.21.15.81:0/2615923191 wait complete. 2024-09-10T16:36:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient: build_initial_monmap 2024-09-10T16:36:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient: monmap: 2024-09-10T16:36:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:38.580 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:38.581 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:38.581 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:38.581 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:38.581 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:38.581 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:38.581 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:38.581 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:38.581 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:38.581 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:38.581 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:38.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 1 Processor -- start 2024-09-10T16:36:38.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 1 -- start start 2024-09-10T16:36:38.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient: init 2024-09-10T16:36:38.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient: _add_conns ranks=[6,1,5,8,7,2,0,4,3] 2024-09-10T16:36:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient(hunting): picked mon.noname-d con 0x7f1b7809e7a0 addr v1:172.21.15.81:6792/0 2024-09-10T16:36:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient(hunting): picked mon.noname-f con 0x7f1b781328c0 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient(hunting): picked mon.noname-h con 0x7f1b7813f730 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7813a360 con 0x7f1b781328c0 2024-09-10T16:36:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b781342a0 con 0x7f1b7813f730 2024-09-10T16:36:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b7813a640 con 0x7f1b7809e7a0 2024-09-10T16:36:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient(hunting): authenticate will time out at 1365.974690s 2024-09-10T16:36:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7659c640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f1b7809e7a0 0x7f1b78133480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:40200/0 (socket says 172.21.15.81:40200) 2024-09-10T16:36:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7659c640 1 -- 172.21.15.81:0/36423953 learned_addr learned my addr 172.21.15.81:0/36423953 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 611282491 0 0) 0x7f1b7813a640 con 0x7f1b7809e7a0 2024-09-10T16:36:38.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient(hunting): my global_id is 144789 2024-09-10T16:36:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b58003530 con 0x7f1b7809e7a0 2024-09-10T16:36:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2933383170 0 0) 0x7f1b58003530 con 0x7f1b7809e7a0 2024-09-10T16:36:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f1b7813a640 con 0x7f1b7809e7a0 2024-09-10T16:36:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1b68004b30 con 0x7f1b7809e7a0 2024-09-10T16:36:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:36:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient(hunting): dump: 2024-09-10T16:36:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:38.586 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:38.587 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:38.587 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1562930351 0 0) 0x7f1b7813a360 con 0x7f1b781328c0 2024-09-10T16:36:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient(hunting): my global_id is 164206 2024-09-10T16:36:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1b58003530 con 0x7f1b781328c0 2024-09-10T16:36:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2114281901 0 0) 0x7f1b7813a640 con 0x7f1b7809e7a0 2024-09-10T16:36:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 >> v1:172.21.15.189:6791/0 conn(0x7f1b7813f730 legacy=0x7f1b781d5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 >> v1:172.21.15.189:6789/0 conn(0x7f1b781328c0 legacy=0x7f1b78133b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient: _finish_hunting 0 2024-09-10T16:36:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 1 monclient: found mon.d 2024-09-10T16:36:38.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b780a7730 con 0x7f1b7809e7a0 2024-09-10T16:36:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient: _finish_auth 0 2024-09-10T16:36:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient: _check_auth_tickets 2024-09-10T16:36:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 5 monclient: authenticate success, global_id 144789 2024-09-10T16:36:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient: _renew_subs 2024-09-10T16:36:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 1 -- 172.21.15.81:0/36423953 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f1b78142f70 con 0x7f1b7809e7a0 2024-09-10T16:36:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient: _renew_subs 2024-09-10T16:36:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:38.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b7c955640 1 -- 172.21.15.81:0/36423953 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f1b78135240 con 0x7f1b7809e7a0 2024-09-10T16:36:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f1b68001a40 con 0x7f1b7809e7a0 2024-09-10T16:36:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f1b680011c0 con 0x7f1b7809e7a0 2024-09-10T16:36:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b74d99640 4 set_mon_vals no callback set 2024-09-10T16:36:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:36:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.571+0000 7f1b6effd640 10 monclient: dump: 2024-09-10T16:36:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:38.590 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:38.591 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.575+0000 7f1b7c955640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.575+0000 7f1b7c955640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.575+0000 7f1b7c955640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:38.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.575+0000 7f1b7c955640 1 -- 172.21.15.81:0/36423953 --> v1:172.21.15.81:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b5c005090 con 0x7f1b7809e7a0 2024-09-10T16:36:38.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.575+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f1b68010fa0 con 0x7f1b7809e7a0 2024-09-10T16:36:38.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.575+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(324..324 src has 121..324) ==== 3506+0+0 (unknown 2961462200 0 0) 0x7f1b6804ae30 con 0x7f1b7809e7a0 2024-09-10T16:36:38.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.575+0000 7f1b75d9b640 10 monclient: get_auth_request con 0x7f1b5803d000 auth_method 0 2024-09-10T16:36:38.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.579+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 <== mon.6 v1:172.21.15.81:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f1b68016d50 con 0x7f1b7809e7a0 2024-09-10T16:36:38.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.579+0000 7f1b6effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:38.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.579+0000 7f1b6effd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:38.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.815+0000 7f1b7c955640 10 start_mon_command cmd=[{"prefix": "quorum_status"}] 2024-09-10T16:36:38.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.815+0000 7f1b7c955640 10 monclient: _send_command 2 [{"prefix": "quorum_status"}] 2024-09-10T16:36:38.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.815+0000 7f1b7c955640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:38.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.815+0000 7f1b7c955640 1 -- 172.21.15.81:0/36423953 --> v1:172.21.15.81:6792/0 -- mon_command({"prefix": "quorum_status"} v 0) -- 0x7f1b5c005380 con 0x7f1b7809e7a0 2024-09-10T16:36:38.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.819+0000 7f1b6effd640 1 -- 172.21.15.81:0/36423953 <== mon.6 v1:172.21.15.81:6792/0 10 ==== mon_command_ack([{"prefix": "quorum_status"}]=0 v0) ==== 61+0+2729 (unknown 254746657 0 1469438740) 0x7f1b68016650 con 0x7f1b7809e7a0 2024-09-10T16:36:38.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.819+0000 7f1b6effd640 10 monclient: handle_mon_command_ack 2 [{"prefix": "quorum_status"}] 2024-09-10T16:36:38.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.819+0000 7f1b6effd640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:36:38.820 INFO:teuthology.orchestra.run.smithi081.stdout:{"election_epoch":44,"quorum":[0,1,2,3,4,5,6,7,8],"quorum_names":["a","f","b","g","c","h","d","i","e"],"quorum_leader_name":"a","quorum_age":5,"features":{"quorum_con":"4540719139924082687","quorum_mon":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"]},"monmap":{"epoch":1,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","modified":"2024-09-10T16:29:22.909160Z","created":"2024-09-10T16:29:22.909160Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":3,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6789","nonce":0}]},"addr":"172.21.15.81:6789/0","public_addr":"172.21.15.81:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"f","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6789","nonce":0}]},"addr":"172.21.15.189:6789/0","public_addr":"172.21.15.189:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6790","nonce":0}]},"addr":"172.21.15.81:6790/0","public_addr":"172.21.15.81:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":3,"name":"g","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6790","nonce":0}]},"addr":"172.21.15.189:6790/0","public_addr":"172.21.15.189:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":4,"name":"c","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6791","nonce":0}]},"addr":"172.21.15.81:6791/0","public_addr":"172.21.15.81:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":5,"name":"h","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6791","nonce":0}]},"addr":"172.21.15.189:6791/0","public_addr":"172.21.15.189:6791/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":6,"name":"d","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6792","nonce":0}]},"addr":"172.21.15.81:6792/0","public_addr":"172.21.15.81:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":7,"name":"i","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6792","nonce":0}]},"addr":"172.21.15.189:6792/0","public_addr":"172.21.15.189:6792/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":8,"name":"e","public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6793","nonce":0}]},"addr":"172.21.15.81:6793/0","public_addr":"172.21.15.81:6793/0","priority":0,"weight":0,"crush_location":"{}"}]}} 2024-09-10T16:36:38.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.819+0000 7f1b7c955640 1 -- 172.21.15.81:0/36423953 >> v1:172.21.15.189:6812/1108603242 conn(0x7f1b5803d000 legacy=0x7f1b5803f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:38.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.819+0000 7f1b7c955640 10 monclient: shutdown 2024-09-10T16:36:38.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.819+0000 7f1b7c955640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:38.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.819+0000 7f1b7c955640 1 -- 172.21.15.81:0/36423953 >> v1:172.21.15.81:6792/0 conn(0x7f1b7809e7a0 legacy=0x7f1b78133480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:38.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.819+0000 7f1b7c955640 1 -- 172.21.15.81:0/36423953 shutdown_connections 2024-09-10T16:36:38.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.819+0000 7f1b7c955640 1 -- 172.21.15.81:0/36423953 >> 172.21.15.81:0/36423953 conn(0x7f1b780a47e0 msgr2=0x7f1b7813fff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:38.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.819+0000 7f1b7c955640 1 -- 172.21.15.81:0/36423953 shutdown_connections 2024-09-10T16:36:38.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.819+0000 7f1b7c955640 1 -- 172.21.15.81:0/36423953 wait complete. 2024-09-10T16:36:38.838 INFO:tasks.mon_thrash.ceph_manager:quorum is size 9 2024-09-10T16:36:38.838 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-10T16:36:38.847 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-10T16:36:38.848 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T16:36:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 10 monclient: get_monmap_and_config 2024-09-10T16:36:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 10 monclient: build_initial_monmap 2024-09-10T16:36:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 10 monclient: monmap: 2024-09-10T16:36:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:38.970979+0000 2024-09-10T16:36:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:38.970979+0000 2024-09-10T16:36:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:38.969 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:38.970 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:38.970 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:38.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 1 Processor -- start 2024-09-10T16:36:38.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 1 -- start start 2024-09-10T16:36:38.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 10 monclient: init 2024-09-10T16:36:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 10 monclient: _add_conns ranks=[8,7,1,3,6,2,5,0,4] 2024-09-10T16:36:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 10 monclient(hunting): picked mon.noname-e con 0x7fbe3c09e6b0 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 10 monclient(hunting): picked mon.noname-i con 0x7fbe3c136f30 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 10 monclient(hunting): picked mon.noname-f con 0x7fbe3c13d460 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe3c0a2890 con 0x7fbe3c13d460 2024-09-10T16:36:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe3c09f1a0 con 0x7fbe3c136f30 2024-09-10T16:36:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe3c0a3030 con 0x7fbe3c09e6b0 2024-09-10T16:36:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe41e07640 10 monclient(hunting): authenticate will time out at 1366.370301s 2024-09-10T16:36:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe3b7fe640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fbe3c09e6b0 0x7fbe3c09ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35200/0 (socket says 172.21.15.81:35200) 2024-09-10T16:36:38.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.967+0000 7fbe3b7fe640 1 -- 172.21.15.81:0/3397273731 learned_addr learned my addr 172.21.15.81:0/3397273731 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:38.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 1 -- 172.21.15.81:0/3397273731 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2339763035 0 0) 0x7fbe3c0a2890 con 0x7fbe3c13d460 2024-09-10T16:36:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:36:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient(hunting): my global_id is 164215 2024-09-10T16:36:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 1 -- 172.21.15.81:0/3397273731 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe28003530 con 0x7fbe3c13d460 2024-09-10T16:36:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 1 -- 172.21.15.81:0/3397273731 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2505041882 0 0) 0x7fbe3c0a3030 con 0x7fbe3c09e6b0 2024-09-10T16:36:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:36:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient(hunting): my global_id is 6650 2024-09-10T16:36:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 1 -- 172.21.15.81:0/3397273731 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe3c0a2890 con 0x7fbe3c09e6b0 2024-09-10T16:36:38.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 1 -- 172.21.15.81:0/3397273731 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1072920163 0 0) 0x7fbe3c09f1a0 con 0x7fbe3c136f30 2024-09-10T16:36:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient(hunting): _negotiate 2024-09-10T16:36:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient(hunting): my global_id is 164185 2024-09-10T16:36:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 1 -- 172.21.15.81:0/3397273731 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe3c0a3030 con 0x7fbe3c136f30 2024-09-10T16:36:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 1 -- 172.21.15.81:0/3397273731 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4105010884 0 0) 0x7fbe3c0a2890 con 0x7fbe3c09e6b0 2024-09-10T16:36:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 1 -- 172.21.15.81:0/3397273731 >> v1:172.21.15.189:6792/0 conn(0x7fbe3c136f30 legacy=0x7fbe3c13bd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 1 -- 172.21.15.81:0/3397273731 >> v1:172.21.15.189:6789/0 conn(0x7fbe3c13d460 legacy=0x7fbe3c13f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient: _finish_hunting 0 2024-09-10T16:36:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 1 monclient: found mon.noname-e 2024-09-10T16:36:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:38.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:36:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 1 -- 172.21.15.81:0/3397273731 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3c09f3e0 con 0x7fbe3c09e6b0 2024-09-10T16:36:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient: _finish_auth 0 2024-09-10T16:36:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient: _check_auth_tickets 2024-09-10T16:36:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 1 -- 172.21.15.81:0/3397273731 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fbe24001820 con 0x7fbe3c09e6b0 2024-09-10T16:36:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:36:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient: dump: 2024-09-10T16:36:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:38.977 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:38.978 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:38.979 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 5 monclient: authenticate success, global_id 6650 2024-09-10T16:36:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 1 -- 172.21.15.81:0/3397273731 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe24001a40 con 0x7fbe3c09e6b0 2024-09-10T16:36:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 4 set_mon_vals no callback set 2024-09-10T16:36:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 1 -- 172.21.15.81:0/3397273731 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fbe24004bf0 con 0x7fbe3c09e6b0 2024-09-10T16:36:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe3a7fc640 10 monclient: dump: 2024-09-10T16:36:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:38.979 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:38.980 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:38.980 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 10 monclient: shutdown 2024-09-10T16:36:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 1 -- 172.21.15.81:0/3397273731 >> v1:172.21.15.81:6793/0 conn(0x7fbe3c09e6b0 legacy=0x7fbe3c09ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 1 -- 172.21.15.81:0/3397273731 shutdown_connections 2024-09-10T16:36:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 1 -- 172.21.15.81:0/3397273731 >> 172.21.15.81:0/3397273731 conn(0x7fbe3c0a86b0 msgr2=0x7fbe3c0a8ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 1 -- 172.21.15.81:0/3397273731 shutdown_connections 2024-09-10T16:36:38.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 1 -- 172.21.15.81:0/3397273731 wait complete. 2024-09-10T16:36:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 10 monclient: build_initial_monmap 2024-09-10T16:36:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 10 monclient: monmap: 2024-09-10T16:36:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:38.986 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 1 Processor -- start 2024-09-10T16:36:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 1 -- start start 2024-09-10T16:36:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.971+0000 7fbe41e07640 10 monclient: init 2024-09-10T16:36:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 10 monclient: _add_conns ranks=[3,5,4,2,1,7,0,6,8] 2024-09-10T16:36:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 10 monclient(hunting): picked mon.noname-g con 0x7fbe3c09e6b0 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 10 monclient(hunting): picked mon.noname-h con 0x7fbe3c136f30 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 10 monclient(hunting): picked mon.noname-c con 0x7fbe3c13d460 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe3c140be0 con 0x7fbe3c09e6b0 2024-09-10T16:36:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe3c1388e0 con 0x7fbe3c13d460 2024-09-10T16:36:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe3c09e480 con 0x7fbe3c136f30 2024-09-10T16:36:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 10 monclient(hunting): authenticate will time out at 1366.376245s 2024-09-10T16:36:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe3bfff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fbe3c13d460 0x7fbe3c1d4030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:49150/0 (socket says 172.21.15.81:49150) 2024-09-10T16:36:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe3bfff640 1 -- 172.21.15.81:0/1734609280 learned_addr learned my addr 172.21.15.81:0/1734609280 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3417369349 0 0) 0x7fbe3c1388e0 con 0x7fbe3c13d460 2024-09-10T16:36:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): my global_id is 144832 2024-09-10T16:36:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe1c003530 con 0x7fbe3c13d460 2024-09-10T16:36:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2536646581 0 0) 0x7fbe1c003530 con 0x7fbe3c13d460 2024-09-10T16:36:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fbe3c1388e0 con 0x7fbe3c13d460 2024-09-10T16:36:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fbe34001d80 con 0x7fbe3c13d460 2024-09-10T16:36:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:36:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): dump: 2024-09-10T16:36:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:38.989 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1112093216 0 0) 0x7fbe3c09f3e0 con 0x7fbe3c09e6b0 2024-09-10T16:36:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): my global_id is 164181 2024-09-10T16:36:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe1c003530 con 0x7fbe3c09e6b0 2024-09-10T16:36:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 256632604 0 0) 0x7fbe3c09e480 con 0x7fbe3c136f30 2024-09-10T16:36:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient(hunting): my global_id is 164192 2024-09-10T16:36:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe3c09f3e0 con 0x7fbe3c136f30 2024-09-10T16:36:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 418702342 0 0) 0x7fbe3c1388e0 con 0x7fbe3c13d460 2024-09-10T16:36:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 >> v1:172.21.15.189:6791/0 conn(0x7fbe3c136f30 legacy=0x7fbe3c1381d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 >> v1:172.21.15.189:6790/0 conn(0x7fbe3c09e6b0 legacy=0x7fbe3c137ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient: _finish_hunting 0 2024-09-10T16:36:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 monclient: found mon.c 2024-09-10T16:36:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe3c09df70 con 0x7fbe3c13d460 2024-09-10T16:36:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient: _finish_auth 0 2024-09-10T16:36:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient: _check_auth_tickets 2024-09-10T16:36:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 5 monclient: authenticate success, global_id 144832 2024-09-10T16:36:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 10 monclient: _renew_subs 2024-09-10T16:36:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 1 -- 172.21.15.81:0/1734609280 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fbe3c139380 con 0x7fbe3c13d460 2024-09-10T16:36:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 10 monclient: _renew_subs 2024-09-10T16:36:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 1 -- 172.21.15.81:0/1734609280 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fbe3c13b6e0 con 0x7fbe3c13d460 2024-09-10T16:36:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fbe340020c0 con 0x7fbe3c13d460 2024-09-10T16:36:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fbe34003f90 con 0x7fbe3c13d460 2024-09-10T16:36:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe39ffb640 4 set_mon_vals no callback set 2024-09-10T16:36:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 10 monclient: dump: 2024-09-10T16:36:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:38.992 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:38.993 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fbe340041b0 con 0x7fbe3c13d460 2024-09-10T16:36:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe41e07640 1 -- 172.21.15.81:0/1734609280 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe20005090 con 0x7fbe3c13d460 2024-09-10T16:36:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(324..324 src has 121..324) ==== 3506+0+0 (unknown 2961462200 0 0) 0x7fbe3404b180 con 0x7fbe3c13d460 2024-09-10T16:36:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.975+0000 7fbe3b7fe640 10 monclient: get_auth_request con 0x7fbe1c03d290 auth_method 0 2024-09-10T16:36:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.979+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7fbe34017040 con 0x7fbe3c13d460 2024-09-10T16:36:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.979+0000 7fbe33fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:38.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:38.979+0000 7fbe33fff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:39.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.147+0000 7fbe41e07640 1 -- 172.21.15.81:0/1734609280 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe20000ba0 con 0x7fbe1c03d290 2024-09-10T16:36:39.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.151+0000 7fbe33fff640 1 -- 172.21.15.81:0/1734609280 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34080 (unknown 2965378022 0 2348393127) 0x7fbe20000ba0 con 0x7fbe1c03d290 2024-09-10T16:36:39.154 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:36:39.154 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T16:36:39.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.151+0000 7fbe41e07640 1 -- 172.21.15.81:0/1734609280 >> v1:172.21.15.189:6812/1108603242 conn(0x7fbe1c03d290 legacy=0x7fbe1c03f750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.151+0000 7fbe41e07640 10 monclient: shutdown 2024-09-10T16:36:39.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.151+0000 7fbe41e07640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:39.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.151+0000 7fbe41e07640 1 -- 172.21.15.81:0/1734609280 >> v1:172.21.15.81:6791/0 conn(0x7fbe3c13d460 legacy=0x7fbe3c1d4030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.151+0000 7fbe41e07640 1 -- 172.21.15.81:0/1734609280 shutdown_connections 2024-09-10T16:36:39.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.151+0000 7fbe41e07640 1 -- 172.21.15.81:0/1734609280 >> 172.21.15.81:0/1734609280 conn(0x7fbe3c0a86b0 msgr2=0x7fbe3c0a57d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:39.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.151+0000 7fbe41e07640 1 -- 172.21.15.81:0/1734609280 shutdown_connections 2024-09-10T16:36:39.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.151+0000 7fbe41e07640 1 -- 172.21.15.81:0/1734609280 wait complete. 2024-09-10T16:36:39.172 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":509,"stamp":"2024-09-10T16:36:38.398464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":195368,"kb_used_data":12372,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566035672,"statfs":{"total":579820584960,"available":579620528128,"internally_reserved":0,"allocated":12668928,"data_stored":6343011,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":187226784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.609712"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":626,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.921854+0000","last_change":"2024-09-10T16:30:15.334487+0000","last_active":"2024-09-10T16:36:35.921854+0000","last_peered":"2024-09-10T16:36:35.921854+0000","last_clean":"2024-09-10T16:36:35.921854+0000","last_became_active":"2024-09-10T16:30:13.320369+0000","last_became_peered":"2024-09-10T16:30:13.320369+0000","last_unstale":"2024-09-10T16:36:35.921854+0000","last_undegraded":"2024-09-10T16:36:35.921854+0000","last_fullsized":"2024-09-10T16:36:35.921854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:03.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011103879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":628,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:37.206818+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:36:37.206818+0000","last_peered":"2024-09-10T16:36:37.206818+0000","last_clean":"2024-09-10T16:36:37.206818+0000","last_became_active":"2024-09-10T16:30:13.320284+0000","last_became_peered":"2024-09-10T16:30:13.320284+0000","last_unstale":"2024-09-10T16:36:37.206818+0000","last_undegraded":"2024-09-10T16:36:37.206818+0000","last_fullsized":"2024-09-10T16:36:37.206818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:11.783078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065529,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":627,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.921463+0000","last_change":"2024-09-10T16:30:15.335682+0000","last_active":"2024-09-10T16:36:35.921463+0000","last_peered":"2024-09-10T16:36:35.921463+0000","last_clean":"2024-09-10T16:36:35.921463+0000","last_became_active":"2024-09-10T16:30:13.317933+0000","last_became_peered":"2024-09-10T16:30:13.317933+0000","last_unstale":"2024-09-10T16:36:35.921463+0000","last_undegraded":"2024-09-10T16:36:35.921463+0000","last_fullsized":"2024-09-10T16:36:35.921463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:11.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018898459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":622,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:36.220536+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:36:36.220536+0000","last_peered":"2024-09-10T16:36:36.220536+0000","last_clean":"2024-09-10T16:36:36.220536+0000","last_became_active":"2024-09-10T16:30:13.314196+0000","last_became_peered":"2024-09-10T16:30:13.314196+0000","last_unstale":"2024-09-10T16:36:36.220536+0000","last_undegraded":"2024-09-10T16:36:36.220536+0000","last_fullsized":"2024-09-10T16:36:36.220536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:17.356490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092995700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":624,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.916628+0000","last_change":"2024-09-10T16:30:15.343908+0000","last_active":"2024-09-10T16:36:35.916628+0000","last_peered":"2024-09-10T16:36:35.916628+0000","last_clean":"2024-09-10T16:36:35.916628+0000","last_became_active":"2024-09-10T16:30:13.322410+0000","last_became_peered":"2024-09-10T16:30:13.322410+0000","last_unstale":"2024-09-10T16:36:35.916628+0000","last_undegraded":"2024-09-10T16:36:35.916628+0000","last_fullsized":"2024-09-10T16:36:35.916628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:23.371637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024400910000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":624,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.916982+0000","last_change":"2024-09-10T16:30:15.335359+0000","last_active":"2024-09-10T16:36:35.916982+0000","last_peered":"2024-09-10T16:36:35.916982+0000","last_clean":"2024-09-10T16:36:35.916982+0000","last_became_active":"2024-09-10T16:30:13.314279+0000","last_became_peered":"2024-09-10T16:30:13.314279+0000","last_unstale":"2024-09-10T16:36:35.916982+0000","last_undegraded":"2024-09-10T16:36:35.916982+0000","last_fullsized":"2024-09-10T16:36:35.916982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:19.341302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012467800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":628,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.913445+0000","last_change":"2024-09-10T16:30:15.336057+0000","last_active":"2024-09-10T16:36:35.913445+0000","last_peered":"2024-09-10T16:36:35.913445+0000","last_clean":"2024-09-10T16:36:35.913445+0000","last_became_active":"2024-09-10T16:30:13.315537+0000","last_became_peered":"2024-09-10T16:30:13.315537+0000","last_unstale":"2024-09-10T16:36:35.913445+0000","last_undegraded":"2024-09-10T16:36:35.913445+0000","last_fullsized":"2024-09-10T16:36:35.913445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:18.484028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001369903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":628,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.921393+0000","last_change":"2024-09-10T16:30:15.334665+0000","last_active":"2024-09-10T16:36:35.921393+0000","last_peered":"2024-09-10T16:36:35.921393+0000","last_clean":"2024-09-10T16:36:35.921393+0000","last_became_active":"2024-09-10T16:30:13.317955+0000","last_became_peered":"2024-09-10T16:30:13.317955+0000","last_unstale":"2024-09-10T16:36:35.921393+0000","last_undegraded":"2024-09-10T16:36:35.921393+0000","last_fullsized":"2024-09-10T16:36:35.921393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:01.463525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016930140000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":718,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.922348+0000","last_change":"2024-09-10T16:30:10.241185+0000","last_active":"2024-09-10T16:36:35.922348+0000","last_peered":"2024-09-10T16:36:35.922348+0000","last_clean":"2024-09-10T16:36:35.922348+0000","last_became_active":"2024-09-10T16:30:10.239296+0000","last_became_peered":"2024-09-10T16:30:10.239296+0000","last_unstale":"2024-09-10T16:36:35.922348+0000","last_undegraded":"2024-09-10T16:36:35.922348+0000","last_fullsized":"2024-09-10T16:36:35.922348+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_clean_scrub_stamp":"2024-09-10T16:30:09.204141+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:25.346646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33276,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338564,"statfs":{"total":96636764160,"available":96602689536,"internally_reserved":0,"allocated":2134016,"data_stored":1410089,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574929,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2084864,"data_stored":881180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2080768,"data_stored":881161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2080768,"data_stored":881161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33232,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338608,"statfs":{"total":96636764160,"available":96602734592,"internally_reserved":0,"allocated":2084864,"data_stored":881180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640338,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29180,"kb_used_data":2152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342660,"statfs":{"total":96636764160,"available":96606883840,"internally_reserved":0,"allocated":2203648,"data_stored":1408240,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T16:36:39.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T16:36:39.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.283+0000 7fca53104640 10 monclient: get_monmap_and_config 2024-09-10T16:36:39.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.283+0000 7fca53104640 10 monclient: build_initial_monmap 2024-09-10T16:36:39.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.283+0000 7fca53104640 10 monclient: monmap: 2024-09-10T16:36:39.289 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:39.289 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.289 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:39.289853+0000 2024-09-10T16:36:39.290 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:39.289853+0000 2024-09-10T16:36:39.290 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:39.290 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.290 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:39.290 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:39.290 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:39.290 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:39.291 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:39.291 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:39.291 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:39.291 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:39.291 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:39.291 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 1 Processor -- start 2024-09-10T16:36:39.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 1 -- start start 2024-09-10T16:36:39.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 10 monclient: init 2024-09-10T16:36:39.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:39.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 10 monclient: _add_conns ranks=[7,4,5,1,0,2,8,6,3] 2024-09-10T16:36:39.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 10 monclient(hunting): picked mon.noname-i con 0x7fca4c06e990 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:39.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 10 monclient(hunting): picked mon.noname-c con 0x7fca4c0a4600 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 10 monclient(hunting): picked mon.noname-h con 0x7fca4c0a49e0 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca4c06f7f0 con 0x7fca4c0a4600 2024-09-10T16:36:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca4c0a5630 con 0x7fca4c0a49e0 2024-09-10T16:36:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca4c070900 con 0x7fca4c06e990 2024-09-10T16:36:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 10 monclient(hunting): authenticate will time out at 1366.689520s 2024-09-10T16:36:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4bfff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fca4c0a4600 0x7fca4c13e2e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:49162/0 (socket says 172.21.15.81:49162) 2024-09-10T16:36:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4bfff640 1 -- 172.21.15.81:0/288117865 learned_addr learned my addr 172.21.15.81:0/288117865 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 1 -- 172.21.15.81:0/288117865 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2820746565 0 0) 0x7fca3c001120 con 0x7fca4c0a4600 2024-09-10T16:36:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:39.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient(hunting): my global_id is 144841 2024-09-10T16:36:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 1 -- 172.21.15.81:0/288117865 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca34003530 con 0x7fca4c0a4600 2024-09-10T16:36:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 1 -- 172.21.15.81:0/288117865 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2156624043 0 0) 0x7fca34003530 con 0x7fca4c0a4600 2024-09-10T16:36:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 1 -- 172.21.15.81:0/288117865 >> v1:172.21.15.189:6792/0 conn(0x7fca4c06e990 legacy=0x7fca4c0a3ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 1 -- 172.21.15.81:0/288117865 >> v1:172.21.15.189:6791/0 conn(0x7fca4c0a49e0 legacy=0x7fca4c141a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:36:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 1 monclient: found mon.noname-c 2024-09-10T16:36:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:36:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 1 -- 172.21.15.81:0/288117865 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4c070630 con 0x7fca4c0a4600 2024-09-10T16:36:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient: _finish_auth 0 2024-09-10T16:36:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:36:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 1 -- 172.21.15.81:0/288117865 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fca3c001a10 con 0x7fca4c0a4600 2024-09-10T16:36:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 5 monclient: authenticate success, global_id 144841 2024-09-10T16:36:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:36:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient: dump: 2024-09-10T16:36:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:39.302 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:39.303 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:39.304 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 1 -- 172.21.15.81:0/288117865 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca3c001c30 con 0x7fca4c0a4600 2024-09-10T16:36:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 4 set_mon_vals no callback set 2024-09-10T16:36:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 1 -- 172.21.15.81:0/288117865 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fca3c004bf0 con 0x7fca4c0a4600 2024-09-10T16:36:39.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca4b7fe640 10 monclient: dump: 2024-09-10T16:36:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:39.305 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:39.306 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 10 monclient: shutdown 2024-09-10T16:36:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:39.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 1 -- 172.21.15.81:0/288117865 >> v1:172.21.15.81:6791/0 conn(0x7fca4c0a4600 legacy=0x7fca4c13e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 1 -- 172.21.15.81:0/288117865 shutdown_connections 2024-09-10T16:36:39.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 1 -- 172.21.15.81:0/288117865 >> 172.21.15.81:0/288117865 conn(0x7fca4c0a94f0 msgr2=0x7fca4c0a9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:39.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 1 -- 172.21.15.81:0/288117865 shutdown_connections 2024-09-10T16:36:39.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 1 -- 172.21.15.81:0/288117865 wait complete. 2024-09-10T16:36:39.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 10 monclient: build_initial_monmap 2024-09-10T16:36:39.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.287+0000 7fca53104640 10 monclient: monmap: 2024-09-10T16:36:39.307 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:39.307 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:39.307 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:39.307 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:39.308 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:39.308 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:39.308 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:39.308 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:39.308 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:39.308 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:39.308 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:39.308 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:39.308 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:39.309 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:39.309 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:39.309 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 1 Processor -- start 2024-09-10T16:36:39.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 1 -- start start 2024-09-10T16:36:39.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 monclient: init 2024-09-10T16:36:39.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:39.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 monclient: _add_conns ranks=[3,2,7,6,1,0,4,8,5] 2024-09-10T16:36:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 monclient(hunting): picked mon.noname-g con 0x7fca4c06e990 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 monclient(hunting): picked mon.noname-b con 0x7fca4c0a4600 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 monclient(hunting): picked mon.noname-i con 0x7fca4c0a49e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca4c142110 con 0x7fca4c0a4600 2024-09-10T16:36:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca4c1290e0 con 0x7fca4c06e990 2024-09-10T16:36:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca4c1293c0 con 0x7fca4c0a49e0 2024-09-10T16:36:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 monclient(hunting): authenticate will time out at 1366.692946s 2024-09-10T16:36:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca4bfff640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fca4c0a4600 0x7fca4c1ce640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34230/0 (socket says 172.21.15.81:34230) 2024-09-10T16:36:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca4bfff640 1 -- 172.21.15.81:0/983257110 learned_addr learned my addr 172.21.15.81:0/983257110 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:39.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4199818864 0 0) 0x7fca4c070630 con 0x7fca4c0a4600 2024-09-10T16:36:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): _negotiate 2024-09-10T16:36:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): my global_id is 144974 2024-09-10T16:36:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca38003530 con 0x7fca4c0a4600 2024-09-10T16:36:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3975137368 0 0) 0x7fca38003530 con 0x7fca4c0a4600 2024-09-10T16:36:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fca4c070630 con 0x7fca4c0a4600 2024-09-10T16:36:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fca3c004b30 con 0x7fca4c0a4600 2024-09-10T16:36:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:39.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): dump: 2024-09-10T16:36:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:39.312 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:39.313 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:39.313 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1849305675 0 0) 0x7fca4c1290e0 con 0x7fca4c06e990 2024-09-10T16:36:39.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): _negotiate 2024-09-10T16:36:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): my global_id is 164190 2024-09-10T16:36:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca38003530 con 0x7fca4c06e990 2024-09-10T16:36:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2689215576 0 0) 0x7fca4c1293c0 con 0x7fca4c0a49e0 2024-09-10T16:36:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): _negotiate 2024-09-10T16:36:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:39.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient(hunting): my global_id is 164203 2024-09-10T16:36:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca4c1290e0 con 0x7fca4c0a49e0 2024-09-10T16:36:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1990601322 0 0) 0x7fca4c070630 con 0x7fca4c0a4600 2024-09-10T16:36:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 >> v1:172.21.15.189:6792/0 conn(0x7fca4c0a49e0 legacy=0x7fca4c1d6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 >> v1:172.21.15.189:6790/0 conn(0x7fca4c06e990 legacy=0x7fca4c1cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient: _finish_hunting 0 2024-09-10T16:36:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 monclient: found mon.b 2024-09-10T16:36:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4c1ced50 con 0x7fca4c0a4600 2024-09-10T16:36:39.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient: _finish_auth 0 2024-09-10T16:36:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient: _check_auth_tickets 2024-09-10T16:36:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 5 monclient: authenticate success, global_id 144974 2024-09-10T16:36:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 monclient: _renew_subs 2024-09-10T16:36:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 1 -- 172.21.15.81:0/983257110 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fca4c0a7660 con 0x7fca4c0a4600 2024-09-10T16:36:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 monclient: _renew_subs 2024-09-10T16:36:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 1 -- 172.21.15.81:0/983257110 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fca4c127340 con 0x7fca4c0a4600 2024-09-10T16:36:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fca3c004ef0 con 0x7fca4c0a4600 2024-09-10T16:36:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:39.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fca3c001bf0 con 0x7fca4c0a4600 2024-09-10T16:36:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca4affd640 4 set_mon_vals no callback set 2024-09-10T16:36:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 10 monclient: dump: 2024-09-10T16:36:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:39.322 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca53104640 1 -- 172.21.15.81:0/983257110 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca2c005090 con 0x7fca4c0a4600 2024-09-10T16:36:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fca3c011150 con 0x7fca4c0a4600 2024-09-10T16:36:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(324..324 src has 121..324) ==== 3506+0+0 (unknown 2961462200 0 0) 0x7fca3c04af50 con 0x7fca4c0a4600 2024-09-10T16:36:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.291+0000 7fca50ea0640 10 monclient: get_auth_request con 0x7fca3803d1a0 auth_method 0 2024-09-10T16:36:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.295+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7fca4c142110 con 0x7fca4c0a4600 2024-09-10T16:36:39.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.295+0000 7fca497fa640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:39.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.295+0000 7fca497fa640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:39.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.463+0000 7fca53104640 1 -- 172.21.15.81:0/983257110 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca2c000ba0 con 0x7fca3803d1a0 2024-09-10T16:36:39.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.467+0000 7fca497fa640 1 -- 172.21.15.81:0/983257110 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34080 (unknown 2965378022 0 2348393127) 0x7fca2c000ba0 con 0x7fca3803d1a0 2024-09-10T16:36:39.469 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:36:39.470 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T16:36:39.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.467+0000 7fca53104640 1 -- 172.21.15.81:0/983257110 >> v1:172.21.15.189:6812/1108603242 conn(0x7fca3803d1a0 legacy=0x7fca3803f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.467+0000 7fca53104640 10 monclient: shutdown 2024-09-10T16:36:39.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.467+0000 7fca53104640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:39.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.467+0000 7fca53104640 1 -- 172.21.15.81:0/983257110 >> v1:172.21.15.81:6790/0 conn(0x7fca4c0a4600 legacy=0x7fca4c1ce640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.467+0000 7fca53104640 1 -- 172.21.15.81:0/983257110 shutdown_connections 2024-09-10T16:36:39.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.467+0000 7fca53104640 1 -- 172.21.15.81:0/983257110 >> 172.21.15.81:0/983257110 conn(0x7fca4c0a94f0 msgr2=0x7fca4c1429a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:39.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.467+0000 7fca53104640 1 -- 172.21.15.81:0/983257110 shutdown_connections 2024-09-10T16:36:39.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.467+0000 7fca53104640 1 -- 172.21.15.81:0/983257110 wait complete. 2024-09-10T16:36:39.487 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":509,"stamp":"2024-09-10T16:36:38.398464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":195368,"kb_used_data":12372,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566035672,"statfs":{"total":579820584960,"available":579620528128,"internally_reserved":0,"allocated":12668928,"data_stored":6343011,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":187226784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.609712"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":626,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.921854+0000","last_change":"2024-09-10T16:30:15.334487+0000","last_active":"2024-09-10T16:36:35.921854+0000","last_peered":"2024-09-10T16:36:35.921854+0000","last_clean":"2024-09-10T16:36:35.921854+0000","last_became_active":"2024-09-10T16:30:13.320369+0000","last_became_peered":"2024-09-10T16:30:13.320369+0000","last_unstale":"2024-09-10T16:36:35.921854+0000","last_undegraded":"2024-09-10T16:36:35.921854+0000","last_fullsized":"2024-09-10T16:36:35.921854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:03.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011103879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":628,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:37.206818+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:36:37.206818+0000","last_peered":"2024-09-10T16:36:37.206818+0000","last_clean":"2024-09-10T16:36:37.206818+0000","last_became_active":"2024-09-10T16:30:13.320284+0000","last_became_peered":"2024-09-10T16:30:13.320284+0000","last_unstale":"2024-09-10T16:36:37.206818+0000","last_undegraded":"2024-09-10T16:36:37.206818+0000","last_fullsized":"2024-09-10T16:36:37.206818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:11.783078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065529,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":627,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.921463+0000","last_change":"2024-09-10T16:30:15.335682+0000","last_active":"2024-09-10T16:36:35.921463+0000","last_peered":"2024-09-10T16:36:35.921463+0000","last_clean":"2024-09-10T16:36:35.921463+0000","last_became_active":"2024-09-10T16:30:13.317933+0000","last_became_peered":"2024-09-10T16:30:13.317933+0000","last_unstale":"2024-09-10T16:36:35.921463+0000","last_undegraded":"2024-09-10T16:36:35.921463+0000","last_fullsized":"2024-09-10T16:36:35.921463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:11.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018898459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":622,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:36.220536+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:36:36.220536+0000","last_peered":"2024-09-10T16:36:36.220536+0000","last_clean":"2024-09-10T16:36:36.220536+0000","last_became_active":"2024-09-10T16:30:13.314196+0000","last_became_peered":"2024-09-10T16:30:13.314196+0000","last_unstale":"2024-09-10T16:36:36.220536+0000","last_undegraded":"2024-09-10T16:36:36.220536+0000","last_fullsized":"2024-09-10T16:36:36.220536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:17.356490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092995700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":624,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.916628+0000","last_change":"2024-09-10T16:30:15.343908+0000","last_active":"2024-09-10T16:36:35.916628+0000","last_peered":"2024-09-10T16:36:35.916628+0000","last_clean":"2024-09-10T16:36:35.916628+0000","last_became_active":"2024-09-10T16:30:13.322410+0000","last_became_peered":"2024-09-10T16:30:13.322410+0000","last_unstale":"2024-09-10T16:36:35.916628+0000","last_undegraded":"2024-09-10T16:36:35.916628+0000","last_fullsized":"2024-09-10T16:36:35.916628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:23.371637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024400910000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":624,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.916982+0000","last_change":"2024-09-10T16:30:15.335359+0000","last_active":"2024-09-10T16:36:35.916982+0000","last_peered":"2024-09-10T16:36:35.916982+0000","last_clean":"2024-09-10T16:36:35.916982+0000","last_became_active":"2024-09-10T16:30:13.314279+0000","last_became_peered":"2024-09-10T16:30:13.314279+0000","last_unstale":"2024-09-10T16:36:35.916982+0000","last_undegraded":"2024-09-10T16:36:35.916982+0000","last_fullsized":"2024-09-10T16:36:35.916982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:19.341302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012467800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":628,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.913445+0000","last_change":"2024-09-10T16:30:15.336057+0000","last_active":"2024-09-10T16:36:35.913445+0000","last_peered":"2024-09-10T16:36:35.913445+0000","last_clean":"2024-09-10T16:36:35.913445+0000","last_became_active":"2024-09-10T16:30:13.315537+0000","last_became_peered":"2024-09-10T16:30:13.315537+0000","last_unstale":"2024-09-10T16:36:35.913445+0000","last_undegraded":"2024-09-10T16:36:35.913445+0000","last_fullsized":"2024-09-10T16:36:35.913445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:18.484028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001369903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":628,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.921393+0000","last_change":"2024-09-10T16:30:15.334665+0000","last_active":"2024-09-10T16:36:35.921393+0000","last_peered":"2024-09-10T16:36:35.921393+0000","last_clean":"2024-09-10T16:36:35.921393+0000","last_became_active":"2024-09-10T16:30:13.317955+0000","last_became_peered":"2024-09-10T16:30:13.317955+0000","last_unstale":"2024-09-10T16:36:35.921393+0000","last_undegraded":"2024-09-10T16:36:35.921393+0000","last_fullsized":"2024-09-10T16:36:35.921393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:01.463525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016930140000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":718,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.922348+0000","last_change":"2024-09-10T16:30:10.241185+0000","last_active":"2024-09-10T16:36:35.922348+0000","last_peered":"2024-09-10T16:36:35.922348+0000","last_clean":"2024-09-10T16:36:35.922348+0000","last_became_active":"2024-09-10T16:30:10.239296+0000","last_became_peered":"2024-09-10T16:30:10.239296+0000","last_unstale":"2024-09-10T16:36:35.922348+0000","last_undegraded":"2024-09-10T16:36:35.922348+0000","last_fullsized":"2024-09-10T16:36:35.922348+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_clean_scrub_stamp":"2024-09-10T16:30:09.204141+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:25.346646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33276,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338564,"statfs":{"total":96636764160,"available":96602689536,"internally_reserved":0,"allocated":2134016,"data_stored":1410089,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574929,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2084864,"data_stored":881180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2080768,"data_stored":881161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2080768,"data_stored":881161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33232,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338608,"statfs":{"total":96636764160,"available":96602734592,"internally_reserved":0,"allocated":2084864,"data_stored":881180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640338,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29180,"kb_used_data":2152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342660,"statfs":{"total":96636764160,"available":96606883840,"internally_reserved":0,"allocated":2203648,"data_stored":1408240,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T16:36:39.488 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-10T16:36:39.488 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T16:36:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.603+0000 7f452a978640 10 monclient: get_monmap_and_config 2024-09-10T16:36:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.603+0000 7f452a978640 10 monclient: build_initial_monmap 2024-09-10T16:36:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.603+0000 7f452a978640 10 monclient: monmap: 2024-09-10T16:36:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:39.608842+0000 2024-09-10T16:36:39.607 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:39.608842+0000 2024-09-10T16:36:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:39.608 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:39.608 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.603+0000 7f452a978640 1 Processor -- start 2024-09-10T16:36:39.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.603+0000 7f452a978640 1 -- start start 2024-09-10T16:36:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.603+0000 7f452a978640 10 monclient: init 2024-09-10T16:36:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient: _add_conns ranks=[6,7,0,1,4,5,8,2,3] 2024-09-10T16:36:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient(hunting): picked mon.noname-d con 0x7f452409ca10 addr v1:172.21.15.81:6792/0 2024-09-10T16:36:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient(hunting): picked mon.noname-i con 0x7f45240a56e0 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient(hunting): picked mon.noname-a con 0x7f45240a5b00 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45241362b0 con 0x7f45240a5b00 2024-09-10T16:36:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45240a80b0 con 0x7f452409ca10 2024-09-10T16:36:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f452409de70 con 0x7f45240a56e0 2024-09-10T16:36:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient(hunting): authenticate will time out at 1367.008801s 2024-09-10T16:36:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4523fff640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f452409ca10 0x7f4524135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:40216/0 (socket says 172.21.15.81:40216) 2024-09-10T16:36:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4523fff640 1 -- 172.21.15.81:0/3467548523 learned_addr learned my addr 172.21.15.81:0/3467548523 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4528f15640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f45240a5b00 0x7f4524141650 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37392/0 (socket says 172.21.15.81:37392) 2024-09-10T16:36:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 1 -- 172.21.15.81:0/3467548523 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 941371100 0 0) 0x7f45241362b0 con 0x7f45240a5b00 2024-09-10T16:36:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient(hunting): my global_id is 6552 2024-09-10T16:36:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 1 -- 172.21.15.81:0/3467548523 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f450c003530 con 0x7f45240a5b00 2024-09-10T16:36:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 1 -- 172.21.15.81:0/3467548523 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1811541758 0 0) 0x7f45240a80b0 con 0x7f452409ca10 2024-09-10T16:36:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient(hunting): my global_id is 144798 2024-09-10T16:36:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 1 -- 172.21.15.81:0/3467548523 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45241362b0 con 0x7f452409ca10 2024-09-10T16:36:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 1 -- 172.21.15.81:0/3467548523 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3092641265 0 0) 0x7f45241362b0 con 0x7f452409ca10 2024-09-10T16:36:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 1 -- 172.21.15.81:0/3467548523 >> v1:172.21.15.189:6792/0 conn(0x7f45240a56e0 legacy=0x7f452413df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 1 -- 172.21.15.81:0/3467548523 >> v1:172.21.15.81:6789/0 conn(0x7f45240a5b00 legacy=0x7f4524141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:36:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 1 monclient: found mon.noname-d 2024-09-10T16:36:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient: _send_mon_message to mon.noname-d at v1:172.21.15.81:6792/0 2024-09-10T16:36:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 1 -- 172.21.15.81:0/3467548523 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f452409e150 con 0x7f452409ca10 2024-09-10T16:36:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient: _finish_auth 0 2024-09-10T16:36:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:36:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 1 -- 172.21.15.81:0/3467548523 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f451c001b20 con 0x7f452409ca10 2024-09-10T16:36:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 5 monclient: authenticate success, global_id 144798 2024-09-10T16:36:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient: got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:36:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient: dump: 2024-09-10T16:36:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.614 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 1 -- 172.21.15.81:0/3467548523 <== mon.6 v1:172.21.15.81:6792/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f451c001d40 con 0x7f452409ca10 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 4 set_mon_vals no callback set 2024-09-10T16:36:39.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 1 -- 172.21.15.81:0/3467548523 <== mon.6 v1:172.21.15.81:6792/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f451c004f70 con 0x7f452409ca10 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f4522ffd640 10 monclient: dump: 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:39.616 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:39.617 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient: shutdown 2024-09-10T16:36:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 1 -- 172.21.15.81:0/3467548523 >> v1:172.21.15.81:6792/0 conn(0x7f452409ca10 legacy=0x7f4524135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 1 -- 172.21.15.81:0/3467548523 shutdown_connections 2024-09-10T16:36:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 1 -- 172.21.15.81:0/3467548523 >> 172.21.15.81:0/3467548523 conn(0x7f452406dc90 msgr2=0x7f45240ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 1 -- 172.21.15.81:0/3467548523 shutdown_connections 2024-09-10T16:36:39.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 1 -- 172.21.15.81:0/3467548523 wait complete. 2024-09-10T16:36:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient: build_initial_monmap 2024-09-10T16:36:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient: monmap: 2024-09-10T16:36:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:39.621 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:39.622 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 1 Processor -- start 2024-09-10T16:36:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 1 -- start start 2024-09-10T16:36:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient: init 2024-09-10T16:36:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:39.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient: _add_conns ranks=[7,8,6,5,1,0,2,3,4] 2024-09-10T16:36:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient(hunting): picked mon.noname-i con 0x7f452409ca10 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient(hunting): picked mon.noname-e con 0x7f45240a56e0 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient(hunting): picked mon.noname-d con 0x7f45240a5b00 addr v1:172.21.15.81:6792/0 2024-09-10T16:36:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45240a09d0 con 0x7f45240a5b00 2024-09-10T16:36:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4524142a40 con 0x7f452409ca10 2024-09-10T16:36:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f452409e670 con 0x7f45240a56e0 2024-09-10T16:36:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.607+0000 7f452a978640 10 monclient(hunting): authenticate will time out at 1367.011919s 2024-09-10T16:36:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4528f15640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f45240a5b00 0x7f45241d5fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:40224/0 (socket says 172.21.15.81:40224) 2024-09-10T16:36:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4528f15640 1 -- 172.21.15.81:0/2858124895 learned_addr learned my addr 172.21.15.81:0/2858124895 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f45237fe640 1 --1- 172.21.15.81:0/2858124895 >> v1:172.21.15.81:6793/0 conn(0x7f45240a56e0 0x7f4524131d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35210/0 (socket says 172.21.15.81:35210) 2024-09-10T16:36:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3776258004 0 0) 0x7f45240a09d0 con 0x7f45240a5b00 2024-09-10T16:36:39.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): my global_id is 144807 2024-09-10T16:36:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4510003530 con 0x7f45240a5b00 2024-09-10T16:36:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254347125 0 0) 0x7f452409e670 con 0x7f45240a56e0 2024-09-10T16:36:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): my global_id is 6659 2024-09-10T16:36:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45240a09d0 con 0x7f45240a56e0 2024-09-10T16:36:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3020964512 0 0) 0x7f4510003530 con 0x7f45240a5b00 2024-09-10T16:36:39.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f452409e670 con 0x7f45240a5b00 2024-09-10T16:36:39.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4514001970 con 0x7f45240a5b00 2024-09-10T16:36:39.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:39.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:36:39.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): dump: 2024-09-10T16:36:39.625 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:39.625 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.625 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.625 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.625 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:39.625 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.625 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:39.625 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:39.625 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:39.626 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:39.626 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:39.626 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:39.626 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:39.626 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:39.626 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:39.626 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:39.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 319697710 0 0) 0x7f45240a09d0 con 0x7f45240a56e0 2024-09-10T16:36:39.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4510003530 con 0x7f45240a56e0 2024-09-10T16:36:39.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 631969950 0 0) 0x7f4524142a40 con 0x7f452409ca10 2024-09-10T16:36:39.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:39.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:39.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:39.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): my global_id is 164221 2024-09-10T16:36:39.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45240a09d0 con 0x7f452409ca10 2024-09-10T16:36:39.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f45180019c0 con 0x7f45240a56e0 2024-09-10T16:36:39.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:39.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:39.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient(hunting): dump: 2024-09-10T16:36:39.627 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:39.627 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.627 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.627 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.627 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:39.627 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.627 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:39.628 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:39.628 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:39.628 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:39.628 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:39.628 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:39.628 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:39.628 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:39.628 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:39.628 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1912239946 0 0) 0x7f452409e670 con 0x7f45240a5b00 2024-09-10T16:36:39.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 >> v1:172.21.15.81:6793/0 conn(0x7f45240a56e0 legacy=0x7f4524131d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 >> v1:172.21.15.189:6792/0 conn(0x7f452409ca10 legacy=0x7f4524131650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:36:39.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 monclient: found mon.d 2024-09-10T16:36:39.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:39.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:39.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45240a0130 con 0x7f45240a5b00 2024-09-10T16:36:39.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient: _finish_auth 0 2024-09-10T16:36:39.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:36:39.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:39.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f452a978640 5 monclient: authenticate success, global_id 144807 2024-09-10T16:36:39.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f452a978640 10 monclient: _renew_subs 2024-09-10T16:36:39.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f452a978640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:39.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f452a978640 1 -- 172.21.15.81:0/2858124895 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f45240a0410 con 0x7f45240a5b00 2024-09-10T16:36:39.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f452a978640 10 monclient: _renew_subs 2024-09-10T16:36:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f452a978640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f452a978640 1 -- 172.21.15.81:0/2858124895 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f452409f3a0 con 0x7f45240a5b00 2024-09-10T16:36:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f45140047f0 con 0x7f45240a5b00 2024-09-10T16:36:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4514004d60 con 0x7f45240a5b00 2024-09-10T16:36:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:36:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f45227fc640 4 set_mon_vals no callback set 2024-09-10T16:36:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 10 monclient: dump: 2024-09-10T16:36:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.630 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:39.631 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f452a978640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:39.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f452a978640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:39.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f452a978640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:39.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f452a978640 1 -- 172.21.15.81:0/2858124895 --> v1:172.21.15.81:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4504005090 con 0x7f45240a5b00 2024-09-10T16:36:39.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f4514004f80 con 0x7f45240a5b00 2024-09-10T16:36:39.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(324..324 src has 121..324) ==== 3506+0+0 (unknown 2961462200 0 0) 0x7f451404ad50 con 0x7f45240a5b00 2024-09-10T16:36:39.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.611+0000 7f4523fff640 10 monclient: get_auth_request con 0x7f451003d860 auth_method 0 2024-09-10T16:36:39.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.615+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 <== mon.6 v1:172.21.15.81:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f4514016bb0 con 0x7f45240a5b00 2024-09-10T16:36:39.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.615+0000 7f4520ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:39.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.615+0000 7f4520ff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:39.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.787+0000 7f452a978640 1 -- 172.21.15.81:0/2858124895 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4504000ba0 con 0x7f451003d860 2024-09-10T16:36:39.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.791+0000 7f4520ff9640 1 -- 172.21.15.81:0/2858124895 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34080 (unknown 2965378022 0 2348393127) 0x7f4504000ba0 con 0x7f451003d860 2024-09-10T16:36:39.794 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:36:39.794 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T16:36:39.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.795+0000 7f452a978640 1 -- 172.21.15.81:0/2858124895 >> v1:172.21.15.189:6812/1108603242 conn(0x7f451003d860 legacy=0x7f451003fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.795+0000 7f452a978640 10 monclient: shutdown 2024-09-10T16:36:39.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.795+0000 7f452a978640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:39.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.795+0000 7f452a978640 1 -- 172.21.15.81:0/2858124895 >> v1:172.21.15.81:6792/0 conn(0x7f45240a5b00 legacy=0x7f45241d5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.795+0000 7f452a978640 1 -- 172.21.15.81:0/2858124895 shutdown_connections 2024-09-10T16:36:39.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.795+0000 7f452a978640 1 -- 172.21.15.81:0/2858124895 >> 172.21.15.81:0/2858124895 conn(0x7f452406dc90 msgr2=0x7f45240aa830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:39.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.795+0000 7f452a978640 1 -- 172.21.15.81:0/2858124895 shutdown_connections 2024-09-10T16:36:39.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.795+0000 7f452a978640 1 -- 172.21.15.81:0/2858124895 wait complete. 2024-09-10T16:36:39.813 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":509,"stamp":"2024-09-10T16:36:38.398464+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":55,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":195368,"kb_used_data":12372,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566035672,"statfs":{"total":579820584960,"available":579620528128,"internally_reserved":0,"allocated":12668928,"data_stored":6343011,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":187226784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.609712"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":626,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.921854+0000","last_change":"2024-09-10T16:30:15.334487+0000","last_active":"2024-09-10T16:36:35.921854+0000","last_peered":"2024-09-10T16:36:35.921854+0000","last_clean":"2024-09-10T16:36:35.921854+0000","last_became_active":"2024-09-10T16:30:13.320369+0000","last_became_peered":"2024-09-10T16:30:13.320369+0000","last_unstale":"2024-09-10T16:36:35.921854+0000","last_undegraded":"2024-09-10T16:36:35.921854+0000","last_fullsized":"2024-09-10T16:36:35.921854+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:03.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011103879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":628,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:37.206818+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:36:37.206818+0000","last_peered":"2024-09-10T16:36:37.206818+0000","last_clean":"2024-09-10T16:36:37.206818+0000","last_became_active":"2024-09-10T16:30:13.320284+0000","last_became_peered":"2024-09-10T16:30:13.320284+0000","last_unstale":"2024-09-10T16:36:37.206818+0000","last_undegraded":"2024-09-10T16:36:37.206818+0000","last_fullsized":"2024-09-10T16:36:37.206818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:11.783078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065529,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":627,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.921463+0000","last_change":"2024-09-10T16:30:15.335682+0000","last_active":"2024-09-10T16:36:35.921463+0000","last_peered":"2024-09-10T16:36:35.921463+0000","last_clean":"2024-09-10T16:36:35.921463+0000","last_became_active":"2024-09-10T16:30:13.317933+0000","last_became_peered":"2024-09-10T16:30:13.317933+0000","last_unstale":"2024-09-10T16:36:35.921463+0000","last_undegraded":"2024-09-10T16:36:35.921463+0000","last_fullsized":"2024-09-10T16:36:35.921463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:11.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018898459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":622,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:36.220536+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:36:36.220536+0000","last_peered":"2024-09-10T16:36:36.220536+0000","last_clean":"2024-09-10T16:36:36.220536+0000","last_became_active":"2024-09-10T16:30:13.314196+0000","last_became_peered":"2024-09-10T16:30:13.314196+0000","last_unstale":"2024-09-10T16:36:36.220536+0000","last_undegraded":"2024-09-10T16:36:36.220536+0000","last_fullsized":"2024-09-10T16:36:36.220536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:17.356490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092995700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":624,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.916628+0000","last_change":"2024-09-10T16:30:15.343908+0000","last_active":"2024-09-10T16:36:35.916628+0000","last_peered":"2024-09-10T16:36:35.916628+0000","last_clean":"2024-09-10T16:36:35.916628+0000","last_became_active":"2024-09-10T16:30:13.322410+0000","last_became_peered":"2024-09-10T16:30:13.322410+0000","last_unstale":"2024-09-10T16:36:35.916628+0000","last_undegraded":"2024-09-10T16:36:35.916628+0000","last_fullsized":"2024-09-10T16:36:35.916628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:23.371637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024400910000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":624,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.916982+0000","last_change":"2024-09-10T16:30:15.335359+0000","last_active":"2024-09-10T16:36:35.916982+0000","last_peered":"2024-09-10T16:36:35.916982+0000","last_clean":"2024-09-10T16:36:35.916982+0000","last_became_active":"2024-09-10T16:30:13.314279+0000","last_became_peered":"2024-09-10T16:30:13.314279+0000","last_unstale":"2024-09-10T16:36:35.916982+0000","last_undegraded":"2024-09-10T16:36:35.916982+0000","last_fullsized":"2024-09-10T16:36:35.916982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:19.341302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012467800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":628,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.913445+0000","last_change":"2024-09-10T16:30:15.336057+0000","last_active":"2024-09-10T16:36:35.913445+0000","last_peered":"2024-09-10T16:36:35.913445+0000","last_clean":"2024-09-10T16:36:35.913445+0000","last_became_active":"2024-09-10T16:30:13.315537+0000","last_became_peered":"2024-09-10T16:30:13.315537+0000","last_unstale":"2024-09-10T16:36:35.913445+0000","last_undegraded":"2024-09-10T16:36:35.913445+0000","last_fullsized":"2024-09-10T16:36:35.913445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:18.484028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001369903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":628,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.921393+0000","last_change":"2024-09-10T16:30:15.334665+0000","last_active":"2024-09-10T16:36:35.921393+0000","last_peered":"2024-09-10T16:36:35.921393+0000","last_clean":"2024-09-10T16:36:35.921393+0000","last_became_active":"2024-09-10T16:30:13.317955+0000","last_became_peered":"2024-09-10T16:30:13.317955+0000","last_unstale":"2024-09-10T16:36:35.921393+0000","last_undegraded":"2024-09-10T16:36:35.921393+0000","last_fullsized":"2024-09-10T16:36:35.921393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:01.463525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016930140000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":718,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.922348+0000","last_change":"2024-09-10T16:30:10.241185+0000","last_active":"2024-09-10T16:36:35.922348+0000","last_peered":"2024-09-10T16:36:35.922348+0000","last_clean":"2024-09-10T16:36:35.922348+0000","last_became_active":"2024-09-10T16:30:10.239296+0000","last_became_peered":"2024-09-10T16:30:10.239296+0000","last_unstale":"2024-09-10T16:36:35.922348+0000","last_undegraded":"2024-09-10T16:36:35.922348+0000","last_fullsized":"2024-09-10T16:36:35.922348+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_clean_scrub_stamp":"2024-09-10T16:30:09.204141+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:25.346646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33276,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338564,"statfs":{"total":96636764160,"available":96602689536,"internally_reserved":0,"allocated":2134016,"data_stored":1410089,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574929,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2084864,"data_stored":881180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2080768,"data_stored":881161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2080768,"data_stored":881161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33232,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338608,"statfs":{"total":96636764160,"available":96602734592,"internally_reserved":0,"allocated":2084864,"data_stored":881180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640338,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29180,"kb_used_data":2152,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342660,"statfs":{"total":96636764160,"available":96606883840,"internally_reserved":0,"allocated":2203648,"data_stored":1408240,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T16:36:39.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-10T16:36:39.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 10 monclient: get_monmap_and_config 2024-09-10T16:36:39.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 10 monclient: build_initial_monmap 2024-09-10T16:36:39.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 10 monclient: monmap: 2024-09-10T16:36:39.935 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:39.935 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.935 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:39.936163+0000 2024-09-10T16:36:39.935 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:39.936163+0000 2024-09-10T16:36:39.935 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:39.935 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.935 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:39.935 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:39.935 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:39.935 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:39.935 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:39.935 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:39.935 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:39.936 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 1 Processor -- start 2024-09-10T16:36:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 1 -- start start 2024-09-10T16:36:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 10 monclient: init 2024-09-10T16:36:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 10 monclient: _add_conns ranks=[4,3,2,8,7,1,6,0,5] 2024-09-10T16:36:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 10 monclient(hunting): picked mon.noname-c con 0x7f0e780a0a90 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 10 monclient(hunting): picked mon.noname-g con 0x7f0e780a35f0 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 10 monclient(hunting): picked mon.noname-b con 0x7f0e780a3a40 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e7809df70 con 0x7f0e780a3a40 2024-09-10T16:36:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e7809fa30 con 0x7f0e780a35f0 2024-09-10T16:36:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e7809fd10 con 0x7f0e780a0a90 2024-09-10T16:36:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e7d56c640 10 monclient(hunting): authenticate will time out at 1367.335783s 2024-09-10T16:36:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e76ffd640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f0e780a0a90 0x7f0e780a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:49176/0 (socket says 172.21.15.81:49176) 2024-09-10T16:36:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e777fe640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f0e780a3a40 0x7f0e7813fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34242/0 (socket says 172.21.15.81:34242) 2024-09-10T16:36:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.931+0000 7f0e76ffd640 1 -- 172.21.15.81:0/3646847112 learned_addr learned my addr 172.21.15.81:0/3646847112 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 1 -- 172.21.15.81:0/3646847112 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2290258349 0 0) 0x7f0e7809fd10 con 0x7f0e780a0a90 2024-09-10T16:36:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient(hunting): my global_id is 144850 2024-09-10T16:36:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 1 -- 172.21.15.81:0/3646847112 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e64003530 con 0x7f0e780a0a90 2024-09-10T16:36:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 1 -- 172.21.15.81:0/3646847112 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2192180638 0 0) 0x7f0e7809df70 con 0x7f0e780a3a40 2024-09-10T16:36:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient(hunting): my global_id is 144983 2024-09-10T16:36:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 1 -- 172.21.15.81:0/3646847112 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e7809fd10 con 0x7f0e780a3a40 2024-09-10T16:36:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 1 -- 172.21.15.81:0/3646847112 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4136311414 0 0) 0x7f0e7809fd10 con 0x7f0e780a3a40 2024-09-10T16:36:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 1 -- 172.21.15.81:0/3646847112 >> v1:172.21.15.81:6791/0 conn(0x7f0e780a0a90 legacy=0x7f0e780a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 1 -- 172.21.15.81:0/3646847112 >> v1:172.21.15.189:6790/0 conn(0x7f0e780a35f0 legacy=0x7f0e7813c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:36:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 1 monclient: found mon.noname-b 2024-09-10T16:36:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:36:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 1 -- 172.21.15.81:0/3646847112 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e7809fff0 con 0x7f0e780a3a40 2024-09-10T16:36:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient: _finish_auth 0 2024-09-10T16:36:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:36:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 5 monclient: authenticate success, global_id 144983 2024-09-10T16:36:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 1 -- 172.21.15.81:0/3646847112 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0e68001820 con 0x7f0e780a3a40 2024-09-10T16:36:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient: dump: 2024-09-10T16:36:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:39.945 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:39.946 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 1 -- 172.21.15.81:0/3646847112 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e680019c0 con 0x7f0e780a3a40 2024-09-10T16:36:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 1 -- 172.21.15.81:0/3646847112 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0e68004b30 con 0x7f0e780a3a40 2024-09-10T16:36:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e75ffb640 10 monclient: dump: 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:39.947 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:39.948 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 4 set_mon_vals no callback set 2024-09-10T16:36:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient: shutdown 2024-09-10T16:36:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 1 -- 172.21.15.81:0/3646847112 >> v1:172.21.15.81:6790/0 conn(0x7f0e780a3a40 legacy=0x7f0e7813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 1 -- 172.21.15.81:0/3646847112 shutdown_connections 2024-09-10T16:36:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 1 -- 172.21.15.81:0/3646847112 >> 172.21.15.81:0/3646847112 conn(0x7f0e780a3fd0 msgr2=0x7f0e780a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 1 -- 172.21.15.81:0/3646847112 shutdown_connections 2024-09-10T16:36:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 1 -- 172.21.15.81:0/3646847112 wait complete. 2024-09-10T16:36:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient: build_initial_monmap 2024-09-10T16:36:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient: monmap: 2024-09-10T16:36:39.948 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:39.950 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 1 Processor -- start 2024-09-10T16:36:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 1 -- start start 2024-09-10T16:36:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient: init 2024-09-10T16:36:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient: _add_conns ranks=[4,3,5,1,7,6,8,0,2] 2024-09-10T16:36:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient(hunting): picked mon.noname-c con 0x7f0e780a0a90 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient(hunting): picked mon.noname-g con 0x7f0e780a35f0 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient(hunting): picked mon.noname-h con 0x7f0e780a3a40 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e780a6ae0 con 0x7f0e780a35f0 2024-09-10T16:36:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e781b4630 con 0x7f0e780a0a90 2024-09-10T16:36:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0e781b20c0 con 0x7f0e780a3a40 2024-09-10T16:36:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient(hunting): authenticate will time out at 1367.338841s 2024-09-10T16:36:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e76ffd640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f0e780a0a90 0x7f0e781b12a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:49192/0 (socket says 172.21.15.81:49192) 2024-09-10T16:36:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e76ffd640 1 -- 172.21.15.81:0/1700743616 learned_addr learned my addr 172.21.15.81:0/1700743616 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1500947701 0 0) 0x7f0e781b4630 con 0x7f0e780a0a90 2024-09-10T16:36:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient(hunting): my global_id is 144859 2024-09-10T16:36:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e58003530 con 0x7f0e780a0a90 2024-09-10T16:36:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4062486882 0 0) 0x7f0e58003530 con 0x7f0e780a0a90 2024-09-10T16:36:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0e781b4630 con 0x7f0e780a0a90 2024-09-10T16:36:39.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0e60001f20 con 0x7f0e780a0a90 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient(hunting): dump: 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:39.952 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:39.953 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:39.953 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:39.953 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:39.953 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:39.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 290246766 0 0) 0x7f0e781b4630 con 0x7f0e780a0a90 2024-09-10T16:36:39.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 >> v1:172.21.15.189:6791/0 conn(0x7f0e780a3a40 legacy=0x7f0e781d3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 >> v1:172.21.15.189:6790/0 conn(0x7f0e780a35f0 legacy=0x7f0e781b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:39.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:36:39.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 1 monclient: found mon.c 2024-09-10T16:36:39.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:39.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:39.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e781b37c0 con 0x7f0e780a0a90 2024-09-10T16:36:39.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient: _finish_auth 0 2024-09-10T16:36:39.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:36:39.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:39.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 5 monclient: authenticate success, global_id 144859 2024-09-10T16:36:39.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient: _renew_subs 2024-09-10T16:36:39.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:39.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 1 -- 172.21.15.81:0/1700743616 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f0e781b4070 con 0x7f0e780a0a90 2024-09-10T16:36:39.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient: _renew_subs 2024-09-10T16:36:39.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:39.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e7d56c640 1 -- 172.21.15.81:0/1700743616 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f0e78074150 con 0x7f0e780a0a90 2024-09-10T16:36:39.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0e60004e20 con 0x7f0e780a0a90 2024-09-10T16:36:39.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:39.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0e60005310 con 0x7f0e780a0a90 2024-09-10T16:36:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e757fa640 4 set_mon_vals no callback set 2024-09-10T16:36:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.935+0000 7f0e6f7fe640 10 monclient: dump: 2024-09-10T16:36:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:39.956 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:39.956 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:39.956 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:39.956 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:39.956 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:39.956 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:39.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.939+0000 7f0e7d56c640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:39.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.939+0000 7f0e7d56c640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:39.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.939+0000 7f0e7d56c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:39.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.939+0000 7f0e7d56c640 1 -- 172.21.15.81:0/1700743616 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e5c005090 con 0x7f0e780a0a90 2024-09-10T16:36:39.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.939+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f0e60011220 con 0x7f0e780a0a90 2024-09-10T16:36:39.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.939+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(324..324 src has 121..324) ==== 3506+0+0 (unknown 2961462200 0 0) 0x7f0e6004b250 con 0x7f0e780a0a90 2024-09-10T16:36:39.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.939+0000 7f0e767fc640 10 monclient: get_auth_request con 0x7f0e5803d040 auth_method 0 2024-09-10T16:36:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.943+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f0e60017190 con 0x7f0e780a0a90 2024-09-10T16:36:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.943+0000 7f0e6f7fe640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:39.943+0000 7f0e6f7fe640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.115+0000 7f0e7d56c640 10 start_mon_command cmd=[{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:36:40.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.115+0000 7f0e7d56c640 10 monclient: _send_command 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:36:40.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.115+0000 7f0e7d56c640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:40.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.115+0000 7f0e7d56c640 1 -- 172.21.15.81:0/1700743616 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e5c005380 con 0x7f0e780a0a90 2024-09-10T16:36:40.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.115+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/1700743616 <== mon.4 v1:172.21.15.81:6791/0 10 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v324) ==== 74+0+10886 (unknown 3416541790 0 310452004) 0x7f0e60016a90 con 0x7f0e780a0a90 2024-09-10T16:36:40.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.115+0000 7f0e6f7fe640 10 monclient: handle_mon_command_ack 2 [{"prefix": "osd dump", "format": "json"}] 2024-09-10T16:36:40.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.115+0000 7f0e6f7fe640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:36:40.119 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:36:40.119 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":324,"fsid":"9dc0ccd6-5839-4e7c-a06b-dacc65254ee8","created":"2024-09-10T16:29:55.164545+0000","modified":"2024-09-10T16:36:35.900961+0000","last_up_change":"2024-09-10T16:30:08.199951+0000","last_in_change":"2024-09-10T16:29:57.004838+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":100,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-10T16:30:08.333238+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":6.059999942779541,"score_stable":6.059999942779541,"optimal_score":0.33000001311302185,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-10T16:30:12.247126+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":20,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"c68b183d-5af0-4465-bf0b-1b1410e7a5c3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6808","nonce":1659450435}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6809","nonce":1659450435}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6811","nonce":1659450435}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6810","nonce":1659450435}]},"public_addr":"172.21.15.81:6808/1659450435","cluster_addr":"172.21.15.81:6809/1659450435","heartbeat_back_addr":"172.21.15.81:6811/1659450435","heartbeat_front_addr":"172.21.15.81:6810/1659450435","state":["exists","up"]},{"osd":1,"uuid":"b0e4a6b2-56e9-4f68-8dc0-998d3dec5bc9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6800","nonce":4086249229}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6801","nonce":4086249229}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6803","nonce":4086249229}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6802","nonce":4086249229}]},"public_addr":"172.21.15.81:6800/4086249229","cluster_addr":"172.21.15.81:6801/4086249229","heartbeat_back_addr":"172.21.15.81:6803/4086249229","heartbeat_front_addr":"172.21.15.81:6802/4086249229","state":["exists","up"]},{"osd":2,"uuid":"8021ac53-8498-4069-92a8-a6477fab55b2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6804","nonce":2595021275}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6805","nonce":2595021275}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6807","nonce":2595021275}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.81:6806","nonce":2595021275}]},"public_addr":"172.21.15.81:6804/2595021275","cluster_addr":"172.21.15.81:6805/2595021275","heartbeat_back_addr":"172.21.15.81:6807/2595021275","heartbeat_front_addr":"172.21.15.81:6806/2595021275","state":["exists","up"]},{"osd":3,"uuid":"c098399b-faef-460a-b448-a1c4ba227a5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6804","nonce":3461775318}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6805","nonce":3461775318}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6807","nonce":3461775318}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6806","nonce":3461775318}]},"public_addr":"172.21.15.189:6804/3461775318","cluster_addr":"172.21.15.189:6805/3461775318","heartbeat_back_addr":"172.21.15.189:6807/3461775318","heartbeat_front_addr":"172.21.15.189:6806/3461775318","state":["exists","up"]},{"osd":4,"uuid":"f9ea0631-7d1d-4b3a-9806-684dfc66c44e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6808","nonce":1206180154}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6809","nonce":1206180154}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6811","nonce":1206180154}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6810","nonce":1206180154}]},"public_addr":"172.21.15.189:6808/1206180154","cluster_addr":"172.21.15.189:6809/1206180154","heartbeat_back_addr":"172.21.15.189:6811/1206180154","heartbeat_front_addr":"172.21.15.189:6810/1206180154","state":["exists","up"]},{"osd":5,"uuid":"e32e3250-fe69-4ef0-8553-974e89bf80e3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":322,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6800","nonce":1814191784}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6801","nonce":1814191784}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6803","nonce":1814191784}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.189:6802","nonce":1814191784}]},"public_addr":"172.21.15.189:6800/1814191784","cluster_addr":"172.21.15.189:6801/1814191784","heartbeat_back_addr":"172.21.15.189:6803/1814191784","heartbeat_front_addr":"172.21.15.189:6802/1814191784","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.542123+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.718470+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.484310+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.507370+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.609326+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-10T16:30:03.643721+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-10T16:36:40.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.119+0000 7f0e7d56c640 1 -- 172.21.15.81:0/1700743616 >> v1:172.21.15.189:6812/1108603242 conn(0x7f0e5803d040 legacy=0x7f0e5803f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:40.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.119+0000 7f0e7d56c640 10 monclient: shutdown 2024-09-10T16:36:40.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.119+0000 7f0e7d56c640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:40.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.119+0000 7f0e7d56c640 1 -- 172.21.15.81:0/1700743616 >> v1:172.21.15.81:6791/0 conn(0x7f0e780a0a90 legacy=0x7f0e781b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:40.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.119+0000 7f0e7d56c640 1 -- 172.21.15.81:0/1700743616 shutdown_connections 2024-09-10T16:36:40.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.119+0000 7f0e7d56c640 1 -- 172.21.15.81:0/1700743616 >> 172.21.15.81:0/1700743616 conn(0x7f0e780a3fd0 msgr2=0x7f0e780a5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:40.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.119+0000 7f0e7d56c640 1 -- 172.21.15.81:0/1700743616 shutdown_connections 2024-09-10T16:36:40.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:40.119+0000 7f0e7d56c640 1 -- 172.21.15.81:0/1700743616 wait complete. 2024-09-10T16:36:41.138 INFO:tasks.ceph:Scrubbing osd.0 2024-09-10T16:36:41.139 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-10T16:36:41.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient: get_monmap_and_config 2024-09-10T16:36:41.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient: build_initial_monmap 2024-09-10T16:36:41.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient: monmap: 2024-09-10T16:36:41.281 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:41.281 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.281 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:41.282575+0000 2024-09-10T16:36:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:41.282575+0000 2024-09-10T16:36:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:41.282 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:41.283 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 1 Processor -- start 2024-09-10T16:36:41.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 1 -- start start 2024-09-10T16:36:41.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient: init 2024-09-10T16:36:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient: _add_conns ranks=[1,8,0,3,7,2,5,6,4] 2024-09-10T16:36:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient(hunting): picked mon.noname-f con 0x7fc3b80a1440 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient(hunting): picked mon.noname-e con 0x7fc3b80a0bc0 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient(hunting): picked mon.noname-a con 0x7fc3b80a1820 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b80a3e00 con 0x7fc3b80a1820 2024-09-10T16:36:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b809b090 con 0x7fc3b80a1440 2024-09-10T16:36:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b809e540 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient(hunting): authenticate will time out at 1368.681766s 2024-09-10T16:36:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3bc900640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc3b80a1820 0x7fc3b813f790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37404/0 (socket says 172.21.15.81:37404) 2024-09-10T16:36:41.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3bc900640 1 -- 172.21.15.81:0/4013293021 learned_addr learned my addr 172.21.15.81:0/4013293021 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 1 -- 172.21.15.81:0/4013293021 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1385171972 0 0) 0x7fc3b80a3e00 con 0x7fc3b80a1820 2024-09-10T16:36:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient(hunting): my global_id is 6561 2024-09-10T16:36:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 1 -- 172.21.15.81:0/4013293021 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3a0003530 con 0x7fc3b80a1820 2024-09-10T16:36:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 1 -- 172.21.15.81:0/4013293021 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2872066046 0 0) 0x7fc3b809e540 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient(hunting): my global_id is 6668 2024-09-10T16:36:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 1 -- 172.21.15.81:0/4013293021 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3b80a3e00 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 1 -- 172.21.15.81:0/4013293021 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 963518836 0 0) 0x7fc3a0003530 con 0x7fc3b80a1820 2024-09-10T16:36:41.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 1 -- 172.21.15.81:0/4013293021 >> v1:172.21.15.81:6793/0 conn(0x7fc3b80a0bc0 legacy=0x7fc3b80a36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 1 -- 172.21.15.81:0/4013293021 >> v1:172.21.15.189:6789/0 conn(0x7fc3b80a1440 legacy=0x7fc3b80a2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:36:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 1 monclient: found mon.noname-a 2024-09-10T16:36:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:36:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 1 -- 172.21.15.81:0/4013293021 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b809e0c0 con 0x7fc3b80a1820 2024-09-10T16:36:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient: _finish_auth 0 2024-09-10T16:36:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:36:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 5 monclient: authenticate success, global_id 6561 2024-09-10T16:36:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 1 -- 172.21.15.81:0/4013293021 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fc3b0001bc0 con 0x7fc3b80a1820 2024-09-10T16:36:41.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:36:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient: dump: 2024-09-10T16:36:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.292 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.293 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 1 -- 172.21.15.81:0/4013293021 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3b0001d60 con 0x7fc3b80a1820 2024-09-10T16:36:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 4 set_mon_vals no callback set 2024-09-10T16:36:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 1 -- 172.21.15.81:0/4013293021 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fc3b0004f70 con 0x7fc3b80a1820 2024-09-10T16:36:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:41.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3b6ffd640 10 monclient: dump: 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.294 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient: shutdown 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 1 -- 172.21.15.81:0/4013293021 >> v1:172.21.15.81:6789/0 conn(0x7fc3b80a1820 legacy=0x7fc3b813f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 1 -- 172.21.15.81:0/4013293021 shutdown_connections 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 1 -- 172.21.15.81:0/4013293021 >> 172.21.15.81:0/4013293021 conn(0x7fc3b80a40d0 msgr2=0x7fc3b80a44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 1 -- 172.21.15.81:0/4013293021 shutdown_connections 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 1 -- 172.21.15.81:0/4013293021 wait complete. 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient: build_initial_monmap 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.279+0000 7fc3be363640 10 monclient: monmap: 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:41.295 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:41.296 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:41.296 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:41.296 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:41.296 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:41.296 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:41.296 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:41.296 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:41.296 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:41.296 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:41.296 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:41.296 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 1 Processor -- start 2024-09-10T16:36:41.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 1 -- start start 2024-09-10T16:36:41.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 10 monclient: init 2024-09-10T16:36:41.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:41.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 10 monclient: _add_conns ranks=[4,5,1,2,8,3,6,0,7] 2024-09-10T16:36:41.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 10 monclient(hunting): picked mon.noname-c con 0x7fc3b80a0bc0 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:41.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 10 monclient(hunting): picked mon.noname-h con 0x7fc3b80a1440 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:41.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 10 monclient(hunting): picked mon.noname-f con 0x7fc3b80a1820 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:41.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b81b7d10 con 0x7fc3b80a1820 2024-09-10T16:36:41.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b81cc5d0 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc3b81b6a80 con 0x7fc3b80a1440 2024-09-10T16:36:41.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:41.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 10 monclient(hunting): authenticate will time out at 1368.684841s 2024-09-10T16:36:41.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b7fff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fc3b80a0bc0 0x7fc3b81cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:49196/0 (socket says 172.21.15.81:49196) 2024-09-10T16:36:41.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b7fff640 1 -- 172.21.15.81:0/1898643357 learned_addr learned my addr 172.21.15.81:0/1898643357 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:41.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3607976905 0 0) 0x7fc3b81cc5d0 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient(hunting): my global_id is 144868 2024-09-10T16:36:41.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc3a4003530 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3969324076 0 0) 0x7fc3a4003530 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc3b81cc5d0 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fc3a8001be0 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:36:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient(hunting): dump: 2024-09-10T16:36:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.300 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.301 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1177724950 0 0) 0x7fc3b81cc5d0 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 >> v1:172.21.15.189:6791/0 conn(0x7fc3b80a1440 legacy=0x7fc3b81cbec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 >> v1:172.21.15.189:6789/0 conn(0x7fc3b80a1820 legacy=0x7fc3b81d3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:36:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 monclient: found mon.c 2024-09-10T16:36:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:41.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3b81b7050 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient: _finish_auth 0 2024-09-10T16:36:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:36:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 5 monclient: authenticate success, global_id 144868 2024-09-10T16:36:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 10 monclient: _renew_subs 2024-09-10T16:36:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 1 -- 172.21.15.81:0/1898643357 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc3b81b7330 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 10 monclient: _renew_subs 2024-09-10T16:36:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 1 -- 172.21.15.81:0/1898643357 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fc3b81b55f0 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc3a80038d0 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fc3a8003e40 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b67fc640 4 set_mon_vals no callback set 2024-09-10T16:36:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient: dump: 2024-09-10T16:36:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.304 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.304 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.304 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.304 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.304 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:41.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3be363640 1 -- 172.21.15.81:0/1898643357 --> v1:172.21.15.81:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc398000f90 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fc3a8003fe0 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7fc3a804ae80 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 --> v1:172.21.15.81:6808/1659450435 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc3a40477c0 con 0x7fc3a4043b50 2024-09-10T16:36:41.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_get_version_reply(handle=1 version=325) ==== 24+0+0 (unknown 690020996 0 0) 0x7fc3a804b2e0 con 0x7fc3b80a0bc0 2024-09-10T16:36:41.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b4ff9640 10 monclient: handle_get_version_reply finishing 1 version 325 2024-09-10T16:36:41.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3b77fe640 10 monclient: get_auth_request con 0x7fc3a403d010 auth_method 0 2024-09-10T16:36:41.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.283+0000 7fc3bc900640 10 monclient: get_auth_request con 0x7fc3a4043b50 auth_method 0 2024-09-10T16:36:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.287+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 <== osd.0 v1:172.21.15.81:6808/1659450435 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fc3a40477c0 con 0x7fc3a4043b50 2024-09-10T16:36:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.299+0000 7fc3be363640 1 -- 172.21.15.81:0/1898643357 --> v1:172.21.15.81:6808/1659450435 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc398002ce0 con 0x7fc3a4043b50 2024-09-10T16:36:41.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.299+0000 7fc3b4ff9640 1 -- 172.21.15.81:0/1898643357 <== osd.0 v1:172.21.15.81:6808/1659450435 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fc398002ce0 con 0x7fc3a4043b50 2024-09-10T16:36:41.306 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:41.306 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T16:36:41.306 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:41.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.299+0000 7fc3be363640 1 -- 172.21.15.81:0/1898643357 >> v1:172.21.15.81:6808/1659450435 conn(0x7fc3a4043b50 legacy=0x7fc3a4045f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.299+0000 7fc3be363640 1 -- 172.21.15.81:0/1898643357 >> v1:172.21.15.189:6812/1108603242 conn(0x7fc3a403d010 legacy=0x7fc3a403f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.299+0000 7fc3be363640 10 monclient: shutdown 2024-09-10T16:36:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.299+0000 7fc3be363640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.299+0000 7fc3be363640 1 -- 172.21.15.81:0/1898643357 >> v1:172.21.15.81:6791/0 conn(0x7fc3b80a0bc0 legacy=0x7fc3b81cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.299+0000 7fc3bc900640 1 -- 172.21.15.81:0/1898643357 reap_dead start 2024-09-10T16:36:41.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.299+0000 7fc3be363640 1 -- 172.21.15.81:0/1898643357 shutdown_connections 2024-09-10T16:36:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.299+0000 7fc3be363640 1 -- 172.21.15.81:0/1898643357 >> 172.21.15.81:0/1898643357 conn(0x7fc3b80a40d0 msgr2=0x7fc3b81bcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.299+0000 7fc3be363640 1 -- 172.21.15.81:0/1898643357 shutdown_connections 2024-09-10T16:36:41.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.299+0000 7fc3be363640 1 -- 172.21.15.81:0/1898643357 wait complete. 2024-09-10T16:36:41.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-10T16:36:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.423+0000 7f413df4e640 10 monclient: get_monmap_and_config 2024-09-10T16:36:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.423+0000 7f413df4e640 10 monclient: build_initial_monmap 2024-09-10T16:36:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.423+0000 7f413df4e640 10 monclient: monmap: 2024-09-10T16:36:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:41.429773+0000 2024-09-10T16:36:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:41.429773+0000 2024-09-10T16:36:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:41.428 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:41.429 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:41.429 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 1 Processor -- start 2024-09-10T16:36:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 1 -- start start 2024-09-10T16:36:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 10 monclient: init 2024-09-10T16:36:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 10 monclient: _add_conns ranks=[2,8,6,0,1,7,4,3,5] 2024-09-10T16:36:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 10 monclient(hunting): picked mon.noname-b con 0x7f41380a0a90 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 10 monclient(hunting): picked mon.noname-e con 0x7f41380a35f0 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 10 monclient(hunting): picked mon.noname-d con 0x7f41380a3a40 addr v1:172.21.15.81:6792/0 2024-09-10T16:36:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f413809df70 con 0x7f41380a0a90 2024-09-10T16:36:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f413809fa30 con 0x7f41380a3a40 2024-09-10T16:36:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f413809fd10 con 0x7f41380a35f0 2024-09-10T16:36:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 10 monclient(hunting): authenticate will time out at 1368.829034s 2024-09-10T16:36:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f4137fff640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f41380a3a40 0x7f413813fda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:40226/0 (socket says 172.21.15.81:40226) 2024-09-10T16:36:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f4137fff640 1 -- 172.21.15.81:0/4093341417 learned_addr learned my addr 172.21.15.81:0/4093341417 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41377fe640 1 --1- 172.21.15.81:0/4093341417 >> v1:172.21.15.81:6790/0 conn(0x7f41380a0a90 0x7f41380a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34258/0 (socket says 172.21.15.81:34258) 2024-09-10T16:36:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 1 -- 172.21.15.81:0/4093341417 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2368560562 0 0) 0x7f413809df70 con 0x7f41380a0a90 2024-09-10T16:36:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient(hunting): my global_id is 144992 2024-09-10T16:36:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 1 -- 172.21.15.81:0/4093341417 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4120003530 con 0x7f41380a0a90 2024-09-10T16:36:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 1 -- 172.21.15.81:0/4093341417 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1625969383 0 0) 0x7f413809fa30 con 0x7f41380a3a40 2024-09-10T16:36:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient(hunting): my global_id is 144816 2024-09-10T16:36:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 1 -- 172.21.15.81:0/4093341417 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f413809df70 con 0x7f41380a3a40 2024-09-10T16:36:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 1 -- 172.21.15.81:0/4093341417 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1995808568 0 0) 0x7f413809fd10 con 0x7f41380a35f0 2024-09-10T16:36:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient(hunting): my global_id is 6677 2024-09-10T16:36:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 1 -- 172.21.15.81:0/4093341417 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f413809fa30 con 0x7f41380a35f0 2024-09-10T16:36:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 1 -- 172.21.15.81:0/4093341417 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2100088737 0 0) 0x7f413809fa30 con 0x7f41380a35f0 2024-09-10T16:36:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 1 -- 172.21.15.81:0/4093341417 >> v1:172.21.15.81:6792/0 conn(0x7f41380a3a40 legacy=0x7f413813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 1 -- 172.21.15.81:0/4093341417 >> v1:172.21.15.81:6790/0 conn(0x7f41380a0a90 legacy=0x7f41380a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient: _finish_hunting 0 2024-09-10T16:36:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 1 monclient: found mon.noname-e 2024-09-10T16:36:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:36:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 1 -- 172.21.15.81:0/4093341417 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413809fff0 con 0x7f41380a35f0 2024-09-10T16:36:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient: _finish_auth 0 2024-09-10T16:36:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient: _check_auth_tickets 2024-09-10T16:36:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 1 -- 172.21.15.81:0/4093341417 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f412c001760 con 0x7f41380a35f0 2024-09-10T16:36:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:36:41.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient: dump: 2024-09-10T16:36:41.441 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.441 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.441 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.441 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.441 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.441 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.441 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.441 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.441 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.441 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.442 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.442 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.442 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.442 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.442 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.442 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 5 monclient: authenticate success, global_id 6677 2024-09-10T16:36:41.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:41.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 1 -- 172.21.15.81:0/4093341417 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f412c001900 con 0x7f41380a35f0 2024-09-10T16:36:41.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:41.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 1 -- 172.21.15.81:0/4093341417 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f412c001bf0 con 0x7f41380a35f0 2024-09-10T16:36:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f41367fc640 10 monclient: dump: 2024-09-10T16:36:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.443 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.444 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 4 set_mon_vals no callback set 2024-09-10T16:36:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 10 monclient: shutdown 2024-09-10T16:36:41.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 1 -- 172.21.15.81:0/4093341417 >> v1:172.21.15.81:6793/0 conn(0x7f41380a35f0 legacy=0x7f413813c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 1 -- 172.21.15.81:0/4093341417 shutdown_connections 2024-09-10T16:36:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 1 -- 172.21.15.81:0/4093341417 >> 172.21.15.81:0/4093341417 conn(0x7f41380a3fd0 msgr2=0x7f41380a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 1 -- 172.21.15.81:0/4093341417 shutdown_connections 2024-09-10T16:36:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 1 -- 172.21.15.81:0/4093341417 wait complete. 2024-09-10T16:36:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 10 monclient: build_initial_monmap 2024-09-10T16:36:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 10 monclient: monmap: 2024-09-10T16:36:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:41.445 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:41.446 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:41.446 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 1 Processor -- start 2024-09-10T16:36:41.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 1 -- start start 2024-09-10T16:36:41.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.427+0000 7f413df4e640 10 monclient: init 2024-09-10T16:36:41.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:41.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 10 monclient: _add_conns ranks=[2,0,1,8,5,4,6,3,7] 2024-09-10T16:36:41.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 10 monclient(hunting): picked mon.noname-b con 0x7f41380a0a90 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:41.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 10 monclient(hunting): picked mon.noname-a con 0x7f41380a35f0 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:41.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 10 monclient(hunting): picked mon.noname-f con 0x7f41380a3a40 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:41.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f413809d4a0 con 0x7f41380a35f0 2024-09-10T16:36:41.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41380a6820 con 0x7f41380a3a40 2024-09-10T16:36:41.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41381b6990 con 0x7f41380a0a90 2024-09-10T16:36:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 10 monclient(hunting): authenticate will time out at 1368.832278s 2024-09-10T16:36:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f41377fe640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f41380a0a90 0x7f41381cda50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34274/0 (socket says 172.21.15.81:34274) 2024-09-10T16:36:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f41377fe640 1 -- 172.21.15.81:0/4107017445 learned_addr learned my addr 172.21.15.81:0/4107017445 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1533126000 0 0) 0x7f41381b6990 con 0x7f41380a0a90 2024-09-10T16:36:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): my global_id is 145001 2024-09-10T16:36:41.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4124003530 con 0x7f41380a0a90 2024-09-10T16:36:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2269257153 0 0) 0x7f413809d4a0 con 0x7f41380a35f0 2024-09-10T16:36:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): my global_id is 6570 2024-09-10T16:36:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41381b6990 con 0x7f41380a35f0 2024-09-10T16:36:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2596154507 0 0) 0x7f41381b6990 con 0x7f41380a35f0 2024-09-10T16:36:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f413809d4a0 con 0x7f41380a35f0 2024-09-10T16:36:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2259612604 0 0) 0x7f4124003530 con 0x7f41380a0a90 2024-09-10T16:36:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f41381b6990 con 0x7f41380a0a90 2024-09-10T16:36:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f412c001af0 con 0x7f41380a35f0 2024-09-10T16:36:41.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:36:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): dump: 2024-09-10T16:36:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.450 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.451 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4128001580 con 0x7f41380a0a90 2024-09-10T16:36:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:41.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): dump: 2024-09-10T16:36:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.452 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.453 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3909124279 0 0) 0x7f41380a6820 con 0x7f41380a3a40 2024-09-10T16:36:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient(hunting): my global_id is 164242 2024-09-10T16:36:41.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4124003530 con 0x7f41380a3a40 2024-09-10T16:36:41.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2569009206 0 0) 0x7f413809d4a0 con 0x7f41380a35f0 2024-09-10T16:36:41.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 >> v1:172.21.15.81:6790/0 conn(0x7f41380a0a90 legacy=0x7f41381cda50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 >> v1:172.21.15.189:6789/0 conn(0x7f41380a3a40 legacy=0x7f41381d6550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient: _finish_hunting 0 2024-09-10T16:36:41.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 monclient: found mon.a 2024-09-10T16:36:41.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:41.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:41.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f413809d1f0 con 0x7f41380a35f0 2024-09-10T16:36:41.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient: _finish_auth 0 2024-09-10T16:36:41.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient: _check_auth_tickets 2024-09-10T16:36:41.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:41.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 5 monclient: authenticate success, global_id 6570 2024-09-10T16:36:41.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 10 monclient: _renew_subs 2024-09-10T16:36:41.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:41.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 1 -- 172.21.15.81:0/4107017445 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f41381bb1a0 con 0x7f41380a35f0 2024-09-10T16:36:41.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f412c003bf0 con 0x7f41380a35f0 2024-09-10T16:36:41.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:41.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f412c0040e0 con 0x7f41380a35f0 2024-09-10T16:36:41.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:41.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f4135ffb640 4 set_mon_vals no callback set 2024-09-10T16:36:41.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:41.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 10 monclient: dump: 2024-09-10T16:36:41.456 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.456 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.456 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.456 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.456 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.456 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.456 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.456 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.456 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.456 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.456 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.457 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.457 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.457 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.457 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.457 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 10 monclient: _renew_subs 2024-09-10T16:36:41.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:41.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 1 -- 172.21.15.81:0/4107017445 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f413809c6b0 con 0x7f41380a35f0 2024-09-10T16:36:41.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f412c00fff0 con 0x7f41380a35f0 2024-09-10T16:36:41.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:41.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:41.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:41.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f413df4e640 1 -- 172.21.15.81:0/4107017445 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41380a6b50 con 0x7f41380a35f0 2024-09-10T16:36:41.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7f412c049b60 con 0x7f41380a35f0 2024-09-10T16:36:41.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.431+0000 7f41377fe640 10 monclient: get_auth_request con 0x7f412403d7a0 auth_method 0 2024-09-10T16:36:41.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.435+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f412c015a20 con 0x7f41380a35f0 2024-09-10T16:36:41.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.435+0000 7f411ffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:41.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.435+0000 7f411ffff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:41.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.607+0000 7f413df4e640 1 -- 172.21.15.81:0/4107017445 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f413809cde0 con 0x7f412403d7a0 2024-09-10T16:36:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.607+0000 7f411ffff640 1 -- 172.21.15.81:0/4107017445 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (unknown 2057319476 0 0) 0x7f413809cde0 con 0x7f412403d7a0 2024-09-10T16:36:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2024-09-10T16:36:41.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.611+0000 7f413df4e640 1 -- 172.21.15.81:0/4107017445 >> v1:172.21.15.189:6812/1108603242 conn(0x7f412403d7a0 legacy=0x7f412403fc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.611+0000 7f413df4e640 10 monclient: shutdown 2024-09-10T16:36:41.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.611+0000 7f413df4e640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:41.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.611+0000 7f413df4e640 1 -- 172.21.15.81:0/4107017445 >> v1:172.21.15.81:6789/0 conn(0x7f41380a35f0 legacy=0x7f41381d2e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.611+0000 7f413df4e640 1 -- 172.21.15.81:0/4107017445 shutdown_connections 2024-09-10T16:36:41.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.611+0000 7f413df4e640 1 -- 172.21.15.81:0/4107017445 >> 172.21.15.81:0/4107017445 conn(0x7f41380a3fd0 msgr2=0x7f41381bde00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:41.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.611+0000 7f413df4e640 1 -- 172.21.15.81:0/4107017445 shutdown_connections 2024-09-10T16:36:41.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.611+0000 7f413df4e640 1 -- 172.21.15.81:0/4107017445 wait complete. 2024-09-10T16:36:41.628 INFO:tasks.ceph:Scrubbing osd.1 2024-09-10T16:36:41.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-10T16:36:41.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 10 monclient: get_monmap_and_config 2024-09-10T16:36:41.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 10 monclient: build_initial_monmap 2024-09-10T16:36:41.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 10 monclient: monmap: 2024-09-10T16:36:41.757 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:41.757 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.757 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:41.758475+0000 2024-09-10T16:36:41.757 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:41.758475+0000 2024-09-10T16:36:41.757 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:41.757 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.757 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:41.757 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:41.758 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:41.758 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 1 Processor -- start 2024-09-10T16:36:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 1 -- start start 2024-09-10T16:36:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 10 monclient: init 2024-09-10T16:36:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 10 monclient: _add_conns ranks=[8,7,2,4,3,5,6,1,0] 2024-09-10T16:36:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 10 monclient(hunting): picked mon.noname-e con 0x7fc46009dc40 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:41.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 10 monclient(hunting): picked mon.noname-i con 0x7fc460135c50 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 10 monclient(hunting): picked mon.noname-b con 0x7fc4601360c0 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46009be70 con 0x7fc4601360c0 2024-09-10T16:36:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46009c150 con 0x7fc460135c50 2024-09-10T16:36:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46009c430 con 0x7fc46009dc40 2024-09-10T16:36:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 10 monclient(hunting): authenticate will time out at 1369.157823s 2024-09-10T16:36:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc465408640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fc4601360c0 0x7fc460141760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34282/0 (socket says 172.21.15.81:34282) 2024-09-10T16:36:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc465408640 1 -- 172.21.15.81:0/2410079168 learned_addr learned my addr 172.21.15.81:0/2410079168 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 1 -- 172.21.15.81:0/2410079168 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 829429653 0 0) 0x7fc46009c430 con 0x7fc46009dc40 2024-09-10T16:36:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient(hunting): my global_id is 6686 2024-09-10T16:36:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 1 -- 172.21.15.81:0/2410079168 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc44c003530 con 0x7fc46009dc40 2024-09-10T16:36:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 1 -- 172.21.15.81:0/2410079168 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1896129799 0 0) 0x7fc46009be70 con 0x7fc4601360c0 2024-09-10T16:36:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient(hunting): my global_id is 145010 2024-09-10T16:36:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 1 -- 172.21.15.81:0/2410079168 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc46009c430 con 0x7fc4601360c0 2024-09-10T16:36:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 1 -- 172.21.15.81:0/2410079168 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 77367888 0 0) 0x7fc44c003530 con 0x7fc46009dc40 2024-09-10T16:36:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 1 -- 172.21.15.81:0/2410079168 >> v1:172.21.15.189:6792/0 conn(0x7fc460135c50 legacy=0x7fc46013e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 1 -- 172.21.15.81:0/2410079168 >> v1:172.21.15.81:6790/0 conn(0x7fc4601360c0 legacy=0x7fc460141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:36:41.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 1 monclient: found mon.noname-e 2024-09-10T16:36:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:36:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 1 -- 172.21.15.81:0/2410079168 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4600a3240 con 0x7fc46009dc40 2024-09-10T16:36:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient: _finish_auth 0 2024-09-10T16:36:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:36:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 1 -- 172.21.15.81:0/2410079168 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fc450001840 con 0x7fc46009dc40 2024-09-10T16:36:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:36:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient: dump: 2024-09-10T16:36:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.768 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.769 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.770 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 5 monclient: authenticate success, global_id 6686 2024-09-10T16:36:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 1 -- 172.21.15.81:0/2410079168 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc450001a60 con 0x7fc46009dc40 2024-09-10T16:36:41.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 1 -- 172.21.15.81:0/2410079168 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fc450001d50 con 0x7fc46009dc40 2024-09-10T16:36:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 4 set_mon_vals no callback set 2024-09-10T16:36:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc45f7fe640 10 monclient: dump: 2024-09-10T16:36:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.771 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.772 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 10 monclient: shutdown 2024-09-10T16:36:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 1 -- 172.21.15.81:0/2410079168 >> v1:172.21.15.81:6793/0 conn(0x7fc46009dc40 legacy=0x7fc46009e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 1 -- 172.21.15.81:0/2410079168 shutdown_connections 2024-09-10T16:36:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 1 -- 172.21.15.81:0/2410079168 >> 172.21.15.81:0/2410079168 conn(0x7fc4600a40d0 msgr2=0x7fc4600a44e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 1 -- 172.21.15.81:0/2410079168 shutdown_connections 2024-09-10T16:36:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.755+0000 7fc466e6b640 1 -- 172.21.15.81:0/2410079168 wait complete. 2024-09-10T16:36:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient: build_initial_monmap 2024-09-10T16:36:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient: monmap: 2024-09-10T16:36:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:41.773 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:41.774 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 1 Processor -- start 2024-09-10T16:36:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 1 -- start start 2024-09-10T16:36:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient: init 2024-09-10T16:36:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient: _add_conns ranks=[3,6,0,4,7,8,2,1,5] 2024-09-10T16:36:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient(hunting): picked mon.noname-g con 0x7fc46009dc40 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:41.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient(hunting): picked mon.noname-d con 0x7fc460135c50 addr v1:172.21.15.81:6792/0 2024-09-10T16:36:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient(hunting): picked mon.noname-a con 0x7fc4601360c0 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc460091510 con 0x7fc4601360c0 2024-09-10T16:36:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4600a57f0 con 0x7fc46009dc40 2024-09-10T16:36:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc46009d700 con 0x7fc460135c50 2024-09-10T16:36:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient(hunting): authenticate will time out at 1369.160934s 2024-09-10T16:36:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc465408640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7fc4601360c0 0x7fc46008f1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37410/0 (socket says 172.21.15.81:37410) 2024-09-10T16:36:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45ffff640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fc460135c50 0x7fc46008eaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:40236/0 (socket says 172.21.15.81:40236) 2024-09-10T16:36:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc465408640 1 -- 172.21.15.81:0/1543065101 learned_addr learned my addr 172.21.15.81:0/1543065101 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 972554970 0 0) 0x7fc46009c150 con 0x7fc460135c50 2024-09-10T16:36:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): my global_id is 144825 2024-09-10T16:36:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc440003530 con 0x7fc460135c50 2024-09-10T16:36:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2361705326 0 0) 0x7fc460091510 con 0x7fc4601360c0 2024-09-10T16:36:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): my global_id is 6579 2024-09-10T16:36:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc46009c150 con 0x7fc4601360c0 2024-09-10T16:36:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3269005851 0 0) 0x7fc440003530 con 0x7fc460135c50 2024-09-10T16:36:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc460091510 con 0x7fc460135c50 2024-09-10T16:36:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fc448001b20 con 0x7fc460135c50 2024-09-10T16:36:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:36:41.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): dump: 2024-09-10T16:36:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.777 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.778 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3921566455 0 0) 0x7fc46009c150 con 0x7fc4601360c0 2024-09-10T16:36:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fc440003530 con 0x7fc4601360c0 2024-09-10T16:36:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fc4580017c0 con 0x7fc4601360c0 2024-09-10T16:36:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): dump: 2024-09-10T16:36:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.778 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.779 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.779 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2311757060 0 0) 0x7fc4600a3240 con 0x7fc46009dc40 2024-09-10T16:36:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient(hunting): my global_id is 164217 2024-09-10T16:36:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc46009c150 con 0x7fc46009dc40 2024-09-10T16:36:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3750569615 0 0) 0x7fc460091510 con 0x7fc460135c50 2024-09-10T16:36:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 >> v1:172.21.15.189:6790/0 conn(0x7fc46009dc40 legacy=0x7fc46008e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 >> v1:172.21.15.81:6789/0 conn(0x7fc4601360c0 legacy=0x7fc46008f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient: _finish_hunting 0 2024-09-10T16:36:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 monclient: found mon.d 2024-09-10T16:36:41.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc460091d70 con 0x7fc460135c50 2024-09-10T16:36:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient: _finish_auth 0 2024-09-10T16:36:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient: _check_auth_tickets 2024-09-10T16:36:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 5 monclient: authenticate success, global_id 144825 2024-09-10T16:36:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient: _renew_subs 2024-09-10T16:36:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 1 -- 172.21.15.81:0/1543065101 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fc4600908f0 con 0x7fc460135c50 2024-09-10T16:36:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient: _renew_subs 2024-09-10T16:36:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 1 -- 172.21.15.81:0/1543065101 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7fc46008fd30 con 0x7fc460135c50 2024-09-10T16:36:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fc4480038d0 con 0x7fc460135c50 2024-09-10T16:36:41.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fc448003e80 con 0x7fc460135c50 2024-09-10T16:36:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:36:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient: dump: 2024-09-10T16:36:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.782 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.783 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45effd640 4 set_mon_vals no callback set 2024-09-10T16:36:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:36:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc466e6b640 1 -- 172.21.15.81:0/1543065101 --> v1:172.21.15.81:6792/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fc460094a40 con 0x7fc460135c50 2024-09-10T16:36:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fc4480040a0 con 0x7fc460135c50 2024-09-10T16:36:41.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7fc44804add0 con 0x7fc460135c50 2024-09-10T16:36:41.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 --> v1:172.21.15.81:6800/4086249229 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc440047f50 con 0x7fc4400442e0 2024-09-10T16:36:41.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== mon.6 v1:172.21.15.81:6792/0 9 ==== mon_get_version_reply(handle=1 version=325) ==== 24+0+0 (unknown 690020996 0 0) 0x7fc44804b1d0 con 0x7fc460135c50 2024-09-10T16:36:41.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc45d7fa640 10 monclient: handle_get_version_reply finishing 1 version 325 2024-09-10T16:36:41.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc465408640 10 monclient: get_auth_request con 0x7fc4400442e0 auth_method 0 2024-09-10T16:36:41.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.759+0000 7fc464c07640 10 monclient: get_auth_request con 0x7fc44003d700 auth_method 0 2024-09-10T16:36:41.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.763+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== osd.1 v1:172.21.15.81:6800/4086249229 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fc440047f50 con 0x7fc4400442e0 2024-09-10T16:36:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.775+0000 7fc466e6b640 1 -- 172.21.15.81:0/1543065101 --> v1:172.21.15.81:6800/4086249229 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc460094e40 con 0x7fc4400442e0 2024-09-10T16:36:41.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.775+0000 7fc45d7fa640 1 -- 172.21.15.81:0/1543065101 <== osd.1 v1:172.21.15.81:6800/4086249229 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fc460094e40 con 0x7fc4400442e0 2024-09-10T16:36:41.785 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:41.785 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T16:36:41.785 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:41.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.775+0000 7fc466e6b640 1 -- 172.21.15.81:0/1543065101 >> v1:172.21.15.81:6800/4086249229 conn(0x7fc4400442e0 legacy=0x7fc440046700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.775+0000 7fc466e6b640 1 -- 172.21.15.81:0/1543065101 >> v1:172.21.15.189:6812/1108603242 conn(0x7fc44003d700 legacy=0x7fc44003fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.775+0000 7fc466e6b640 10 monclient: shutdown 2024-09-10T16:36:41.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.775+0000 7fc466e6b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:41.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.775+0000 7fc466e6b640 1 -- 172.21.15.81:0/1543065101 >> v1:172.21.15.81:6792/0 conn(0x7fc460135c50 legacy=0x7fc46008eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.775+0000 7fc465408640 1 -- 172.21.15.81:0/1543065101 reap_dead start 2024-09-10T16:36:41.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.775+0000 7fc466e6b640 1 -- 172.21.15.81:0/1543065101 shutdown_connections 2024-09-10T16:36:41.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.775+0000 7fc466e6b640 1 -- 172.21.15.81:0/1543065101 >> 172.21.15.81:0/1543065101 conn(0x7fc4600a40d0 msgr2=0x7fc460094330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:41.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.775+0000 7fc466e6b640 1 -- 172.21.15.81:0/1543065101 shutdown_connections 2024-09-10T16:36:41.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.775+0000 7fc466e6b640 1 -- 172.21.15.81:0/1543065101 wait complete. 2024-09-10T16:36:41.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-10T16:36:41.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 10 monclient: get_monmap_and_config 2024-09-10T16:36:41.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 10 monclient: build_initial_monmap 2024-09-10T16:36:41.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 10 monclient: monmap: 2024-09-10T16:36:41.905 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:41.905 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.905 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:41.906892+0000 2024-09-10T16:36:41.905 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:41.906892+0000 2024-09-10T16:36:41.905 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:41.905 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.905 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:41.906 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:41.906 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:41.906 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:41.906 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:41.906 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:41.906 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:41.906 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:41.906 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:41.906 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 1 Processor -- start 2024-09-10T16:36:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 1 -- start start 2024-09-10T16:36:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 10 monclient: init 2024-09-10T16:36:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 10 monclient: _add_conns ranks=[2,1,7,0,4,6,8,5,3] 2024-09-10T16:36:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 10 monclient(hunting): picked mon.noname-b con 0x7f4b0809ca10 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 10 monclient(hunting): picked mon.noname-f con 0x7f4b080a56e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 10 monclient(hunting): picked mon.noname-i con 0x7f4b080a5b00 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b081362b0 con 0x7f4b080a56e0 2024-09-10T16:36:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b080a80b0 con 0x7f4b0809ca10 2024-09-10T16:36:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b0809de70 con 0x7f4b080a5b00 2024-09-10T16:36:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:41.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 10 monclient(hunting): authenticate will time out at 1369.306311s 2024-09-10T16:36:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b06ffd640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f4b0809ca10 0x7f4b08135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34298/0 (socket says 172.21.15.81:34298) 2024-09-10T16:36:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b06ffd640 1 -- 172.21.15.81:0/43018665 learned_addr learned my addr 172.21.15.81:0/43018665 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 1 -- 172.21.15.81:0/43018665 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1887326462 0 0) 0x7f4b080a80b0 con 0x7f4b0809ca10 2024-09-10T16:36:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient(hunting): my global_id is 145019 2024-09-10T16:36:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 1 -- 172.21.15.81:0/43018665 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4af0003530 con 0x7f4b0809ca10 2024-09-10T16:36:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 1 -- 172.21.15.81:0/43018665 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2587890789 0 0) 0x7f4af0003530 con 0x7f4b0809ca10 2024-09-10T16:36:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 1 -- 172.21.15.81:0/43018665 >> v1:172.21.15.189:6792/0 conn(0x7f4b080a5b00 legacy=0x7f4b08141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 1 -- 172.21.15.81:0/43018665 >> v1:172.21.15.189:6789/0 conn(0x7f4b080a56e0 legacy=0x7f4b0813df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:36:41.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 1 monclient: found mon.noname-b 2024-09-10T16:36:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:36:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 1 -- 172.21.15.81:0/43018665 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0809e150 con 0x7f4b0809ca10 2024-09-10T16:36:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient: _finish_auth 0 2024-09-10T16:36:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:36:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 1 -- 172.21.15.81:0/43018665 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4af8001840 con 0x7f4b0809ca10 2024-09-10T16:36:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 5 monclient: authenticate success, global_id 145019 2024-09-10T16:36:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient: dump: 2024-09-10T16:36:41.914 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.915 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.916 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 1 -- 172.21.15.81:0/43018665 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4af8001a60 con 0x7f4b0809ca10 2024-09-10T16:36:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 1 -- 172.21.15.81:0/43018665 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4af8004bf0 con 0x7f4b0809ca10 2024-09-10T16:36:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b05ffb640 10 monclient: dump: 2024-09-10T16:36:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.916 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.917 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 4 set_mon_vals no callback set 2024-09-10T16:36:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 10 monclient: shutdown 2024-09-10T16:36:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/43018665 >> v1:172.21.15.81:6790/0 conn(0x7f4b0809ca10 legacy=0x7f4b08135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/43018665 shutdown_connections 2024-09-10T16:36:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/43018665 >> 172.21.15.81:0/43018665 conn(0x7f4b0806dc90 msgr2=0x7f4b080ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/43018665 shutdown_connections 2024-09-10T16:36:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.903+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/43018665 wait complete. 2024-09-10T16:36:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient: build_initial_monmap 2024-09-10T16:36:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient: monmap: 2024-09-10T16:36:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:41.919 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:41.919 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:41.919 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:41.919 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:41.919 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:41.919 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:41.919 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:41.919 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:41.919 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:41.919 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:41.920 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 1 Processor -- start 2024-09-10T16:36:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 1 -- start start 2024-09-10T16:36:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient: init 2024-09-10T16:36:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient: _add_conns ranks=[7,4,0,5,1,6,8,2,3] 2024-09-10T16:36:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient(hunting): picked mon.noname-i con 0x7f4b0809ca10 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient(hunting): picked mon.noname-c con 0x7f4b080a56e0 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient(hunting): picked mon.noname-a con 0x7f4b080a5b00 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b08131f70 con 0x7f4b080a5b00 2024-09-10T16:36:41.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b08132250 con 0x7f4b080a56e0 2024-09-10T16:36:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b080aa900 con 0x7f4b0809ca10 2024-09-10T16:36:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient(hunting): authenticate will time out at 1369.309180s 2024-09-10T16:36:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b077fe640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f4b080a5b00 0x7f4b081d5fb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37422/0 (socket says 172.21.15.81:37422) 2024-09-10T16:36:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b077fe640 1 -- 172.21.15.81:0/3638037600 learned_addr learned my addr 172.21.15.81:0/3638037600 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1242348333 0 0) 0x7f4b08131f70 con 0x7f4b080a5b00 2024-09-10T16:36:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): my global_id is 6588 2024-09-10T16:36:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4af4003560 con 0x7f4b080a5b00 2024-09-10T16:36:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3666653810 0 0) 0x7f4b08132250 con 0x7f4b080a56e0 2024-09-10T16:36:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): my global_id is 144877 2024-09-10T16:36:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4b08131f70 con 0x7f4b080a56e0 2024-09-10T16:36:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3353424722 0 0) 0x7f4af4003560 con 0x7f4b080a5b00 2024-09-10T16:36:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b08132250 con 0x7f4b080a5b00 2024-09-10T16:36:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4b00001e40 con 0x7f4b080a5b00 2024-09-10T16:36:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:36:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): dump: 2024-09-10T16:36:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.923 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1295976308 0 0) 0x7f4b080aa900 con 0x7f4b0809ca10 2024-09-10T16:36:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): my global_id is 164248 2024-09-10T16:36:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4af4003560 con 0x7f4b0809ca10 2024-09-10T16:36:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3578729722 0 0) 0x7f4b08131f70 con 0x7f4b080a56e0 2024-09-10T16:36:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f4b080aa900 con 0x7f4b080a56e0 2024-09-10T16:36:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4afc0019d0 con 0x7f4b080a56e0 2024-09-10T16:36:41.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:41.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:41.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient(hunting): dump: 2024-09-10T16:36:41.925 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.925 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.925 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.925 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.925 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.925 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.925 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.925 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.925 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.925 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.926 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.926 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.926 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.926 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.926 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.926 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1874489440 0 0) 0x7f4b08132250 con 0x7f4b080a5b00 2024-09-10T16:36:41.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 >> v1:172.21.15.189:6792/0 conn(0x7f4b0809ca10 legacy=0x7f4b0812e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 >> v1:172.21.15.81:6791/0 conn(0x7f4b080a56e0 legacy=0x7f4b0812f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:41.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient: _finish_hunting 0 2024-09-10T16:36:41.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 monclient: found mon.a 2024-09-10T16:36:41.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:41.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b080aa3f0 con 0x7f4b080a5b00 2024-09-10T16:36:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient: _finish_auth 0 2024-09-10T16:36:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient: _check_auth_tickets 2024-09-10T16:36:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 5 monclient: authenticate success, global_id 6588 2024-09-10T16:36:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient: _renew_subs 2024-09-10T16:36:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/3638037600 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f4b0812f730 con 0x7f4b080a5b00 2024-09-10T16:36:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient: _renew_subs 2024-09-10T16:36:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/3638037600 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f4b081308b0 con 0x7f4b080a5b00 2024-09-10T16:36:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f4b00003c50 con 0x7f4b080a5b00 2024-09-10T16:36:41.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f4b00004200 con 0x7f4b080a5b00 2024-09-10T16:36:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b057fa640 4 set_mon_vals no callback set 2024-09-10T16:36:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 10 monclient: dump: 2024-09-10T16:36:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:41.928 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:41.929 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/3638037600 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ae8005090 con 0x7f4b080a5b00 2024-09-10T16:36:41.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f4b000043a0 con 0x7f4b080a5b00 2024-09-10T16:36:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7f4b0004b0c0 con 0x7f4b080a5b00 2024-09-10T16:36:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.907+0000 7f4b06ffd640 10 monclient: get_auth_request con 0x7f4af403d8a0 auth_method 0 2024-09-10T16:36:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.911+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f4b00017000 con 0x7f4b080a5b00 2024-09-10T16:36:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.911+0000 7f4aeffff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:41.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:41.911+0000 7f4aeffff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.087+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/3638037600 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f4ae8000ba0 con 0x7f4af403d8a0 2024-09-10T16:36:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.087+0000 7f4aeffff640 1 -- 172.21.15.81:0/3638037600 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (unknown 489605429 0 0) 0x7f4ae8000ba0 con 0x7f4af403d8a0 2024-09-10T16:36:42.090 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2024-09-10T16:36:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.091+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/3638037600 >> v1:172.21.15.189:6812/1108603242 conn(0x7f4af403d8a0 legacy=0x7f4af403fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.091+0000 7f4b0d9e6640 10 monclient: shutdown 2024-09-10T16:36:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.091+0000 7f4b0d9e6640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.091+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/3638037600 >> v1:172.21.15.81:6789/0 conn(0x7f4b080a5b00 legacy=0x7f4b081d5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.091+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/3638037600 shutdown_connections 2024-09-10T16:36:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.091+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/3638037600 >> 172.21.15.81:0/3638037600 conn(0x7f4b0806dc90 msgr2=0x7f4b0812c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.091+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/3638037600 shutdown_connections 2024-09-10T16:36:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.091+0000 7f4b0d9e6640 1 -- 172.21.15.81:0/3638037600 wait complete. 2024-09-10T16:36:42.108 INFO:tasks.ceph:Scrubbing osd.2 2024-09-10T16:36:42.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-10T16:36:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.223+0000 7fd92c64f640 10 monclient: get_monmap_and_config 2024-09-10T16:36:42.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.223+0000 7fd92c64f640 10 monclient: build_initial_monmap 2024-09-10T16:36:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.223+0000 7fd92c64f640 10 monclient: monmap: 2024-09-10T16:36:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:42.229291+0000 2024-09-10T16:36:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:42.229291+0000 2024-09-10T16:36:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:42.228 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:42.229 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:42.229 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.223+0000 7fd92c64f640 1 Processor -- start 2024-09-10T16:36:42.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 1 -- start start 2024-09-10T16:36:42.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient: init 2024-09-10T16:36:42.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:42.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient: _add_conns ranks=[2,8,1,5,4,6,0,3,7] 2024-09-10T16:36:42.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient(hunting): picked mon.noname-b con 0x7fd924068960 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:42.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient(hunting): picked mon.noname-e con 0x7fd924069450 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:42.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient(hunting): picked mon.noname-f con 0x7fd92413f9e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:42.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9240a7ef0 con 0x7fd92413f9e0 2024-09-10T16:36:42.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9240a9720 con 0x7fd924068960 2024-09-10T16:36:42.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9240a1570 con 0x7fd924069450 2024-09-10T16:36:42.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:42.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient(hunting): authenticate will time out at 1369.628647s 2024-09-10T16:36:42.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92a3eb640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fd924068960 0x7fd924068d40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34302/0 (socket says 172.21.15.81:34302) 2024-09-10T16:36:42.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd929bea640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fd924069450 0x7fd92413e2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35242/0 (socket says 172.21.15.81:35242) 2024-09-10T16:36:42.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92a3eb640 1 -- 172.21.15.81:0/3731259824 learned_addr learned my addr 172.21.15.81:0/3731259824 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 1 -- 172.21.15.81:0/3731259824 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3834948937 0 0) 0x7fd9240a9720 con 0x7fd924068960 2024-09-10T16:36:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient(hunting): my global_id is 145028 2024-09-10T16:36:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 1 -- 172.21.15.81:0/3731259824 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd910003530 con 0x7fd924068960 2024-09-10T16:36:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 1 -- 172.21.15.81:0/3731259824 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2469736416 0 0) 0x7fd9240a1570 con 0x7fd924069450 2024-09-10T16:36:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient(hunting): my global_id is 6695 2024-09-10T16:36:42.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 1 -- 172.21.15.81:0/3731259824 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9240a9720 con 0x7fd924069450 2024-09-10T16:36:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 1 -- 172.21.15.81:0/3731259824 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 843657034 0 0) 0x7fd910003530 con 0x7fd924068960 2024-09-10T16:36:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 1 -- 172.21.15.81:0/3731259824 >> v1:172.21.15.81:6793/0 conn(0x7fd924069450 legacy=0x7fd92413e2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 1 -- 172.21.15.81:0/3731259824 >> v1:172.21.15.189:6789/0 conn(0x7fd92413f9e0 legacy=0x7fd924141dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient: _finish_hunting 0 2024-09-10T16:36:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 1 monclient: found mon.noname-b 2024-09-10T16:36:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:36:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 1 -- 172.21.15.81:0/3731259824 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9240a1b30 con 0x7fd924068960 2024-09-10T16:36:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient: _finish_auth 0 2024-09-10T16:36:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient: _check_auth_tickets 2024-09-10T16:36:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 1 -- 172.21.15.81:0/3731259824 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd920001840 con 0x7fd924068960 2024-09-10T16:36:42.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient: dump: 2024-09-10T16:36:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.239 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.240 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 5 monclient: authenticate success, global_id 145028 2024-09-10T16:36:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 1 -- 172.21.15.81:0/3731259824 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd9200019e0 con 0x7fd924068960 2024-09-10T16:36:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 4 set_mon_vals no callback set 2024-09-10T16:36:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 1 -- 172.21.15.81:0/3731259824 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd920004bf0 con 0x7fd924068960 2024-09-10T16:36:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:42.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd9293e9640 10 monclient: dump: 2024-09-10T16:36:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.241 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.242 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.242 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.242 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient: shutdown 2024-09-10T16:36:42.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:42.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 1 -- 172.21.15.81:0/3731259824 >> v1:172.21.15.81:6790/0 conn(0x7fd924068960 legacy=0x7fd924068d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 1 -- 172.21.15.81:0/3731259824 shutdown_connections 2024-09-10T16:36:42.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 1 -- 172.21.15.81:0/3731259824 >> 172.21.15.81:0/3731259824 conn(0x7fd9240a6720 msgr2=0x7fd9240a5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:42.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 1 -- 172.21.15.81:0/3731259824 shutdown_connections 2024-09-10T16:36:42.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 1 -- 172.21.15.81:0/3731259824 wait complete. 2024-09-10T16:36:42.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient: build_initial_monmap 2024-09-10T16:36:42.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient: monmap: 2024-09-10T16:36:42.242 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:42.243 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:42.244 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 1 Processor -- start 2024-09-10T16:36:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 1 -- start start 2024-09-10T16:36:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient: init 2024-09-10T16:36:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient: _add_conns ranks=[7,2,4,6,5,3,0,1,8] 2024-09-10T16:36:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient(hunting): picked mon.noname-i con 0x7fd924068960 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient(hunting): picked mon.noname-b con 0x7fd924069450 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient(hunting): picked mon.noname-c con 0x7fd92413f9e0 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9241294f0 con 0x7fd924069450 2024-09-10T16:36:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9241297d0 con 0x7fd92413f9e0 2024-09-10T16:36:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd9241ce980 con 0x7fd924068960 2024-09-10T16:36:42.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd92c64f640 10 monclient(hunting): authenticate will time out at 1369.631545s 2024-09-10T16:36:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd929bea640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fd924069450 0x7fd9241ce270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34314/0 (socket says 172.21.15.81:34314) 2024-09-10T16:36:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd929bea640 1 -- 172.21.15.81:0/1653833169 learned_addr learned my addr 172.21.15.81:0/1653833169 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3116231141 0 0) 0x7fd9241294f0 con 0x7fd924069450 2024-09-10T16:36:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd916ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd916ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd916ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd916ffd640 10 monclient(hunting): my global_id is 145037 2024-09-10T16:36:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd908003560 con 0x7fd924069450 2024-09-10T16:36:42.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 402763638 0 0) 0x7fd9241297d0 con 0x7fd92413f9e0 2024-09-10T16:36:42.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd916ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd916ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd916ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd916ffd640 10 monclient(hunting): my global_id is 144886 2024-09-10T16:36:42.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.227+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9241294f0 con 0x7fd92413f9e0 2024-09-10T16:36:42.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1063794222 0 0) 0x7fd908003560 con 0x7fd924069450 2024-09-10T16:36:42.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd9241297d0 con 0x7fd924069450 2024-09-10T16:36:42.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 145457182 0 0) 0x7fd9241294f0 con 0x7fd92413f9e0 2024-09-10T16:36:42.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd908003560 con 0x7fd92413f9e0 2024-09-10T16:36:42.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd9180018d0 con 0x7fd924069450 2024-09-10T16:36:42.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:42.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:42.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient(hunting): dump: 2024-09-10T16:36:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.248 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.248 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.248 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:42.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd91c001c80 con 0x7fd92413f9e0 2024-09-10T16:36:42.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:42.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient(hunting): got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:42.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient(hunting): dump: 2024-09-10T16:36:42.248 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.248 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.248 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.248 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.248 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.249 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== mon.7 v1:172.21.15.189:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2557610978 0 0) 0x7fd9241ce980 con 0x7fd924068960 2024-09-10T16:36:42.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient(hunting): my global_id is 164257 2024-09-10T16:36:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 --> v1:172.21.15.189:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd9241294f0 con 0x7fd924068960 2024-09-10T16:36:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1632553251 0 0) 0x7fd9241297d0 con 0x7fd924069450 2024-09-10T16:36:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 >> v1:172.21.15.189:6792/0 conn(0x7fd924068960 legacy=0x7fd9241cdb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 >> v1:172.21.15.81:6791/0 conn(0x7fd92413f9e0 legacy=0x7fd9241d5dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:36:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 monclient: found mon.b 2024-09-10T16:36:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd924072d00 con 0x7fd924069450 2024-09-10T16:36:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient: _finish_auth 0 2024-09-10T16:36:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:36:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd92c64f640 5 monclient: authenticate success, global_id 145037 2024-09-10T16:36:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd92c64f640 10 monclient: _renew_subs 2024-09-10T16:36:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd92c64f640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd92c64f640 1 -- 172.21.15.81:0/1653833169 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd9240a74c0 con 0x7fd924069450 2024-09-10T16:36:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd92c64f640 10 monclient: _renew_subs 2024-09-10T16:36:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd92c64f640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd92c64f640 1 -- 172.21.15.81:0/1653833169 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7fd924128960 con 0x7fd924069450 2024-09-10T16:36:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd918001be0 con 0x7fd924069450 2024-09-10T16:36:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd918004de0 con 0x7fd924069450 2024-09-10T16:36:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd928be8640 4 set_mon_vals no callback set 2024-09-10T16:36:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient: dump: 2024-09-10T16:36:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.253 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd92c64f640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd92c64f640 1 -- 172.21.15.81:0/1653833169 --> v1:172.21.15.81:6790/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd90c000f90 con 0x7fd924069450 2024-09-10T16:36:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fd918010cf0 con 0x7fd924069450 2024-09-10T16:36:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7fd91804ad10 con 0x7fd924069450 2024-09-10T16:36:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 --> v1:172.21.15.81:6804/2595021275 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd9180018d0 con 0x7fd9080443b0 2024-09-10T16:36:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_get_version_reply(handle=1 version=325) ==== 24+0+0 (unknown 690020996 0 0) 0x7fd91804b160 con 0x7fd924069450 2024-09-10T16:36:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 10 monclient: handle_get_version_reply finishing 1 version 325 2024-09-10T16:36:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd92abec640 10 monclient: get_auth_request con 0x7fd9080443b0 auth_method 0 2024-09-10T16:36:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd92a3eb640 10 monclient: get_auth_request con 0x7fd90803d850 auth_method 0 2024-09-10T16:36:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.231+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== osd.2 v1:172.21.15.81:6804/2595021275 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fd9180018d0 con 0x7fd9080443b0 2024-09-10T16:36:42.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.243+0000 7fd92c64f640 1 -- 172.21.15.81:0/1653833169 --> v1:172.21.15.81:6804/2595021275 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd90c002ce0 con 0x7fd9080443b0 2024-09-10T16:36:42.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.243+0000 7fd916ffd640 1 -- 172.21.15.81:0/1653833169 <== osd.2 v1:172.21.15.81:6804/2595021275 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fd90c002ce0 con 0x7fd9080443b0 2024-09-10T16:36:42.254 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:42.254 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T16:36:42.255 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.247+0000 7fd92c64f640 1 -- 172.21.15.81:0/1653833169 >> v1:172.21.15.81:6804/2595021275 conn(0x7fd9080443b0 legacy=0x7fd9080467d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.247+0000 7fd92c64f640 1 -- 172.21.15.81:0/1653833169 >> v1:172.21.15.189:6812/1108603242 conn(0x7fd90803d850 legacy=0x7fd90803fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.247+0000 7fd92c64f640 10 monclient: shutdown 2024-09-10T16:36:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.247+0000 7fd92c64f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.247+0000 7fd92c64f640 1 -- 172.21.15.81:0/1653833169 >> v1:172.21.15.81:6790/0 conn(0x7fd924069450 legacy=0x7fd9241ce270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.247+0000 7fd92abec640 1 -- 172.21.15.81:0/1653833169 reap_dead start 2024-09-10T16:36:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.247+0000 7fd92c64f640 1 -- 172.21.15.81:0/1653833169 shutdown_connections 2024-09-10T16:36:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.247+0000 7fd92c64f640 1 -- 172.21.15.81:0/1653833169 >> 172.21.15.81:0/1653833169 conn(0x7fd9240a6720 msgr2=0x7fd9240714f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.247+0000 7fd92c64f640 1 -- 172.21.15.81:0/1653833169 shutdown_connections 2024-09-10T16:36:42.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.247+0000 7fd92c64f640 1 -- 172.21.15.81:0/1653833169 wait complete. 2024-09-10T16:36:42.263 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-10T16:36:42.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 10 monclient: get_monmap_and_config 2024-09-10T16:36:42.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 10 monclient: build_initial_monmap 2024-09-10T16:36:42.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 10 monclient: monmap: 2024-09-10T16:36:42.369 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:42.369 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.369 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:42.370648+0000 2024-09-10T16:36:42.369 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:42.370648+0000 2024-09-10T16:36:42.369 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:42.369 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.369 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:42.369 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:42.369 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:42.369 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:42.369 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:42.370 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:42.370 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:42.370 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:42.370 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:42.370 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 1 Processor -- start 2024-09-10T16:36:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 1 -- start start 2024-09-10T16:36:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 10 monclient: init 2024-09-10T16:36:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 10 monclient: _add_conns ranks=[2,7,8,3,4,1,5,6,0] 2024-09-10T16:36:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 10 monclient(hunting): picked mon.noname-b con 0x7f98680a3ef0 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 10 monclient(hunting): picked mon.noname-i con 0x7f9868073d20 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:42.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 10 monclient(hunting): picked mon.noname-e con 0x7f98680a49e0 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9868073870 con 0x7f98680a3ef0 2024-09-10T16:36:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98680a5630 con 0x7f9868073d20 2024-09-10T16:36:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9868073590 con 0x7f98680a49e0 2024-09-10T16:36:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 10 monclient(hunting): authenticate will time out at 1369.770212s 2024-09-10T16:36:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986d45c640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f98680a3ef0 0x7f98680a42d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34322/0 (socket says 172.21.15.81:34322) 2024-09-10T16:36:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986d45c640 1 -- 172.21.15.81:0/2558635550 learned_addr learned my addr 172.21.15.81:0/2558635550 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 1 -- 172.21.15.81:0/2558635550 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1995409452 0 0) 0x7f9868073590 con 0x7f98680a49e0 2024-09-10T16:36:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient(hunting): my global_id is 6704 2024-09-10T16:36:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 1 -- 172.21.15.81:0/2558635550 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9854003530 con 0x7f98680a49e0 2024-09-10T16:36:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 1 -- 172.21.15.81:0/2558635550 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1489879630 0 0) 0x7f9868073870 con 0x7f98680a3ef0 2024-09-10T16:36:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient(hunting): my global_id is 145046 2024-09-10T16:36:42.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 1 -- 172.21.15.81:0/2558635550 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9868073590 con 0x7f98680a3ef0 2024-09-10T16:36:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 1 -- 172.21.15.81:0/2558635550 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1155385798 0 0) 0x7f9868073590 con 0x7f98680a3ef0 2024-09-10T16:36:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 1 -- 172.21.15.81:0/2558635550 >> v1:172.21.15.81:6793/0 conn(0x7f98680a49e0 legacy=0x7f986813f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 1 -- 172.21.15.81:0/2558635550 >> v1:172.21.15.189:6792/0 conn(0x7f9868073d20 legacy=0x7f986813c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient: _finish_hunting 0 2024-09-10T16:36:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 1 monclient: found mon.noname-b 2024-09-10T16:36:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:36:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 1 -- 172.21.15.81:0/2558635550 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98680a5870 con 0x7f98680a3ef0 2024-09-10T16:36:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient: _finish_auth 0 2024-09-10T16:36:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient: _check_auth_tickets 2024-09-10T16:36:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 1 -- 172.21.15.81:0/2558635550 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9864001ba0 con 0x7f98680a3ef0 2024-09-10T16:36:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:42.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient: dump: 2024-09-10T16:36:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.381 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.382 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.386 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 5 monclient: authenticate success, global_id 145046 2024-09-10T16:36:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 1 -- 172.21.15.81:0/2558635550 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9864001d40 con 0x7f98680a3ef0 2024-09-10T16:36:42.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 1 -- 172.21.15.81:0/2558635550 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9864004c30 con 0x7f98680a3ef0 2024-09-10T16:36:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 4 set_mon_vals no callback set 2024-09-10T16:36:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:42.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f985ffff640 10 monclient: dump: 2024-09-10T16:36:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.388 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.389 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 10 monclient: shutdown 2024-09-10T16:36:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 1 -- 172.21.15.81:0/2558635550 >> v1:172.21.15.81:6790/0 conn(0x7f98680a3ef0 legacy=0x7f98680a42d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 1 -- 172.21.15.81:0/2558635550 shutdown_connections 2024-09-10T16:36:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 1 -- 172.21.15.81:0/2558635550 >> 172.21.15.81:0/2558635550 conn(0x7f98680a94f0 msgr2=0x7f98680a9900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 1 -- 172.21.15.81:0/2558635550 shutdown_connections 2024-09-10T16:36:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.367+0000 7f986f6c0640 1 -- 172.21.15.81:0/2558635550 wait complete. 2024-09-10T16:36:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient: build_initial_monmap 2024-09-10T16:36:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient: monmap: 2024-09-10T16:36:42.389 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:42.390 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:42.391 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 1 Processor -- start 2024-09-10T16:36:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 1 -- start start 2024-09-10T16:36:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient: init 2024-09-10T16:36:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient: _add_conns ranks=[8,0,1,3,7,6,4,5,2] 2024-09-10T16:36:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient(hunting): picked mon.noname-e con 0x7f9868073d20 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient(hunting): picked mon.noname-a con 0x7f98680a3ef0 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient(hunting): picked mon.noname-f con 0x7f98680a49e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9868126fe0 con 0x7f98680a3ef0 2024-09-10T16:36:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f98680a68d0 con 0x7f98680a49e0 2024-09-10T16:36:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9868124c80 con 0x7f9868073d20 2024-09-10T16:36:42.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient(hunting): authenticate will time out at 1369.773075s 2024-09-10T16:36:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986d45c640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f9868073d20 0x7f986813f580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35262/0 (socket says 172.21.15.81:35262) 2024-09-10T16:36:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986cc5b640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f98680a3ef0 0x7f98681d07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37432/0 (socket says 172.21.15.81:37432) 2024-09-10T16:36:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986d45c640 1 -- 172.21.15.81:0/1296616520 learned_addr learned my addr 172.21.15.81:0/1296616520 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4000185066 0 0) 0x7f9868124c80 con 0x7f9868073d20 2024-09-10T16:36:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): my global_id is 6713 2024-09-10T16:36:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f984c003530 con 0x7f9868073d20 2024-09-10T16:36:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632726453 0 0) 0x7f9868126fe0 con 0x7f98680a3ef0 2024-09-10T16:36:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): my global_id is 6597 2024-09-10T16:36:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9868124c80 con 0x7f98680a3ef0 2024-09-10T16:36:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3712940128 0 0) 0x7f984c003530 con 0x7f9868073d20 2024-09-10T16:36:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9868126fe0 con 0x7f9868073d20 2024-09-10T16:36:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1351338178 0 0) 0x7f9868124c80 con 0x7f98680a3ef0 2024-09-10T16:36:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f984c003530 con 0x7f98680a3ef0 2024-09-10T16:36:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9864001b60 con 0x7f9868073d20 2024-09-10T16:36:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:36:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): dump: 2024-09-10T16:36:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.394 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9858001ae0 con 0x7f98680a3ef0 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient(hunting): dump: 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.396 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 626831725 0 0) 0x7f984c003530 con 0x7f98680a3ef0 2024-09-10T16:36:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 >> v1:172.21.15.81:6793/0 conn(0x7f9868073d20 legacy=0x7f986813f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 >> v1:172.21.15.189:6789/0 conn(0x7f98680a49e0 legacy=0x7f98681d3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient: _finish_hunting 0 2024-09-10T16:36:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 monclient: found mon.a 2024-09-10T16:36:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9868126d00 con 0x7f98680a3ef0 2024-09-10T16:36:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient: _finish_auth 0 2024-09-10T16:36:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient: _check_auth_tickets 2024-09-10T16:36:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 5 monclient: authenticate success, global_id 6597 2024-09-10T16:36:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient: _renew_subs 2024-09-10T16:36:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 1 -- 172.21.15.81:0/1296616520 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f9868125b90 con 0x7f98680a3ef0 2024-09-10T16:36:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient: _renew_subs 2024-09-10T16:36:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 1 -- 172.21.15.81:0/1296616520 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f986813fc90 con 0x7f98680a3ef0 2024-09-10T16:36:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f98580038d0 con 0x7f98680a3ef0 2024-09-10T16:36:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9858003e00 con 0x7f98680a3ef0 2024-09-10T16:36:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985f7fe640 4 set_mon_vals no callback set 2024-09-10T16:36:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 10 monclient: dump: 2024-09-10T16:36:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.399 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.399 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.399 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.399 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:42.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:42.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:42.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986f6c0640 1 -- 172.21.15.81:0/1296616520 --> v1:172.21.15.81:6789/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9848005090 con 0x7f98680a3ef0 2024-09-10T16:36:42.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f9858004020 con 0x7f98680a3ef0 2024-09-10T16:36:42.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7f985804adf0 con 0x7f98680a3ef0 2024-09-10T16:36:42.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.371+0000 7f986d45c640 10 monclient: get_auth_request con 0x7f984c03d4c0 auth_method 0 2024-09-10T16:36:42.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.375+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f9858016c30 con 0x7f98680a3ef0 2024-09-10T16:36:42.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.375+0000 7f985dffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:42.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.375+0000 7f985dffb640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.543+0000 7f986f6c0640 1 -- 172.21.15.81:0/1296616520 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f9848000ba0 con 0x7f984c03d4c0 2024-09-10T16:36:42.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.543+0000 7f985dffb640 1 -- 172.21.15.81:0/1296616520 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (unknown 3049115190 0 0) 0x7f9848000ba0 con 0x7f984c03d4c0 2024-09-10T16:36:42.548 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2024-09-10T16:36:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.547+0000 7f986f6c0640 1 -- 172.21.15.81:0/1296616520 >> v1:172.21.15.189:6812/1108603242 conn(0x7f984c03d4c0 legacy=0x7f984c03f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.547+0000 7f986f6c0640 10 monclient: shutdown 2024-09-10T16:36:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.547+0000 7f986f6c0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.547+0000 7f986f6c0640 1 -- 172.21.15.81:0/1296616520 >> v1:172.21.15.81:6789/0 conn(0x7f98680a3ef0 legacy=0x7f98681d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.547+0000 7f986f6c0640 1 -- 172.21.15.81:0/1296616520 shutdown_connections 2024-09-10T16:36:42.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.547+0000 7f986f6c0640 1 -- 172.21.15.81:0/1296616520 >> 172.21.15.81:0/1296616520 conn(0x7f98680a94f0 msgr2=0x7f9868140690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.547+0000 7f986f6c0640 1 -- 172.21.15.81:0/1296616520 shutdown_connections 2024-09-10T16:36:42.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.547+0000 7f986f6c0640 1 -- 172.21.15.81:0/1296616520 wait complete. 2024-09-10T16:36:42.566 INFO:tasks.ceph:Scrubbing osd.3 2024-09-10T16:36:42.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-10T16:36:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 10 monclient: get_monmap_and_config 2024-09-10T16:36:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 10 monclient: build_initial_monmap 2024-09-10T16:36:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 10 monclient: monmap: 2024-09-10T16:36:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:42.694846+0000 2024-09-10T16:36:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:42.694846+0000 2024-09-10T16:36:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:42.694 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 1 Processor -- start 2024-09-10T16:36:42.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 1 -- start start 2024-09-10T16:36:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 10 monclient: init 2024-09-10T16:36:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 10 monclient: _add_conns ranks=[4,7,2,8,0,6,3,5,1] 2024-09-10T16:36:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 10 monclient(hunting): picked mon.noname-c con 0x7fd04c138d90 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 10 monclient(hunting): picked mon.noname-i con 0x7fd04c0a5db0 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 10 monclient(hunting): picked mon.noname-b con 0x7fd04c13f830 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04c09dbc0 con 0x7fd04c13f830 2024-09-10T16:36:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04c139a70 con 0x7fd04c138d90 2024-09-10T16:36:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04c09de30 con 0x7fd04c0a5db0 2024-09-10T16:36:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 10 monclient(hunting): authenticate will time out at 1370.095042s 2024-09-10T16:36:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd05169a640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7fd04c13f830 0x7fd04c141c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34334/0 (socket says 172.21.15.81:34334) 2024-09-10T16:36:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd05169a640 1 -- 172.21.15.81:0/2370642434 learned_addr learned my addr 172.21.15.81:0/2370642434 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 1 -- 172.21.15.81:0/2370642434 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2620720118 0 0) 0x7fd04c09dbc0 con 0x7fd04c13f830 2024-09-10T16:36:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 10 monclient(hunting): my global_id is 145055 2024-09-10T16:36:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 1 -- 172.21.15.81:0/2370642434 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd03c003530 con 0x7fd04c13f830 2024-09-10T16:36:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 1 -- 172.21.15.81:0/2370642434 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1065577948 0 0) 0x7fd04c139a70 con 0x7fd04c138d90 2024-09-10T16:36:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 10 monclient(hunting): my global_id is 144895 2024-09-10T16:36:42.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 1 -- 172.21.15.81:0/2370642434 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd04c09dbc0 con 0x7fd04c138d90 2024-09-10T16:36:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 1 -- 172.21.15.81:0/2370642434 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3932053367 0 0) 0x7fd03c003530 con 0x7fd04c13f830 2024-09-10T16:36:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 1 -- 172.21.15.81:0/2370642434 >> v1:172.21.15.189:6792/0 conn(0x7fd04c0a5db0 legacy=0x7fd04c13e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 1 -- 172.21.15.81:0/2370642434 >> v1:172.21.15.81:6791/0 conn(0x7fd04c138d90 legacy=0x7fd04c0a56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 10 monclient: _finish_hunting 0 2024-09-10T16:36:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 1 monclient: found mon.noname-b 2024-09-10T16:36:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:36:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 1 -- 172.21.15.81:0/2370642434 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c09e110 con 0x7fd04c13f830 2024-09-10T16:36:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 10 monclient: _finish_auth 0 2024-09-10T16:36:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 10 monclient: _check_auth_tickets 2024-09-10T16:36:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 1 -- 172.21.15.81:0/2370642434 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd044001bc0 con 0x7fd04c13f830 2024-09-10T16:36:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 5 monclient: authenticate success, global_id 145055 2024-09-10T16:36:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd0530fd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.691+0000 7fd04b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd04b7fe640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd04b7fe640 10 monclient: dump: 2024-09-10T16:36:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.705 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.706 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd04b7fe640 1 -- 172.21.15.81:0/2370642434 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd044001d60 con 0x7fd04c13f830 2024-09-10T16:36:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd04b7fe640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 4 set_mon_vals no callback set 2024-09-10T16:36:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd04b7fe640 1 -- 172.21.15.81:0/2370642434 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd044004f70 con 0x7fd04c13f830 2024-09-10T16:36:42.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd04b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:42.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd04b7fe640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:42.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd04b7fe640 10 monclient: dump: 2024-09-10T16:36:42.707 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.707 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.707 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.707 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.707 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.707 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.707 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.707 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.707 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.707 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.707 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.707 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.708 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient: shutdown 2024-09-10T16:36:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 1 -- 172.21.15.81:0/2370642434 >> v1:172.21.15.81:6790/0 conn(0x7fd04c13f830 legacy=0x7fd04c141c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 1 -- 172.21.15.81:0/2370642434 shutdown_connections 2024-09-10T16:36:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 1 -- 172.21.15.81:0/2370642434 >> 172.21.15.81:0/2370642434 conn(0x7fd04c06dd20 msgr2=0x7fd04c0abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 1 -- 172.21.15.81:0/2370642434 shutdown_connections 2024-09-10T16:36:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 1 -- 172.21.15.81:0/2370642434 wait complete. 2024-09-10T16:36:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient: build_initial_monmap 2024-09-10T16:36:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient: monmap: 2024-09-10T16:36:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:42.709 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:42.710 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 1 Processor -- start 2024-09-10T16:36:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 1 -- start start 2024-09-10T16:36:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient: init 2024-09-10T16:36:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient: _add_conns ranks=[8,0,5,1,6,7,3,4,2] 2024-09-10T16:36:42.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient(hunting): picked mon.noname-e con 0x7fd04c0a5db0 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient(hunting): picked mon.noname-a con 0x7fd04c138d90 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient(hunting): picked mon.noname-h con 0x7fd04c13f830 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04c13a500 con 0x7fd04c138d90 2024-09-10T16:36:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04c13a7e0 con 0x7fd04c13f830 2024-09-10T16:36:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd04c13aac0 con 0x7fd04c0a5db0 2024-09-10T16:36:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient(hunting): authenticate will time out at 1370.098078s 2024-09-10T16:36:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd050e99640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7fd04c0a5db0 0x7fd04c133cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35266/0 (socket says 172.21.15.81:35266) 2024-09-10T16:36:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd050e99640 1 -- 172.21.15.81:0/3999796824 learned_addr learned my addr 172.21.15.81:0/3999796824 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd04bfff640 1 --1- 172.21.15.81:0/3999796824 >> v1:172.21.15.81:6789/0 conn(0x7fd04c138d90 0x7fd04c134400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37434/0 (socket says 172.21.15.81:37434) 2024-09-10T16:36:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1621283242 0 0) 0x7fd04c13a500 con 0x7fd04c138d90 2024-09-10T16:36:42.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): my global_id is 6606 2024-09-10T16:36:42.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd030003530 con 0x7fd04c138d90 2024-09-10T16:36:42.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038671501 0 0) 0x7fd04c13aac0 con 0x7fd04c0a5db0 2024-09-10T16:36:42.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): my global_id is 6722 2024-09-10T16:36:42.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd04c13a500 con 0x7fd04c0a5db0 2024-09-10T16:36:42.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2529979844 0 0) 0x7fd030003530 con 0x7fd04c138d90 2024-09-10T16:36:42.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd04c13aac0 con 0x7fd04c138d90 2024-09-10T16:36:42.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd038001a80 con 0x7fd04c138d90 2024-09-10T16:36:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:36:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): dump: 2024-09-10T16:36:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.713 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.714 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1222848778 0 0) 0x7fd04c13a500 con 0x7fd04c0a5db0 2024-09-10T16:36:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fd030003530 con 0x7fd04c0a5db0 2024-09-10T16:36:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd040001660 con 0x7fd04c0a5db0 2024-09-10T16:36:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): dump: 2024-09-10T16:36:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.714 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.715 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.716 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3818075613 0 0) 0x7fd04c13a7e0 con 0x7fd04c13f830 2024-09-10T16:36:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient(hunting): my global_id is 164228 2024-09-10T16:36:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd04c13a500 con 0x7fd04c13f830 2024-09-10T16:36:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1241280361 0 0) 0x7fd04c13aac0 con 0x7fd04c138d90 2024-09-10T16:36:42.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 >> v1:172.21.15.81:6793/0 conn(0x7fd04c0a5db0 legacy=0x7fd04c133cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 >> v1:172.21.15.189:6791/0 conn(0x7fd04c13f830 legacy=0x7fd04c134b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient: _finish_hunting 0 2024-09-10T16:36:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 monclient: found mon.a 2024-09-10T16:36:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd04c13adf0 con 0x7fd04c138d90 2024-09-10T16:36:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient: _finish_auth 0 2024-09-10T16:36:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient: _check_auth_tickets 2024-09-10T16:36:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 5 monclient: authenticate success, global_id 6606 2024-09-10T16:36:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient: _renew_subs 2024-09-10T16:36:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 1 -- 172.21.15.81:0/3999796824 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fd04c13b360 con 0x7fd04c138d90 2024-09-10T16:36:42.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient: _renew_subs 2024-09-10T16:36:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 1 -- 172.21.15.81:0/3999796824 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7fd04c135620 con 0x7fd04c138d90 2024-09-10T16:36:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fd038001d00 con 0x7fd04c138d90 2024-09-10T16:36:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fd038003c10 con 0x7fd04c138d90 2024-09-10T16:36:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd04affd640 4 set_mon_vals no callback set 2024-09-10T16:36:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 10 monclient: dump: 2024-09-10T16:36:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.719 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.719 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.719 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.719 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.719 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.719 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.719 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.719 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.719 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.719 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.719 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.719 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:42.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0530fd640 1 -- 172.21.15.81:0/3999796824 --> v1:172.21.15.81:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fd02c000f90 con 0x7fd04c138d90 2024-09-10T16:36:42.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.695+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fd038003db0 con 0x7fd04c138d90 2024-09-10T16:36:42.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.699+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7fd03804ac40 con 0x7fd04c138d90 2024-09-10T16:36:42.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.699+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 --> v1:172.21.15.189:6804/3461775318 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd030048000 con 0x7fd030044390 2024-09-10T16:36:42.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.699+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_get_version_reply(handle=1 version=325) ==== 24+0+0 (unknown 690020996 0 0) 0x7fd03804b050 con 0x7fd04c138d90 2024-09-10T16:36:42.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.699+0000 7fd0497fa640 10 monclient: handle_get_version_reply finishing 1 version 325 2024-09-10T16:36:42.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.699+0000 7fd050e99640 10 monclient: get_auth_request con 0x7fd03003d800 auth_method 0 2024-09-10T16:36:42.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.699+0000 7fd05169a640 10 monclient: get_auth_request con 0x7fd030044390 auth_method 0 2024-09-10T16:36:42.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.699+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== osd.3 v1:172.21.15.189:6804/3461775318 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fd030048000 con 0x7fd030044390 2024-09-10T16:36:42.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.711+0000 7fd0530fd640 1 -- 172.21.15.81:0/3999796824 --> v1:172.21.15.189:6804/3461775318 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd02c002ce0 con 0x7fd030044390 2024-09-10T16:36:42.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.715+0000 7fd0497fa640 1 -- 172.21.15.81:0/3999796824 <== osd.3 v1:172.21.15.189:6804/3461775318 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fd02c002ce0 con 0x7fd030044390 2024-09-10T16:36:42.721 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T16:36:42.722 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:42.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.715+0000 7fd0530fd640 1 -- 172.21.15.81:0/3999796824 >> v1:172.21.15.189:6804/3461775318 conn(0x7fd030044390 legacy=0x7fd0300467b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.715+0000 7fd0530fd640 1 -- 172.21.15.81:0/3999796824 >> v1:172.21.15.189:6812/1108603242 conn(0x7fd03003d800 legacy=0x7fd03003fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.715+0000 7fd0530fd640 10 monclient: shutdown 2024-09-10T16:36:42.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.715+0000 7fd0530fd640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:42.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.715+0000 7fd0530fd640 1 -- 172.21.15.81:0/3999796824 >> v1:172.21.15.81:6789/0 conn(0x7fd04c138d90 legacy=0x7fd04c134400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.715+0000 7fd05169a640 1 -- 172.21.15.81:0/3999796824 reap_dead start 2024-09-10T16:36:42.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.715+0000 7fd0530fd640 1 -- 172.21.15.81:0/3999796824 shutdown_connections 2024-09-10T16:36:42.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.715+0000 7fd0530fd640 1 -- 172.21.15.81:0/3999796824 >> 172.21.15.81:0/3999796824 conn(0x7fd04c06dd20 msgr2=0x7fd04c12c450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:42.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.715+0000 7fd0530fd640 1 -- 172.21.15.81:0/3999796824 shutdown_connections 2024-09-10T16:36:42.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.715+0000 7fd0530fd640 1 -- 172.21.15.81:0/3999796824 wait complete. 2024-09-10T16:36:42.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-10T16:36:42.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.835+0000 7f937a38a640 10 monclient: get_monmap_and_config 2024-09-10T16:36:42.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.835+0000 7f937a38a640 10 monclient: build_initial_monmap 2024-09-10T16:36:42.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.835+0000 7f937a38a640 10 monclient: monmap: 2024-09-10T16:36:42.839 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:42.841195+0000 2024-09-10T16:36:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:42.841195+0000 2024-09-10T16:36:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:42.840 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:42.841 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:42.841 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.835+0000 7f937a38a640 1 Processor -- start 2024-09-10T16:36:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.835+0000 7f937a38a640 1 -- start start 2024-09-10T16:36:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.835+0000 7f937a38a640 10 monclient: init 2024-09-10T16:36:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient: _add_conns ranks=[4,0,5,7,3,6,8,2,1] 2024-09-10T16:36:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient(hunting): picked mon.noname-c con 0x7f937409ca10 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient(hunting): picked mon.noname-a con 0x7f93740a56e0 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:42.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient(hunting): picked mon.noname-h con 0x7f93740a5b00 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93741362b0 con 0x7f93740a56e0 2024-09-10T16:36:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93740a80b0 con 0x7f937409ca10 2024-09-10T16:36:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f937409de70 con 0x7f93740a5b00 2024-09-10T16:36:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient(hunting): authenticate will time out at 1370.240698s 2024-09-10T16:36:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9373fff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f937409ca10 0x7f9374135ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:49234/0 (socket says 172.21.15.81:49234) 2024-09-10T16:36:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9373fff640 1 -- 172.21.15.81:0/4273340558 learned_addr learned my addr 172.21.15.81:0/4273340558 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 1 -- 172.21.15.81:0/4273340558 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3552052188 0 0) 0x7f93741362b0 con 0x7f93740a56e0 2024-09-10T16:36:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient(hunting): my global_id is 6615 2024-09-10T16:36:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 1 -- 172.21.15.81:0/4273340558 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f935c003530 con 0x7f93740a56e0 2024-09-10T16:36:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 1 -- 172.21.15.81:0/4273340558 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4086076580 0 0) 0x7f93740a80b0 con 0x7f937409ca10 2024-09-10T16:36:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient(hunting): my global_id is 144904 2024-09-10T16:36:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 1 -- 172.21.15.81:0/4273340558 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93741362b0 con 0x7f937409ca10 2024-09-10T16:36:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 1 -- 172.21.15.81:0/4273340558 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 102393435 0 0) 0x7f935c003530 con 0x7f93740a56e0 2024-09-10T16:36:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 1 -- 172.21.15.81:0/4273340558 >> v1:172.21.15.189:6791/0 conn(0x7f93740a5b00 legacy=0x7f9374141650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 1 -- 172.21.15.81:0/4273340558 >> v1:172.21.15.81:6791/0 conn(0x7f937409ca10 legacy=0x7f9374135ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:36:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 1 monclient: found mon.noname-a 2024-09-10T16:36:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient: _send_mon_message to mon.noname-a at v1:172.21.15.81:6789/0 2024-09-10T16:36:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 1 -- 172.21.15.81:0/4273340558 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f937409e150 con 0x7f93740a56e0 2024-09-10T16:36:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient: _finish_auth 0 2024-09-10T16:36:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:36:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 5 monclient: authenticate success, global_id 6615 2024-09-10T16:36:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 1 -- 172.21.15.81:0/4273340558 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9364001bc0 con 0x7f93740a56e0 2024-09-10T16:36:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:36:42.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient: dump: 2024-09-10T16:36:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.852 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.853 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 1 -- 172.21.15.81:0/4273340558 <== mon.0 v1:172.21.15.81:6789/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f9364001de0 con 0x7f93740a56e0 2024-09-10T16:36:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 4 set_mon_vals no callback set 2024-09-10T16:36:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 1 -- 172.21.15.81:0/4273340558 <== mon.0 v1:172.21.15.81:6789/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9364003ce0 con 0x7f93740a56e0 2024-09-10T16:36:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9372ffd640 10 monclient: dump: 2024-09-10T16:36:42.853 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.854 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.854 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.854 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.854 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.854 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.854 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.854 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.854 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.854 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.854 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.854 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.854 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.854 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.854 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.855 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient: shutdown 2024-09-10T16:36:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 1 -- 172.21.15.81:0/4273340558 >> v1:172.21.15.81:6789/0 conn(0x7f93740a56e0 legacy=0x7f937413df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 1 -- 172.21.15.81:0/4273340558 shutdown_connections 2024-09-10T16:36:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 1 -- 172.21.15.81:0/4273340558 >> 172.21.15.81:0/4273340558 conn(0x7f937406dc90 msgr2=0x7f93740ab820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 1 -- 172.21.15.81:0/4273340558 shutdown_connections 2024-09-10T16:36:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 1 -- 172.21.15.81:0/4273340558 wait complete. 2024-09-10T16:36:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient: build_initial_monmap 2024-09-10T16:36:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient: monmap: 2024-09-10T16:36:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:42.855 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:42.856 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 1 Processor -- start 2024-09-10T16:36:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 1 -- start start 2024-09-10T16:36:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient: init 2024-09-10T16:36:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient: _add_conns ranks=[4,1,0,8,7,5,6,2,3] 2024-09-10T16:36:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient(hunting): picked mon.noname-c con 0x7f937409ca10 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient(hunting): picked mon.noname-f con 0x7f93740a56e0 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient(hunting): picked mon.noname-a con 0x7f93740a5b00 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f937409f160 con 0x7f93740a5b00 2024-09-10T16:36:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9374132720 con 0x7f93740a56e0 2024-09-10T16:36:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93741320a0 con 0x7f937409ca10 2024-09-10T16:36:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f937a38a640 10 monclient(hunting): authenticate will time out at 1370.243842s 2024-09-10T16:36:42.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9373fff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7f937409ca10 0x7f93741303a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:49242/0 (socket says 172.21.15.81:49242) 2024-09-10T16:36:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.839+0000 7f9373fff640 1 -- 172.21.15.81:0/3469322394 learned_addr learned my addr 172.21.15.81:0/3469322394 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 828411243 0 0) 0x7f93741320a0 con 0x7f937409ca10 2024-09-10T16:36:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): my global_id is 144913 2024-09-10T16:36:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9360003530 con 0x7f937409ca10 2024-09-10T16:36:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1030361112 0 0) 0x7f937409f160 con 0x7f93740a5b00 2024-09-10T16:36:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): my global_id is 6624 2024-09-10T16:36:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93741320a0 con 0x7f93740a5b00 2024-09-10T16:36:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3178095908 0 0) 0x7f9360003530 con 0x7f937409ca10 2024-09-10T16:36:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f937409f160 con 0x7f937409ca10 2024-09-10T16:36:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f936c001bc0 con 0x7f937409ca10 2024-09-10T16:36:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:36:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): dump: 2024-09-10T16:36:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.859 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.860 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3726594258 0 0) 0x7f93741320a0 con 0x7f93740a5b00 2024-09-10T16:36:42.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f9360003530 con 0x7f93740a5b00 2024-09-10T16:36:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f9368001900 con 0x7f93740a5b00 2024-09-10T16:36:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): dump: 2024-09-10T16:36:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.861 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.862 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 <== mon.1 v1:172.21.15.189:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3839808349 0 0) 0x7f9374132720 con 0x7f93740a56e0 2024-09-10T16:36:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient(hunting): my global_id is 164278 2024-09-10T16:36:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 --> v1:172.21.15.189:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f93741320a0 con 0x7f93740a56e0 2024-09-10T16:36:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2532524664 0 0) 0x7f937409f160 con 0x7f937409ca10 2024-09-10T16:36:42.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 >> v1:172.21.15.189:6789/0 conn(0x7f93740a56e0 legacy=0x7f9374130ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 >> v1:172.21.15.81:6789/0 conn(0x7f93740a5b00 legacy=0x7f93741d5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:36:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 monclient: found mon.c 2024-09-10T16:36:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93740aa5b0 con 0x7f937409ca10 2024-09-10T16:36:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient: _finish_auth 0 2024-09-10T16:36:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:36:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f937a38a640 5 monclient: authenticate success, global_id 144913 2024-09-10T16:36:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f937a38a640 10 monclient: _renew_subs 2024-09-10T16:36:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f937a38a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:42.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f937a38a640 1 -- 172.21.15.81:0/3469322394 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f93741311c0 con 0x7f937409ca10 2024-09-10T16:36:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f937a38a640 10 monclient: _renew_subs 2024-09-10T16:36:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f937a38a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f937a38a640 1 -- 172.21.15.81:0/3469322394 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7f937409ee80 con 0x7f937409ca10 2024-09-10T16:36:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f936c004aa0 con 0x7f937409ca10 2024-09-10T16:36:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f936c004f90 con 0x7f937409ca10 2024-09-10T16:36:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 10 monclient: dump: 2024-09-10T16:36:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.864 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:42.865 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f93727fc640 4 set_mon_vals no callback set 2024-09-10T16:36:42.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f937a38a640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f937a38a640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f937a38a640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f937a38a640 1 -- 172.21.15.81:0/3469322394 --> v1:172.21.15.81:6791/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93740008e0 con 0x7f937409ca10 2024-09-10T16:36:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f936c010ea0 con 0x7f937409ca10 2024-09-10T16:36:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7f936c04ada0 con 0x7f937409ca10 2024-09-10T16:36:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.843+0000 7f93737fe640 10 monclient: get_auth_request con 0x7f936003d650 auth_method 0 2024-09-10T16:36:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.847+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f936c016ca0 con 0x7f937409ca10 2024-09-10T16:36:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.847+0000 7f9370ff9640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:42.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:42.847+0000 7f9370ff9640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:43.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.011+0000 7f937a38a640 1 -- 172.21.15.81:0/3469322394 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f93740aa040 con 0x7f936003d650 2024-09-10T16:36:43.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.011+0000 7f9370ff9640 1 -- 172.21.15.81:0/3469322394 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (unknown 3526570807 0 0) 0x7f93740aa040 con 0x7f936003d650 2024-09-10T16:36:43.013 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2024-09-10T16:36:43.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.015+0000 7f937a38a640 1 -- 172.21.15.81:0/3469322394 >> v1:172.21.15.189:6812/1108603242 conn(0x7f936003d650 legacy=0x7f936003fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.015+0000 7f937a38a640 10 monclient: shutdown 2024-09-10T16:36:43.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.015+0000 7f937a38a640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:43.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.015+0000 7f937a38a640 1 -- 172.21.15.81:0/3469322394 >> v1:172.21.15.81:6791/0 conn(0x7f937409ca10 legacy=0x7f93741303a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.015+0000 7f937a38a640 1 -- 172.21.15.81:0/3469322394 shutdown_connections 2024-09-10T16:36:43.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.015+0000 7f937a38a640 1 -- 172.21.15.81:0/3469322394 >> 172.21.15.81:0/3469322394 conn(0x7f937406dc90 msgr2=0x7f93740a8070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:43.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.015+0000 7f937a38a640 1 -- 172.21.15.81:0/3469322394 shutdown_connections 2024-09-10T16:36:43.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.015+0000 7f937a38a640 1 -- 172.21.15.81:0/3469322394 wait complete. 2024-09-10T16:36:43.032 INFO:tasks.ceph:Scrubbing osd.4 2024-09-10T16:36:43.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-10T16:36:43.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 10 monclient: get_monmap_and_config 2024-09-10T16:36:43.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 10 monclient: build_initial_monmap 2024-09-10T16:36:43.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 10 monclient: monmap: 2024-09-10T16:36:43.145 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:43.145 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.145 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:43.146867+0000 2024-09-10T16:36:43.145 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:43.146867+0000 2024-09-10T16:36:43.145 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:43.146 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.146 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:43.146 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:43.146 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:43.146 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:43.146 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:43.146 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:43.146 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:43.146 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:43.146 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:43.146 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 1 Processor -- start 2024-09-10T16:36:43.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 1 -- start start 2024-09-10T16:36:43.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 10 monclient: init 2024-09-10T16:36:43.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:43.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 10 monclient: _add_conns ranks=[6,2,5,4,7,1,3,8,0] 2024-09-10T16:36:43.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 10 monclient(hunting): picked mon.noname-d con 0x7f7334138d90 addr v1:172.21.15.81:6792/0 2024-09-10T16:36:43.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 10 monclient(hunting): picked mon.noname-b con 0x7f73340a5db0 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:43.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 10 monclient(hunting): picked mon.noname-h con 0x7f733413f830 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:43.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f733409dbc0 con 0x7f73340a5db0 2024-09-10T16:36:43.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7334139a70 con 0x7f733413f830 2024-09-10T16:36:43.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f733409de30 con 0x7f7334138d90 2024-09-10T16:36:43.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:43.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 10 monclient(hunting): authenticate will time out at 1370.546392s 2024-09-10T16:36:43.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f7339353640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f7334138d90 0x7f73340a56a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:40238/0 (socket says 172.21.15.81:40238) 2024-09-10T16:36:43.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f7339353640 1 -- 172.21.15.81:0/1060364318 learned_addr learned my addr 172.21.15.81:0/1060364318 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:43.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 1 -- 172.21.15.81:0/1060364318 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 72550126 0 0) 0x7f733409dbc0 con 0x7f73340a5db0 2024-09-10T16:36:43.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient(hunting): my global_id is 145064 2024-09-10T16:36:43.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 1 -- 172.21.15.81:0/1060364318 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7320003530 con 0x7f73340a5db0 2024-09-10T16:36:43.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 1 -- 172.21.15.81:0/1060364318 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838374584 0 0) 0x7f733409de30 con 0x7f7334138d90 2024-09-10T16:36:43.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient(hunting): my global_id is 144834 2024-09-10T16:36:43.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 1 -- 172.21.15.81:0/1060364318 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f733409dbc0 con 0x7f7334138d90 2024-09-10T16:36:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 1 -- 172.21.15.81:0/1060364318 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1722243930 0 0) 0x7f7320003530 con 0x7f73340a5db0 2024-09-10T16:36:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 1 -- 172.21.15.81:0/1060364318 >> v1:172.21.15.81:6792/0 conn(0x7f7334138d90 legacy=0x7f73340a56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 1 -- 172.21.15.81:0/1060364318 >> v1:172.21.15.189:6791/0 conn(0x7f733413f830 legacy=0x7f7334141c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient: _finish_hunting 0 2024-09-10T16:36:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 1 monclient: found mon.noname-b 2024-09-10T16:36:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:36:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 1 -- 172.21.15.81:0/1060364318 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f733409e110 con 0x7f73340a5db0 2024-09-10T16:36:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient: _finish_auth 0 2024-09-10T16:36:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient: _check_auth_tickets 2024-09-10T16:36:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 5 monclient: authenticate success, global_id 145064 2024-09-10T16:36:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:43.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 1 -- 172.21.15.81:0/1060364318 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7324001770 con 0x7f73340a5db0 2024-09-10T16:36:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient: dump: 2024-09-10T16:36:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.156 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.157 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 1 -- 172.21.15.81:0/1060364318 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7324001990 con 0x7f73340a5db0 2024-09-10T16:36:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 1 -- 172.21.15.81:0/1060364318 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7324003960 con 0x7f73340a5db0 2024-09-10T16:36:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f732bfff640 10 monclient: dump: 2024-09-10T16:36:43.157 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.158 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.159 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 4 set_mon_vals no callback set 2024-09-10T16:36:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 10 monclient: shutdown 2024-09-10T16:36:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 1 -- 172.21.15.81:0/1060364318 >> v1:172.21.15.81:6790/0 conn(0x7f73340a5db0 legacy=0x7f733413e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 1 -- 172.21.15.81:0/1060364318 shutdown_connections 2024-09-10T16:36:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 1 -- 172.21.15.81:0/1060364318 >> 172.21.15.81:0/1060364318 conn(0x7f733406dd20 msgr2=0x7f73340abb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 1 -- 172.21.15.81:0/1060364318 shutdown_connections 2024-09-10T16:36:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.143+0000 7f733b5b7640 1 -- 172.21.15.81:0/1060364318 wait complete. 2024-09-10T16:36:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient: build_initial_monmap 2024-09-10T16:36:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient: monmap: 2024-09-10T16:36:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:43.159 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:43.160 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:43.160 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 1 Processor -- start 2024-09-10T16:36:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 1 -- start start 2024-09-10T16:36:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient: init 2024-09-10T16:36:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient: _add_conns ranks=[0,3,1,6,2,8,7,5,4] 2024-09-10T16:36:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient(hunting): picked mon.noname-a con 0x7f73340a5db0 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient(hunting): picked mon.noname-g con 0x7f7334138d90 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient(hunting): picked mon.noname-f con 0x7f733413f830 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73340a0d60 con 0x7f73340a5db0 2024-09-10T16:36:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f733409f450 con 0x7f733413f830 2024-09-10T16:36:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f73340a1040 con 0x7f7334138d90 2024-09-10T16:36:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:43.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient(hunting): authenticate will time out at 1370.549304s 2024-09-10T16:36:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7339353640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f73340a5db0 0x7f733409e630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37452/0 (socket says 172.21.15.81:37452) 2024-09-10T16:36:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7339353640 1 -- 172.21.15.81:0/1267989136 learned_addr learned my addr 172.21.15.81:0/1267989136 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1892764203 0 0) 0x7f73340a0d60 con 0x7f73340a5db0 2024-09-10T16:36:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient(hunting): my global_id is 6633 2024-09-10T16:36:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7318003530 con 0x7f73340a5db0 2024-09-10T16:36:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3907861853 0 0) 0x7f7318003530 con 0x7f73340a5db0 2024-09-10T16:36:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f73340a0d60 con 0x7f73340a5db0 2024-09-10T16:36:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7330001bc0 con 0x7f73340a5db0 2024-09-10T16:36:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient(hunting): got monmap 1 from mon.noname-a (according to old e1) 2024-09-10T16:36:43.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient(hunting): dump: 2024-09-10T16:36:43.163 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.163 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.163 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.163 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.163 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.163 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.163 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.163 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.163 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.163 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.163 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.163 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.163 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.163 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.164 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 325987385 0 0) 0x7f73340a1040 con 0x7f7334138d90 2024-09-10T16:36:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient(hunting): my global_id is 164226 2024-09-10T16:36:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7318003530 con 0x7f7334138d90 2024-09-10T16:36:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 <== mon.0 v1:172.21.15.81:6789/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2972449784 0 0) 0x7f73340a0d60 con 0x7f73340a5db0 2024-09-10T16:36:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 >> v1:172.21.15.189:6790/0 conn(0x7f7334138d90 legacy=0x7f733409ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 >> v1:172.21.15.189:6789/0 conn(0x7f733413f830 legacy=0x7f73341d5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:36:43.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 monclient: found mon.a 2024-09-10T16:36:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 --> v1:172.21.15.81:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f733413f2f0 con 0x7f73340a5db0 2024-09-10T16:36:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient: _finish_auth 0 2024-09-10T16:36:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:36:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 5 monclient: authenticate success, global_id 6633 2024-09-10T16:36:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient: _renew_subs 2024-09-10T16:36:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 1 -- 172.21.15.81:0/1267989136 --> v1:172.21.15.81:6789/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f733413ef10 con 0x7f73340a5db0 2024-09-10T16:36:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient: _renew_subs 2024-09-10T16:36:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 1 -- 172.21.15.81:0/1267989136 --> v1:172.21.15.81:6789/0 -- mon_subscribe({osdmap=0}) -- 0x7f733413e970 con 0x7f73340a5db0 2024-09-10T16:36:43.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 <== mon.0 v1:172.21.15.81:6789/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7330004aa0 con 0x7f73340a5db0 2024-09-10T16:36:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 <== mon.0 v1:172.21.15.81:6789/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7330004f90 con 0x7f73340a5db0 2024-09-10T16:36:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f732b7fe640 4 set_mon_vals no callback set 2024-09-10T16:36:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient: dump: 2024-09-10T16:36:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.166 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.167 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 10 monclient: _send_mon_message to mon.a at v1:172.21.15.81:6789/0 2024-09-10T16:36:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f733b5b7640 1 -- 172.21.15.81:0/1267989136 --> v1:172.21.15.81:6789/0 -- mon_get_version(what=osdmap handle=1) -- 0x7f7314000f90 con 0x7f73340a5db0 2024-09-10T16:36:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 <== mon.0 v1:172.21.15.81:6789/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f7330010ea0 con 0x7f73340a5db0 2024-09-10T16:36:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 <== mon.0 v1:172.21.15.81:6789/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7f733004adb0 con 0x7f73340a5db0 2024-09-10T16:36:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 --> v1:172.21.15.189:6808/1206180154 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7318047910 con 0x7f7318043ca0 2024-09-10T16:36:43.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 <== mon.0 v1:172.21.15.81:6789/0 9 ==== mon_get_version_reply(handle=1 version=325) ==== 24+0+0 (unknown 690020996 0 0) 0x7f733004b1f0 con 0x7f73340a5db0 2024-09-10T16:36:43.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7329ffb640 10 monclient: handle_get_version_reply finishing 1 version 325 2024-09-10T16:36:43.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7338b52640 10 monclient: get_auth_request con 0x7f731803d0a0 auth_method 0 2024-09-10T16:36:43.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.147+0000 7f7339b54640 10 monclient: get_auth_request con 0x7f7318043ca0 auth_method 0 2024-09-10T16:36:43.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.151+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 <== osd.4 v1:172.21.15.189:6808/1206180154 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7f7318047910 con 0x7f7318043ca0 2024-09-10T16:36:43.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.163+0000 7f733b5b7640 1 -- 172.21.15.81:0/1267989136 --> v1:172.21.15.189:6808/1206180154 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7314002ce0 con 0x7f7318043ca0 2024-09-10T16:36:43.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.163+0000 7f7329ffb640 1 -- 172.21.15.81:0/1267989136 <== osd.4 v1:172.21.15.189:6808/1206180154 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7f7314002ce0 con 0x7f7318043ca0 2024-09-10T16:36:43.169 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:43.169 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T16:36:43.169 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:43.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.163+0000 7f733b5b7640 1 -- 172.21.15.81:0/1267989136 >> v1:172.21.15.189:6808/1206180154 conn(0x7f7318043ca0 legacy=0x7f73180460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.163+0000 7f733b5b7640 1 -- 172.21.15.81:0/1267989136 >> v1:172.21.15.189:6812/1108603242 conn(0x7f731803d0a0 legacy=0x7f731803f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.163+0000 7f733b5b7640 10 monclient: shutdown 2024-09-10T16:36:43.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.163+0000 7f733b5b7640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:43.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.163+0000 7f733b5b7640 1 -- 172.21.15.81:0/1267989136 >> v1:172.21.15.81:6789/0 conn(0x7f73340a5db0 legacy=0x7f733409e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.163+0000 7f7339b54640 1 -- 172.21.15.81:0/1267989136 reap_dead start 2024-09-10T16:36:43.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.163+0000 7f733b5b7640 1 -- 172.21.15.81:0/1267989136 shutdown_connections 2024-09-10T16:36:43.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.163+0000 7f733b5b7640 1 -- 172.21.15.81:0/1267989136 >> 172.21.15.81:0/1267989136 conn(0x7f733406dd20 msgr2=0x7f7334137740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:43.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.167+0000 7f733b5b7640 1 -- 172.21.15.81:0/1267989136 shutdown_connections 2024-09-10T16:36:43.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.167+0000 7f733b5b7640 1 -- 172.21.15.81:0/1267989136 wait complete. 2024-09-10T16:36:43.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-10T16:36:43.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.291+0000 7f52810da640 10 monclient: get_monmap_and_config 2024-09-10T16:36:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.291+0000 7f52810da640 10 monclient: build_initial_monmap 2024-09-10T16:36:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.291+0000 7f52810da640 10 monclient: monmap: 2024-09-10T16:36:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:43.297470+0000 2024-09-10T16:36:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:43.297470+0000 2024-09-10T16:36:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:43.296 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:43.297 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:43.297 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 Processor -- start 2024-09-10T16:36:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 -- start start 2024-09-10T16:36:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient: init 2024-09-10T16:36:43.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient: _add_conns ranks=[8,2,3,4,6,5,0,7,1] 2024-09-10T16:36:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient(hunting): picked mon.noname-e con 0x7f527c0a0a90 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient(hunting): picked mon.noname-b con 0x7f527c0a35f0 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient(hunting): picked mon.noname-g con 0x7f527c0a3a40 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f527c09df70 con 0x7f527c0a35f0 2024-09-10T16:36:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f527c09fa30 con 0x7f527c0a3a40 2024-09-10T16:36:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f527c09fd10 con 0x7f527c0a0a90 2024-09-10T16:36:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient(hunting): authenticate will time out at 1370.696693s 2024-09-10T16:36:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527ad9d640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f527c0a0a90 0x7f527c0a2ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35268/0 (socket says 172.21.15.81:35268) 2024-09-10T16:36:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527ad9d640 1 -- 172.21.15.81:0/259539265 learned_addr learned my addr 172.21.15.81:0/259539265 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527259c640 1 --1- 172.21.15.81:0/259539265 >> v1:172.21.15.81:6790/0 conn(0x7f527c0a35f0 0x7f527c13c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:34354/0 (socket says 172.21.15.81:34354) 2024-09-10T16:36:43.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 1 -- 172.21.15.81:0/259539265 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2360528936 0 0) 0x7f527c09fd10 con 0x7f527c0a0a90 2024-09-10T16:36:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient(hunting): my global_id is 6731 2024-09-10T16:36:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 1 -- 172.21.15.81:0/259539265 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5268003530 con 0x7f527c0a0a90 2024-09-10T16:36:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 1 -- 172.21.15.81:0/259539265 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1572394896 0 0) 0x7f527c09df70 con 0x7f527c0a35f0 2024-09-10T16:36:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient(hunting): my global_id is 145073 2024-09-10T16:36:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 1 -- 172.21.15.81:0/259539265 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f527c09fd10 con 0x7f527c0a35f0 2024-09-10T16:36:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 1 -- 172.21.15.81:0/259539265 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4073160439 0 0) 0x7f5268003530 con 0x7f527c0a0a90 2024-09-10T16:36:43.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 1 -- 172.21.15.81:0/259539265 >> v1:172.21.15.189:6790/0 conn(0x7f527c0a3a40 legacy=0x7f527c13fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 1 -- 172.21.15.81:0/259539265 >> v1:172.21.15.81:6790/0 conn(0x7f527c0a35f0 legacy=0x7f527c13c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient: _finish_hunting 0 2024-09-10T16:36:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 1 monclient: found mon.noname-e 2024-09-10T16:36:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:36:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 1 -- 172.21.15.81:0/259539265 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527c09fff0 con 0x7f527c0a0a90 2024-09-10T16:36:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient: _finish_auth 0 2024-09-10T16:36:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient: _check_auth_tickets 2024-09-10T16:36:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 1 -- 172.21.15.81:0/259539265 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f526c001840 con 0x7f527c0a0a90 2024-09-10T16:36:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 5 monclient: authenticate success, global_id 6731 2024-09-10T16:36:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:43.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:36:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient: dump: 2024-09-10T16:36:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.308 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.309 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 1 -- 172.21.15.81:0/259539265 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f526c001a60 con 0x7f527c0a0a90 2024-09-10T16:36:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 4 set_mon_vals no callback set 2024-09-10T16:36:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 1 -- 172.21.15.81:0/259539265 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f526c004bf0 con 0x7f527c0a0a90 2024-09-10T16:36:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:43.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527a59c640 10 monclient: dump: 2024-09-10T16:36:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.310 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.311 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient: shutdown 2024-09-10T16:36:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 -- 172.21.15.81:0/259539265 >> v1:172.21.15.81:6793/0 conn(0x7f527c0a0a90 legacy=0x7f527c0a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 -- 172.21.15.81:0/259539265 shutdown_connections 2024-09-10T16:36:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 -- 172.21.15.81:0/259539265 >> 172.21.15.81:0/259539265 conn(0x7f527c0a3fd0 msgr2=0x7f527c0a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 -- 172.21.15.81:0/259539265 shutdown_connections 2024-09-10T16:36:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 -- 172.21.15.81:0/259539265 wait complete. 2024-09-10T16:36:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient: build_initial_monmap 2024-09-10T16:36:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient: monmap: 2024-09-10T16:36:43.311 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:43.312 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:43.313 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 Processor -- start 2024-09-10T16:36:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 -- start start 2024-09-10T16:36:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient: init 2024-09-10T16:36:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient: _add_conns ranks=[3,7,8,2,0,4,6,1,5] 2024-09-10T16:36:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient(hunting): picked mon.noname-g con 0x7f527c0a0a90 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient(hunting): picked mon.noname-i con 0x7f527c0a35f0 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient(hunting): picked mon.noname-e con 0x7f527c0a3a40 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f527c1b24f0 con 0x7f527c0a0a90 2024-09-10T16:36:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f527c1b20c0 con 0x7f527c0a35f0 2024-09-10T16:36:43.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f527c0a6b00 con 0x7f527c0a3a40 2024-09-10T16:36:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f52810da640 10 monclient(hunting): authenticate will time out at 1370.699712s 2024-09-10T16:36:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527b59e640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f527c0a3a40 0x7f527c1d3b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:35284/0 (socket says 172.21.15.81:35284) 2024-09-10T16:36:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f527b59e640 1 -- 172.21.15.81:0/2522349467 learned_addr learned my addr 172.21.15.81:0/2522349467 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.295+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595588827 0 0) 0x7f527c0a6b00 con 0x7f527c0a3a40 2024-09-10T16:36:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient(hunting): my global_id is 6740 2024-09-10T16:36:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f525c003560 con 0x7f527c0a3a40 2024-09-10T16:36:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1289663614 0 0) 0x7f525c003560 con 0x7f527c0a3a40 2024-09-10T16:36:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f527c0a6b00 con 0x7f527c0a3a40 2024-09-10T16:36:43.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f5274001e40 con 0x7f527c0a3a40 2024-09-10T16:36:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:36:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient(hunting): dump: 2024-09-10T16:36:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.316 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4214257366 0 0) 0x7f527c1b24f0 con 0x7f527c0a0a90 2024-09-10T16:36:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient(hunting): my global_id is 164244 2024-09-10T16:36:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f525c003560 con 0x7f527c0a0a90 2024-09-10T16:36:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 1245593754 0 0) 0x7f527c0a6b00 con 0x7f527c0a3a40 2024-09-10T16:36:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 >> v1:172.21.15.189:6792/0 conn(0x7f527c0a35f0 legacy=0x7f527c1b19b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 >> v1:172.21.15.189:6790/0 conn(0x7f527c0a0a90 legacy=0x7f527c1b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient: _finish_hunting 0 2024-09-10T16:36:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 monclient: found mon.e 2024-09-10T16:36:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:36:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527c1b4850 con 0x7f527c0a3a40 2024-09-10T16:36:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient: _finish_auth 0 2024-09-10T16:36:43.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient: _check_auth_tickets 2024-09-10T16:36:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f52810da640 5 monclient: authenticate success, global_id 6740 2024-09-10T16:36:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f52810da640 10 monclient: _renew_subs 2024-09-10T16:36:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f52810da640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:36:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f52810da640 1 -- 172.21.15.81:0/2522349467 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f527c1b2bd0 con 0x7f527c0a3a40 2024-09-10T16:36:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f52810da640 10 monclient: _renew_subs 2024-09-10T16:36:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f52810da640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:36:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f52810da640 1 -- 172.21.15.81:0/2522349467 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f527c0743b0 con 0x7f527c0a3a40 2024-09-10T16:36:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f5274003c50 con 0x7f527c0a3a40 2024-09-10T16:36:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f52740041c0 con 0x7f527c0a3a40 2024-09-10T16:36:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5279d9b640 4 set_mon_vals no callback set 2024-09-10T16:36:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 10 monclient: dump: 2024-09-10T16:36:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.320 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.320 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.320 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.320 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.320 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f52810da640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:43.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f52810da640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:43.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f52810da640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:36:43.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f52810da640 1 -- 172.21.15.81:0/2522349467 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5260005090 con 0x7f527c0a3a40 2024-09-10T16:36:43.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f5274004360 con 0x7f527c0a3a40 2024-09-10T16:36:43.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7f527404b1b0 con 0x7f527c0a3a40 2024-09-10T16:36:43.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.299+0000 7f527ad9d640 10 monclient: get_auth_request con 0x7f525c03cff0 auth_method 0 2024-09-10T16:36:43.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.303+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 <== mon.8 v1:172.21.15.81:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f5274017010 con 0x7f527c0a3a40 2024-09-10T16:36:43.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.303+0000 7f5273fff640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:43.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.303+0000 7f5273fff640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.471+0000 7f52810da640 1 -- 172.21.15.81:0/2522349467 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f5260000ba0 con 0x7f525c03cff0 2024-09-10T16:36:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.471+0000 7f5273fff640 1 -- 172.21.15.81:0/2522349467 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (unknown 3782719169 0 0) 0x7f5260000ba0 con 0x7f525c03cff0 2024-09-10T16:36:43.476 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2024-09-10T16:36:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.475+0000 7f52810da640 1 -- 172.21.15.81:0/2522349467 >> v1:172.21.15.189:6812/1108603242 conn(0x7f525c03cff0 legacy=0x7f525c03f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.475+0000 7f52810da640 10 monclient: shutdown 2024-09-10T16:36:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.475+0000 7f52810da640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.475+0000 7f52810da640 1 -- 172.21.15.81:0/2522349467 >> v1:172.21.15.81:6793/0 conn(0x7f527c0a3a40 legacy=0x7f527c1d3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.475+0000 7f52810da640 1 -- 172.21.15.81:0/2522349467 shutdown_connections 2024-09-10T16:36:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.475+0000 7f52810da640 1 -- 172.21.15.81:0/2522349467 >> 172.21.15.81:0/2522349467 conn(0x7f527c0a3fd0 msgr2=0x7f527c09a850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.475+0000 7f52810da640 1 -- 172.21.15.81:0/2522349467 shutdown_connections 2024-09-10T16:36:43.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.475+0000 7f52810da640 1 -- 172.21.15.81:0/2522349467 wait complete. 2024-09-10T16:36:43.493 INFO:tasks.ceph:Scrubbing osd.5 2024-09-10T16:36:43.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-10T16:36:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.615+0000 7fa549c79640 10 monclient: get_monmap_and_config 2024-09-10T16:36:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.615+0000 7fa549c79640 10 monclient: build_initial_monmap 2024-09-10T16:36:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.615+0000 7fa549c79640 10 monclient: monmap: 2024-09-10T16:36:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:43.619889+0000 2024-09-10T16:36:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:43.619889+0000 2024-09-10T16:36:43.618 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:43.619 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.619 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:43.619 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:43.619 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:43.619 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:43.619 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:43.619 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:43.619 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:43.619 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:43.619 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:43.619 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.615+0000 7fa549c79640 1 Processor -- start 2024-09-10T16:36:43.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.615+0000 7fa549c79640 1 -- start start 2024-09-10T16:36:43.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.615+0000 7fa549c79640 10 monclient: init 2024-09-10T16:36:43.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:43.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient: _add_conns ranks=[5,4,3,6,7,8,0,1,2] 2024-09-10T16:36:43.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient(hunting): picked mon.noname-h con 0x7fa544136ea0 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:43.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient(hunting): picked mon.noname-c con 0x7fa5440727f0 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:43.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient(hunting): picked mon.noname-g con 0x7fa54413d450 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:43.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa544073cc0 con 0x7fa54413d450 2024-09-10T16:36:43.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa544073420 con 0x7fa5440727f0 2024-09-10T16:36:43.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa544073700 con 0x7fa544136ea0 2024-09-10T16:36:43.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:43.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient(hunting): authenticate will time out at 1371.020185s 2024-09-10T16:36:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa53bfff640 1 --1- >> v1:172.21.15.81:6791/0 conn(0x7fa5440727f0 0x7fa54413bd30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6791/0 says I am v1:172.21.15.81:53616/0 (socket says 172.21.15.81:53616) 2024-09-10T16:36:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa53bfff640 1 -- 172.21.15.81:0/4290722358 learned_addr learned my addr 172.21.15.81:0/4290722358 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 1 -- 172.21.15.81:0/4290722358 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2060039105 0 0) 0x7fa544073420 con 0x7fa5440727f0 2024-09-10T16:36:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient(hunting): my global_id is 144922 2024-09-10T16:36:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 1 -- 172.21.15.81:0/4290722358 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa530003530 con 0x7fa5440727f0 2024-09-10T16:36:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 1 -- 172.21.15.81:0/4290722358 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2950524692 0 0) 0x7fa530003530 con 0x7fa5440727f0 2024-09-10T16:36:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 1 -- 172.21.15.81:0/4290722358 >> v1:172.21.15.189:6791/0 conn(0x7fa544136ea0 legacy=0x7fa544137280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 1 -- 172.21.15.81:0/4290722358 >> v1:172.21.15.189:6790/0 conn(0x7fa54413d450 legacy=0x7fa54413f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:36:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 1 monclient: found mon.noname-c 2024-09-10T16:36:43.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient: _send_mon_message to mon.noname-c at v1:172.21.15.81:6791/0 2024-09-10T16:36:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 1 -- 172.21.15.81:0/4290722358 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5441369b0 con 0x7fa5440727f0 2024-09-10T16:36:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient: _finish_auth 0 2024-09-10T16:36:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:36:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 1 -- 172.21.15.81:0/4290722358 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa52c001840 con 0x7fa5440727f0 2024-09-10T16:36:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 5 monclient: authenticate success, global_id 144922 2024-09-10T16:36:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:36:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient: dump: 2024-09-10T16:36:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.628 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.629 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.629 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.629 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.629 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.629 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.629 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.629 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.629 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.629 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.629 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.629 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.629 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.630 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 1 -- 172.21.15.81:0/4290722358 <== mon.4 v1:172.21.15.81:6791/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa52c001a60 con 0x7fa5440727f0 2024-09-10T16:36:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 4 set_mon_vals no callback set 2024-09-10T16:36:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 1 -- 172.21.15.81:0/4290722358 <== mon.4 v1:172.21.15.81:6791/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa52c001d50 con 0x7fa5440727f0 2024-09-10T16:36:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa542ffd640 10 monclient: dump: 2024-09-10T16:36:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.630 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.631 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.631 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient: shutdown 2024-09-10T16:36:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 -- 172.21.15.81:0/4290722358 >> v1:172.21.15.81:6791/0 conn(0x7fa5440727f0 legacy=0x7fa54413bd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 -- 172.21.15.81:0/4290722358 shutdown_connections 2024-09-10T16:36:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 -- 172.21.15.81:0/4290722358 >> 172.21.15.81:0/4290722358 conn(0x7fa5440a6410 msgr2=0x7fa5440a67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 -- 172.21.15.81:0/4290722358 shutdown_connections 2024-09-10T16:36:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 -- 172.21.15.81:0/4290722358 wait complete. 2024-09-10T16:36:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient: build_initial_monmap 2024-09-10T16:36:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient: monmap: 2024-09-10T16:36:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:43.632 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 Processor -- start 2024-09-10T16:36:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 -- start start 2024-09-10T16:36:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient: init 2024-09-10T16:36:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient: _add_conns ranks=[6,3,4,2,0,5,8,7,1] 2024-09-10T16:36:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient(hunting): picked mon.noname-d con 0x7fa544136ea0 addr v1:172.21.15.81:6792/0 2024-09-10T16:36:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient(hunting): picked mon.noname-g con 0x7fa54413d450 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient(hunting): picked mon.noname-c con 0x7fa544130cf0 addr v1:172.21.15.81:6791/0 2024-09-10T16:36:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa544140b60 con 0x7fa54413d450 2024-09-10T16:36:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 -- --> v1:172.21.15.81:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa54412d500 con 0x7fa544130cf0 2024-09-10T16:36:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa54412dc70 con 0x7fa544136ea0 2024-09-10T16:36:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient(hunting): authenticate will time out at 1371.022919s 2024-09-10T16:36:43.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa5437fe640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7fa544136ea0 0x7fa544132840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:43592/0 (socket says 172.21.15.81:43592) 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa5437fe640 1 -- 172.21.15.81:0/3075073903 learned_addr learned my addr 172.21.15.81:0/3075073903 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== mon.4 v1:172.21.15.81:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4145520110 0 0) 0x7fa54412d500 con 0x7fa544130cf0 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): my global_id is 144931 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 --> v1:172.21.15.81:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa524003560 con 0x7fa544130cf0 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4010992811 0 0) 0x7fa54412dc70 con 0x7fa544136ea0 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): my global_id is 144843 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa54412d500 con 0x7fa544136ea0 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== mon.4 v1:172.21.15.81:6791/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3635680374 0 0) 0x7fa524003560 con 0x7fa544130cf0 2024-09-10T16:36:43.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 --> v1:172.21.15.81:6791/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa54412dc70 con 0x7fa544130cf0 2024-09-10T16:36:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== mon.4 v1:172.21.15.81:6791/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa53c001cd0 con 0x7fa544130cf0 2024-09-10T16:36:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): got monmap 1 from mon.noname-c (according to old e1) 2024-09-10T16:36:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): dump: 2024-09-10T16:36:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.636 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.637 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2562988178 0 0) 0x7fa54412d500 con 0x7fa544136ea0 2024-09-10T16:36:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7fa524003560 con 0x7fa544136ea0 2024-09-10T16:36:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 535790623 0 0) 0x7fa5441369b0 con 0x7fa54413d450 2024-09-10T16:36:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): my global_id is 164262 2024-09-10T16:36:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa54412d500 con 0x7fa54413d450 2024-09-10T16:36:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa534001b60 con 0x7fa544136ea0 2024-09-10T16:36:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): got monmap 1 from mon.d (according to old e1) 2024-09-10T16:36:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient(hunting): dump: 2024-09-10T16:36:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.638 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.639 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== mon.4 v1:172.21.15.81:6791/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3720283118 0 0) 0x7fa54412dc70 con 0x7fa544130cf0 2024-09-10T16:36:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 >> v1:172.21.15.81:6792/0 conn(0x7fa544136ea0 legacy=0x7fa544132840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 >> v1:172.21.15.189:6790/0 conn(0x7fa54413d450 legacy=0x7fa544132f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient: _finish_hunting 0 2024-09-10T16:36:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 monclient: found mon.c 2024-09-10T16:36:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 --> v1:172.21.15.81:6791/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa54412d7e0 con 0x7fa544130cf0 2024-09-10T16:36:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient: _finish_auth 0 2024-09-10T16:36:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient: _check_auth_tickets 2024-09-10T16:36:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 5 monclient: authenticate success, global_id 144931 2024-09-10T16:36:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient: _renew_subs 2024-09-10T16:36:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 -- 172.21.15.81:0/3075073903 --> v1:172.21.15.81:6791/0 -- mon_subscribe({mgrmap=0+}) -- 0x7fa5440a8c20 con 0x7fa544130cf0 2024-09-10T16:36:43.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient: _renew_subs 2024-09-10T16:36:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa549c79640 1 -- 172.21.15.81:0/3075073903 --> v1:172.21.15.81:6791/0 -- mon_subscribe({osdmap=0}) -- 0x7fa54412d220 con 0x7fa544130cf0 2024-09-10T16:36:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== mon.4 v1:172.21.15.81:6791/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7fa53c001ff0 con 0x7fa544130cf0 2024-09-10T16:36:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== mon.4 v1:172.21.15.81:6791/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7fa53c003f70 con 0x7fa544130cf0 2024-09-10T16:36:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa5427fc640 4 set_mon_vals no callback set 2024-09-10T16:36:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-10T16:36:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.619+0000 7fa540ff9640 10 monclient: dump: 2024-09-10T16:36:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.623+0000 7fa549c79640 10 monclient: _send_mon_message to mon.c at v1:172.21.15.81:6791/0 2024-09-10T16:36:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.623+0000 7fa549c79640 1 -- 172.21.15.81:0/3075073903 --> v1:172.21.15.81:6791/0 -- mon_get_version(what=osdmap handle=1) -- 0x7fa528000f90 con 0x7fa544130cf0 2024-09-10T16:36:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.623+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== mon.4 v1:172.21.15.81:6791/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7fa53c004110 con 0x7fa544130cf0 2024-09-10T16:36:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.623+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== mon.4 v1:172.21.15.81:6791/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7fa53c049d50 con 0x7fa544130cf0 2024-09-10T16:36:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.623+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 --> v1:172.21.15.189:6800/1814191784 -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa524048030 con 0x7fa5240443c0 2024-09-10T16:36:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.623+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== mon.4 v1:172.21.15.81:6791/0 9 ==== mon_get_version_reply(handle=1 version=325) ==== 24+0+0 (unknown 690020996 0 0) 0x7fa53c04a160 con 0x7fa544130cf0 2024-09-10T16:36:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.623+0000 7fa540ff9640 10 monclient: handle_get_version_reply finishing 1 version 325 2024-09-10T16:36:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.623+0000 7fa5437fe640 10 monclient: get_auth_request con 0x7fa52403d830 auth_method 0 2024-09-10T16:36:43.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.623+0000 7fa53bfff640 10 monclient: get_auth_request con 0x7fa5240443c0 auth_method 0 2024-09-10T16:36:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.623+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== osd.5 v1:172.21.15.189:6800/1814191784 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (unknown 0 0 1302949928) 0x7fa524048030 con 0x7fa5240443c0 2024-09-10T16:36:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.635+0000 7fa549c79640 1 -- 172.21.15.81:0/3075073903 --> v1:172.21.15.189:6800/1814191784 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa528002ce0 con 0x7fa5240443c0 2024-09-10T16:36:43.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.639+0000 7fa540ff9640 1 -- 172.21.15.81:0/3075073903 <== osd.5 v1:172.21.15.189:6800/1814191784 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (unknown 0 0 119112422) 0x7fa528002ce0 con 0x7fa5240443c0 2024-09-10T16:36:43.644 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-10T16:36:43.644 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-10T16:36:43.644 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-10T16:36:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.639+0000 7fa549c79640 1 -- 172.21.15.81:0/3075073903 >> v1:172.21.15.189:6800/1814191784 conn(0x7fa5240443c0 legacy=0x7fa5240467e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.639+0000 7fa549c79640 1 -- 172.21.15.81:0/3075073903 >> v1:172.21.15.189:6812/1108603242 conn(0x7fa52403d830 legacy=0x7fa52403fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.639+0000 7fa549c79640 10 monclient: shutdown 2024-09-10T16:36:43.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.639+0000 7fa549c79640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:43.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.639+0000 7fa549c79640 1 -- 172.21.15.81:0/3075073903 >> v1:172.21.15.81:6791/0 conn(0x7fa544130cf0 legacy=0x7fa5441d3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.639+0000 7fa543fff640 1 -- 172.21.15.81:0/3075073903 reap_dead start 2024-09-10T16:36:43.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.639+0000 7fa549c79640 1 -- 172.21.15.81:0/3075073903 shutdown_connections 2024-09-10T16:36:43.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.639+0000 7fa549c79640 1 -- 172.21.15.81:0/3075073903 >> 172.21.15.81:0/3075073903 conn(0x7fa5440a6410 msgr2=0x7fa544135250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:43.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.639+0000 7fa549c79640 1 -- 172.21.15.81:0/3075073903 shutdown_connections 2024-09-10T16:36:43.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.639+0000 7fa549c79640 1 -- 172.21.15.81:0/3075073903 wait complete. 2024-09-10T16:36:43.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-10T16:36:43.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 10 monclient: get_monmap_and_config 2024-09-10T16:36:43.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 10 monclient: build_initial_monmap 2024-09-10T16:36:43.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 10 monclient: monmap: 2024-09-10T16:36:43.758 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:43.758 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.758 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:43.759926+0000 2024-09-10T16:36:43.758 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:43.759926+0000 2024-09-10T16:36:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:43.759 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:43.759 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 1 Processor -- start 2024-09-10T16:36:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 1 -- start start 2024-09-10T16:36:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 10 monclient: init 2024-09-10T16:36:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 10 monclient: _add_conns ranks=[2,5,1,8,7,3,0,4,6] 2024-09-10T16:36:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 10 monclient(hunting): picked mon.noname-b con 0x7f033c09d440 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 10 monclient(hunting): picked mon.noname-h con 0x7f033c0a39e0 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 10 monclient(hunting): picked mon.noname-f con 0x7f033c0a0900 addr v1:172.21.15.189:6789/0 2024-09-10T16:36:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033c0a37a0 con 0x7f033c0a0900 2024-09-10T16:36:43.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033c074d30 con 0x7f033c09d440 2024-09-10T16:36:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033c09d820 con 0x7f033c0a39e0 2024-09-10T16:36:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f03434d0640 10 monclient(hunting): authenticate will time out at 1371.159397s 2024-09-10T16:36:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f034126c640 1 --1- >> v1:172.21.15.81:6790/0 conn(0x7f033c09d440 0x7f033c09fae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:35732/0 (socket says 172.21.15.81:35732) 2024-09-10T16:36:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f034126c640 1 -- 172.21.15.81:0/2318299789 learned_addr learned my addr 172.21.15.81:0/2318299789 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f033bfff640 1 -- 172.21.15.81:0/2318299789 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1444826080 0 0) 0x7f033c074d30 con 0x7f033c09d440 2024-09-10T16:36:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f033bfff640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f033bfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f033bfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f033bfff640 10 monclient(hunting): my global_id is 145082 2024-09-10T16:36:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.755+0000 7f033bfff640 1 -- 172.21.15.81:0/2318299789 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0324003530 con 0x7f033c09d440 2024-09-10T16:36:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 1 -- 172.21.15.81:0/2318299789 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 6695164 0 0) 0x7f0324003530 con 0x7f033c09d440 2024-09-10T16:36:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 1 -- 172.21.15.81:0/2318299789 >> v1:172.21.15.189:6791/0 conn(0x7f033c0a39e0 legacy=0x7f033c0a01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 1 -- 172.21.15.81:0/2318299789 >> v1:172.21.15.189:6789/0 conn(0x7f033c0a0900 legacy=0x7f033c13e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 10 monclient: _finish_hunting 0 2024-09-10T16:36:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 1 monclient: found mon.noname-b 2024-09-10T16:36:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:36:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 1 -- 172.21.15.81:0/2318299789 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c09e1c0 con 0x7f033c09d440 2024-09-10T16:36:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 10 monclient: _finish_auth 0 2024-09-10T16:36:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 10 monclient: _check_auth_tickets 2024-09-10T16:36:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 1 -- 172.21.15.81:0/2318299789 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0334001bc0 con 0x7f033c09d440 2024-09-10T16:36:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:43.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:43.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 10 monclient: dump: 2024-09-10T16:36:43.770 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.770 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.770 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.770 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.770 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.770 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.770 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.770 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.770 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.771 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.771 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.771 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.771 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.771 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.771 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.771 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 5 monclient: authenticate success, global_id 145082 2024-09-10T16:36:43.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:43.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 1 -- 172.21.15.81:0/2318299789 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f0334001de0 con 0x7f033c09d440 2024-09-10T16:36:43.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:43.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 1 -- 172.21.15.81:0/2318299789 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f03340020d0 con 0x7f033c09d440 2024-09-10T16:36:43.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033bfff640 10 monclient: dump: 2024-09-10T16:36:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.772 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.773 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.773 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.773 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.773 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.773 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:43.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 4 set_mon_vals no callback set 2024-09-10T16:36:43.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient: shutdown 2024-09-10T16:36:43.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:43.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 1 -- 172.21.15.81:0/2318299789 >> v1:172.21.15.81:6790/0 conn(0x7f033c09d440 legacy=0x7f033c09fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 1 -- 172.21.15.81:0/2318299789 shutdown_connections 2024-09-10T16:36:43.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 1 -- 172.21.15.81:0/2318299789 >> 172.21.15.81:0/2318299789 conn(0x7f033c0a3fd0 msgr2=0x7f033c0a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 1 -- 172.21.15.81:0/2318299789 shutdown_connections 2024-09-10T16:36:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 1 -- 172.21.15.81:0/2318299789 wait complete. 2024-09-10T16:36:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient: build_initial_monmap 2024-09-10T16:36:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient: monmap: 2024-09-10T16:36:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:43.774 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:43.775 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 1 Processor -- start 2024-09-10T16:36:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 1 -- start start 2024-09-10T16:36:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient: init 2024-09-10T16:36:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:43.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient: _add_conns ranks=[0,8,2,6,4,3,1,7,5] 2024-09-10T16:36:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient(hunting): picked mon.noname-a con 0x7f033c09d440 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient(hunting): picked mon.noname-e con 0x7f033c0a0900 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient(hunting): picked mon.noname-b con 0x7f033c0a39e0 addr v1:172.21.15.81:6790/0 2024-09-10T16:36:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033c0a5780 con 0x7f033c09d440 2024-09-10T16:36:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033c0a14a0 con 0x7f033c0a39e0 2024-09-10T16:36:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f033c0936f0 con 0x7f033c0a0900 2024-09-10T16:36:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient(hunting): authenticate will time out at 1371.162337s 2024-09-10T16:36:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f034126c640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f033c09d440 0x7f033c09a3d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:55148/0 (socket says 172.21.15.81:55148) 2024-09-10T16:36:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f034126c640 1 -- 172.21.15.81:0/1504020258 learned_addr learned my addr 172.21.15.81:0/1504020258 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0341a6d640 1 --1- 172.21.15.81:0/1504020258 >> v1:172.21.15.81:6790/0 conn(0x7f033c0a39e0 0x7f033c1d21c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6790/0 says I am v1:172.21.15.81:35736/0 (socket says 172.21.15.81:35736) 2024-09-10T16:36:43.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3403878436 0 0) 0x7f033c0a14a0 con 0x7f033c0a39e0 2024-09-10T16:36:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): my global_id is 145091 2024-09-10T16:36:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0328003530 con 0x7f033c0a39e0 2024-09-10T16:36:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4093636894 0 0) 0x7f033c0a5780 con 0x7f033c09d440 2024-09-10T16:36:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): my global_id is 6642 2024-09-10T16:36:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f033c0a14a0 con 0x7f033c09d440 2024-09-10T16:36:43.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1988276029 0 0) 0x7f033c0936f0 con 0x7f033c0a0900 2024-09-10T16:36:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:36:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): my global_id is 6749 2024-09-10T16:36:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f033c0a5780 con 0x7f033c0a0900 2024-09-10T16:36:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2190148631 0 0) 0x7f0328003530 con 0x7f033c0a39e0 2024-09-10T16:36:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 --> v1:172.21.15.81:6790/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f033c0936f0 con 0x7f033c0a39e0 2024-09-10T16:36:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f032c001ac0 con 0x7f033c0a39e0 2024-09-10T16:36:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:36:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): dump: 2024-09-10T16:36:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.778 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.779 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.779 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:43.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 418182530 0 0) 0x7f033c0a14a0 con 0x7f033c09d440 2024-09-10T16:36:43.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f0328003530 con 0x7f033c09d440 2024-09-10T16:36:43.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 3800235522 0 0) 0x7f033c0a5780 con 0x7f033c0a0900 2024-09-10T16:36:43.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f033c0a14a0 con 0x7f033c0a0900 2024-09-10T16:36:43.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0334001b80 con 0x7f033c09d440 2024-09-10T16:36:43.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:43.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:43.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): dump: 2024-09-10T16:36:43.780 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.780 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.780 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.780 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.781 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.781 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.781 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.781 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.781 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.781 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.781 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.781 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.781 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.781 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.781 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.781 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f0330001810 con 0x7f033c0a0900 2024-09-10T16:36:43.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient(hunting): dump: 2024-09-10T16:36:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.782 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.783 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.2 v1:172.21.15.81:6790/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 858851777 0 0) 0x7f033c0936f0 con 0x7f033c0a39e0 2024-09-10T16:36:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 >> v1:172.21.15.81:6793/0 conn(0x7f033c0a0900 legacy=0x7f033c1cea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 >> v1:172.21.15.81:6789/0 conn(0x7f033c09d440 legacy=0x7f033c09a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:36:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 monclient: found mon.b 2024-09-10T16:36:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:43.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f033c0945c0 con 0x7f033c0a39e0 2024-09-10T16:36:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient: _finish_auth 0 2024-09-10T16:36:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:36:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 5 monclient: authenticate success, global_id 145091 2024-09-10T16:36:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient: _renew_subs 2024-09-10T16:36:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 1 -- 172.21.15.81:0/1504020258 --> v1:172.21.15.81:6790/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f033c0948a0 con 0x7f033c0a39e0 2024-09-10T16:36:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient: _renew_subs 2024-09-10T16:36:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f03434d0640 1 -- 172.21.15.81:0/1504020258 --> v1:172.21.15.81:6790/0 -- mon_subscribe({osdmap=0}) -- 0x7f033c092b40 con 0x7f033c0a39e0 2024-09-10T16:36:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.2 v1:172.21.15.81:6790/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f032c0038d0 con 0x7f033c0a39e0 2024-09-10T16:36:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.2 v1:172.21.15.81:6790/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f032c003e00 con 0x7f033c0a39e0 2024-09-10T16:36:43.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f033b7fe640 4 set_mon_vals no callback set 2024-09-10T16:36:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:36:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.759+0000 7f0339ffb640 10 monclient: dump: 2024-09-10T16:36:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:43.785 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:43.786 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.763+0000 7f03434d0640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.763+0000 7f03434d0640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.763+0000 7f03434d0640 10 monclient: _send_mon_message to mon.b at v1:172.21.15.81:6790/0 2024-09-10T16:36:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.763+0000 7f03434d0640 1 -- 172.21.15.81:0/1504020258 --> v1:172.21.15.81:6790/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f031c005090 con 0x7f033c0a39e0 2024-09-10T16:36:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.763+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.2 v1:172.21.15.81:6790/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f032c003fa0 con 0x7f033c0a39e0 2024-09-10T16:36:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.763+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.2 v1:172.21.15.81:6790/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7f032c04ad80 con 0x7f033c0a39e0 2024-09-10T16:36:43.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.763+0000 7f034126c640 10 monclient: get_auth_request con 0x7f032803dad0 auth_method 0 2024-09-10T16:36:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.767+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mon.2 v1:172.21.15.81:6790/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f032c07bcf0 con 0x7f033c0a39e0 2024-09-10T16:36:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.767+0000 7f0339ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:43.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.767+0000 7f0339ffb640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:43.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.923+0000 7f03434d0640 1 -- 172.21.15.81:0/1504020258 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f031c000ba0 con 0x7f032803dad0 2024-09-10T16:36:43.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.923+0000 7f0339ffb640 1 -- 172.21.15.81:0/1504020258 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (unknown 2264484800 0 0) 0x7f031c000ba0 con 0x7f032803dad0 2024-09-10T16:36:43.925 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2024-09-10T16:36:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.923+0000 7f03434d0640 1 -- 172.21.15.81:0/1504020258 >> v1:172.21.15.189:6812/1108603242 conn(0x7f032803dad0 legacy=0x7f032803ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.923+0000 7f03434d0640 10 monclient: shutdown 2024-09-10T16:36:43.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.923+0000 7f03434d0640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.923+0000 7f03434d0640 1 -- 172.21.15.81:0/1504020258 >> v1:172.21.15.81:6790/0 conn(0x7f033c0a39e0 legacy=0x7f033c1d21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.923+0000 7f03434d0640 1 -- 172.21.15.81:0/1504020258 shutdown_connections 2024-09-10T16:36:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.923+0000 7f03434d0640 1 -- 172.21.15.81:0/1504020258 >> 172.21.15.81:0/1504020258 conn(0x7f033c0a3fd0 msgr2=0x7f033c071820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.923+0000 7f03434d0640 1 -- 172.21.15.81:0/1504020258 shutdown_connections 2024-09-10T16:36:43.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:43.923+0000 7f03434d0640 1 -- 172.21.15.81:0/1504020258 wait complete. 2024-09-10T16:36:43.944 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T16:36:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.047+0000 7f767cf5b640 10 monclient: get_monmap_and_config 2024-09-10T16:36:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.047+0000 7f767cf5b640 10 monclient: build_initial_monmap 2024-09-10T16:36:44.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.047+0000 7f767cf5b640 10 monclient: monmap: 2024-09-10T16:36:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:36:44.053310+0000 2024-09-10T16:36:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:36:44.053310+0000 2024-09-10T16:36:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:44.052 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:44.053 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:44.053 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:44.053 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 Processor -- start 2024-09-10T16:36:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 -- start start 2024-09-10T16:36:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient: init 2024-09-10T16:36:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient: _add_conns ranks=[7,8,5,1,6,3,0,2,4] 2024-09-10T16:36:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient(hunting): picked mon.noname-i con 0x7f76780a0a90 addr v1:172.21.15.189:6792/0 2024-09-10T16:36:44.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient(hunting): picked mon.noname-e con 0x7f76780a35f0 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient(hunting): picked mon.noname-h con 0x7f76780a3a40 addr v1:172.21.15.189:6791/0 2024-09-10T16:36:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767809df70 con 0x7f76780a3a40 2024-09-10T16:36:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 -- --> v1:172.21.15.189:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767809fa30 con 0x7f76780a0a90 2024-09-10T16:36:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767809fd10 con 0x7f76780a35f0 2024-09-10T16:36:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient(hunting): authenticate will time out at 1371.452851s 2024-09-10T16:36:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f7675d9b640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f76780a35f0 0x7f767813c670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:44370/0 (socket says 172.21.15.81:44370) 2024-09-10T16:36:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f7675d9b640 1 -- 172.21.15.81:0/4171989152 learned_addr learned my addr 172.21.15.81:0/4171989152 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 1 -- 172.21.15.81:0/4171989152 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3058819004 0 0) 0x7f767809fd10 con 0x7f76780a35f0 2024-09-10T16:36:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient(hunting): _negotiate 2024-09-10T16:36:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:44.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient(hunting): my global_id is 6758 2024-09-10T16:36:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 1 -- 172.21.15.81:0/4171989152 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7664003530 con 0x7f76780a35f0 2024-09-10T16:36:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 1 -- 172.21.15.81:0/4171989152 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3915250400 0 0) 0x7f7664003530 con 0x7f76780a35f0 2024-09-10T16:36:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 1 -- 172.21.15.81:0/4171989152 >> v1:172.21.15.189:6792/0 conn(0x7f76780a0a90 legacy=0x7f76780a2ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 1 -- 172.21.15.81:0/4171989152 >> v1:172.21.15.189:6791/0 conn(0x7f76780a3a40 legacy=0x7f767813fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient: _finish_hunting 0 2024-09-10T16:36:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 1 monclient: found mon.noname-e 2024-09-10T16:36:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:36:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 1 -- 172.21.15.81:0/4171989152 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767809fff0 con 0x7f76780a35f0 2024-09-10T16:36:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient: _finish_auth 0 2024-09-10T16:36:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient: _check_auth_tickets 2024-09-10T16:36:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:44.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 1 -- 172.21.15.81:0/4171989152 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7660001840 con 0x7f76780a35f0 2024-09-10T16:36:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:36:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient: dump: 2024-09-10T16:36:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:44.062 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 5 monclient: authenticate success, global_id 6758 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 1 -- 172.21.15.81:0/4171989152 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7660001a60 con 0x7f76780a35f0 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 1 -- 172.21.15.81:0/4171989152 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7660004bf0 con 0x7f76780a35f0 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient: get_monmap_and_config success 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 4 set_mon_vals no callback set 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:44.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767559a640 10 monclient: dump: 2024-09-10T16:36:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:44.064 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:44.065 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:44.065 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:44.065 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:44.065 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:44.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient: shutdown 2024-09-10T16:36:44.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:44.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 -- 172.21.15.81:0/4171989152 >> v1:172.21.15.81:6793/0 conn(0x7f76780a35f0 legacy=0x7f767813c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:44.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 -- 172.21.15.81:0/4171989152 shutdown_connections 2024-09-10T16:36:44.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 -- 172.21.15.81:0/4171989152 >> 172.21.15.81:0/4171989152 conn(0x7f76780a3fd0 msgr2=0x7f76780a43e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:44.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 -- 172.21.15.81:0/4171989152 shutdown_connections 2024-09-10T16:36:44.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 -- 172.21.15.81:0/4171989152 wait complete. 2024-09-10T16:36:44.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient: build_initial_monmap 2024-09-10T16:36:44.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient: monmap: 2024-09-10T16:36:44.065 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:36:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:36:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:36:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:36:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:36:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:36:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:36:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:36:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:36:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:36:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:36:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:36:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:36:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:36:44.066 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:36:44.067 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 Processor -- start 2024-09-10T16:36:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 -- start start 2024-09-10T16:36:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient: init 2024-09-10T16:36:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient: _reopen_session rank -1 2024-09-10T16:36:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient: _add_conns ranks=[3,8,0,4,2,5,7,6,1] 2024-09-10T16:36:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient(hunting): picked mon.noname-g con 0x7f76780a0a90 addr v1:172.21.15.189:6790/0 2024-09-10T16:36:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient(hunting): picked mon.noname-e con 0x7f76780a35f0 addr v1:172.21.15.81:6793/0 2024-09-10T16:36:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient(hunting): picked mon.noname-a con 0x7f76780a3a40 addr v1:172.21.15.81:6789/0 2024-09-10T16:36:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767809ad60 con 0x7f76780a3a40 2024-09-10T16:36:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7678098b70 con 0x7f76780a0a90 2024-09-10T16:36:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7678098e50 con 0x7f76780a35f0 2024-09-10T16:36:44.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient(hunting): _renew_subs 2024-09-10T16:36:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f767cf5b640 10 monclient(hunting): authenticate will time out at 1371.455695s 2024-09-10T16:36:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f7675d9b640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f76780a35f0 0x7f76781d2a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:44384/0 (socket says 172.21.15.81:44384) 2024-09-10T16:36:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f7675d9b640 1 -- 172.21.15.81:0/2794860417 learned_addr learned my addr 172.21.15.81:0/2794860417 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:36:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.051+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2340610922 0 0) 0x7f7678098e50 con 0x7f76780a35f0 2024-09-10T16:36:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): my global_id is 6767 2024-09-10T16:36:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7658003530 con 0x7f76780a35f0 2024-09-10T16:36:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1577604194 0 0) 0x7f767809ad60 con 0x7f76780a3a40 2024-09-10T16:36:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:44.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:44.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): my global_id is 6651 2024-09-10T16:36:44.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7678098e50 con 0x7f76780a3a40 2024-09-10T16:36:44.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 1240616618 0 0) 0x7f7658003530 con 0x7f76780a35f0 2024-09-10T16:36:44.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f767809ad60 con 0x7f76780a35f0 2024-09-10T16:36:44.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7660004b30 con 0x7f76780a35f0 2024-09-10T16:36:44.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:44.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:36:44.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): dump: 2024-09-10T16:36:44.069 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:44.069 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:44.069 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:44.069 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:44.069 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:44.070 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:36:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 4068359463 0 0) 0x7f7678098e50 con 0x7f76780a3a40 2024-09-10T16:36:44.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7658003530 con 0x7f76780a3a40 2024-09-10T16:36:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7670001c80 con 0x7f76780a3a40 2024-09-10T16:36:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:36:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:36:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): dump: 2024-09-10T16:36:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:44.071 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:44.072 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 <== mon.3 v1:172.21.15.189:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1295693769 0 0) 0x7f7678098b70 con 0x7f76780a0a90 2024-09-10T16:36:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): _negotiate 2024-09-10T16:36:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:36:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:36:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient(hunting): my global_id is 164271 2024-09-10T16:36:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 --> v1:172.21.15.189:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7678098e50 con 0x7f76780a0a90 2024-09-10T16:36:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 3923687965 0 0) 0x7f767809ad60 con 0x7f76780a35f0 2024-09-10T16:36:44.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 >> v1:172.21.15.189:6790/0 conn(0x7f76780a0a90 legacy=0x7f767809b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 >> v1:172.21.15.81:6789/0 conn(0x7f76780a3a40 legacy=0x7f76781d6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient: _finish_hunting 0 2024-09-10T16:36:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 monclient: found mon.e 2024-09-10T16:36:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:36:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:36:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76780a6cf0 con 0x7f76780a35f0 2024-09-10T16:36:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient: _finish_auth 0 2024-09-10T16:36:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient: _check_auth_tickets 2024-09-10T16:36:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:36:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f767cf5b640 5 monclient: authenticate success, global_id 6767 2024-09-10T16:36:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f767cf5b640 10 monclient: _renew_subs 2024-09-10T16:36:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f767cf5b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:36:44.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f767cf5b640 1 -- 172.21.15.81:0/2794860417 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7678073ae0 con 0x7f76780a35f0 2024-09-10T16:36:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f767cf5b640 10 monclient: _renew_subs 2024-09-10T16:36:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f767cf5b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:36:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f767cf5b640 1 -- 172.21.15.81:0/2794860417 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f7678098890 con 0x7f76780a35f0 2024-09-10T16:36:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f76600011c0 con 0x7f76780a35f0 2024-09-10T16:36:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:36:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7660001920 con 0x7f76780a35f0 2024-09-10T16:36:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:36:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f7674d99640 4 set_mon_vals no callback set 2024-09-10T16:36:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:36:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 10 monclient: dump: 2024-09-10T16:36:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:36:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:36:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:44.074 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:36:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:36:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:36:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:36:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:36:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:36:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:36:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:36:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:36:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:36:44.075 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:36:44.076 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:36:44.076 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:36:44.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f767cf5b640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:44.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f767cf5b640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:44.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f767cf5b640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:36:44.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f767cf5b640 1 -- 172.21.15.81:0/2794860417 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f765c005090 con 0x7f76780a35f0 2024-09-10T16:36:44.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f7660010fa0 con 0x7f76780a35f0 2024-09-10T16:36:44.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7f766004aea0 con 0x7f76780a35f0 2024-09-10T16:36:44.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.055+0000 7f767659c640 10 monclient: get_auth_request con 0x7f765803d6b0 auth_method 0 2024-09-10T16:36:44.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.059+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 <== mon.8 v1:172.21.15.81:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f7660016e20 con 0x7f76780a35f0 2024-09-10T16:36:44.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.059+0000 7f766effd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:36:44.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.059+0000 7f766effd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:36:44.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.211+0000 7f767cf5b640 1 -- 172.21.15.81:0/2794860417 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f765c000ba0 con 0x7f765803d6b0 2024-09-10T16:36:44.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.215+0000 7f766effd640 1 -- 172.21.15.81:0/2794860417 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34080 (unknown 2965378022 0 2471497898) 0x7f765c000ba0 con 0x7f765803d6b0 2024-09-10T16:36:44.221 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:36:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T16:36:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.215+0000 7f767cf5b640 1 -- 172.21.15.81:0/2794860417 >> v1:172.21.15.189:6812/1108603242 conn(0x7f765803d6b0 legacy=0x7f765803fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:44.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.215+0000 7f767cf5b640 10 monclient: shutdown 2024-09-10T16:36:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.215+0000 7f767cf5b640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:36:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.215+0000 7f767cf5b640 1 -- 172.21.15.81:0/2794860417 >> v1:172.21.15.81:6793/0 conn(0x7f76780a35f0 legacy=0x7f76781d2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:36:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.215+0000 7f767cf5b640 1 -- 172.21.15.81:0/2794860417 shutdown_connections 2024-09-10T16:36:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.215+0000 7f767cf5b640 1 -- 172.21.15.81:0/2794860417 >> 172.21.15.81:0/2794860417 conn(0x7f76780a3fd0 msgr2=0x7f7678074200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:36:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.215+0000 7f767cf5b640 1 -- 172.21.15.81:0/2794860417 shutdown_connections 2024-09-10T16:36:44.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:36:44.215+0000 7f767cf5b640 1 -- 172.21.15.81:0/2794860417 wait complete. 2024-09-10T16:36:44.234 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":512,"stamp":"2024-09-10T16:36:42.399465+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":50,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":195308,"kb_used_data":12312,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566035732,"statfs":{"total":579820584960,"available":579620589568,"internally_reserved":0,"allocated":12607488,"data_stored":6348566,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":187226784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.496060"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":628,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-09-10T16:36:40.187961+0000","last_change":"2024-09-10T16:30:15.334487+0000","last_active":"2024-09-10T16:36:40.187961+0000","last_peered":"2024-09-10T16:36:40.187961+0000","last_clean":"2024-09-10T16:36:40.187961+0000","last_became_active":"2024-09-10T16:30:13.320369+0000","last_became_peered":"2024-09-10T16:30:13.320369+0000","last_unstale":"2024-09-10T16:36:40.187961+0000","last_undegraded":"2024-09-10T16:36:40.187961+0000","last_fullsized":"2024-09-10T16:36:40.187961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T17:44:03.419327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0011103879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":628,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:37.206818+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:36:37.206818+0000","last_peered":"2024-09-10T16:36:37.206818+0000","last_clean":"2024-09-10T16:36:37.206818+0000","last_became_active":"2024-09-10T16:30:13.320284+0000","last_became_peered":"2024-09-10T16:30:13.320284+0000","last_unstale":"2024-09-10T16:36:37.206818+0000","last_undegraded":"2024-09-10T16:36:37.206818+0000","last_fullsized":"2024-09-10T16:36:37.206818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:54:11.783078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065529,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":629,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-09-10T16:36:40.187936+0000","last_change":"2024-09-10T16:30:15.335682+0000","last_active":"2024-09-10T16:36:40.187936+0000","last_peered":"2024-09-10T16:36:40.187936+0000","last_clean":"2024-09-10T16:36:40.187936+0000","last_became_active":"2024-09-10T16:30:13.317933+0000","last_became_peered":"2024-09-10T16:30:13.317933+0000","last_unstale":"2024-09-10T16:36:40.187936+0000","last_undegraded":"2024-09-10T16:36:40.187936+0000","last_fullsized":"2024-09-10T16:36:40.187936+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T16:53:11.603632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018898459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":622,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:36.220536+0000","last_change":"2024-09-10T16:30:15.335134+0000","last_active":"2024-09-10T16:36:36.220536+0000","last_peered":"2024-09-10T16:36:36.220536+0000","last_clean":"2024-09-10T16:36:36.220536+0000","last_became_active":"2024-09-10T16:30:13.314196+0000","last_became_peered":"2024-09-10T16:30:13.314196+0000","last_unstale":"2024-09-10T16:36:36.220536+0000","last_undegraded":"2024-09-10T16:36:36.220536+0000","last_fullsized":"2024-09-10T16:36:36.220536+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T03:33:17.356490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092995700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"20'2","reported_seq":624,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.916628+0000","last_change":"2024-09-10T16:30:15.343908+0000","last_active":"2024-09-10T16:36:35.916628+0000","last_peered":"2024-09-10T16:36:35.916628+0000","last_clean":"2024-09-10T16:36:35.916628+0000","last_became_active":"2024-09-10T16:30:13.322410+0000","last_became_peered":"2024-09-10T16:30:13.322410+0000","last_unstale":"2024-09-10T16:36:35.916628+0000","last_undegraded":"2024-09-10T16:36:35.916628+0000","last_fullsized":"2024-09-10T16:36:35.916628+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T18:48:23.371637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0024400910000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":624,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.916982+0000","last_change":"2024-09-10T16:30:15.335359+0000","last_active":"2024-09-10T16:36:35.916982+0000","last_peered":"2024-09-10T16:36:35.916982+0000","last_clean":"2024-09-10T16:36:35.916982+0000","last_became_active":"2024-09-10T16:30:13.314279+0000","last_became_peered":"2024-09-10T16:30:13.314279+0000","last_unstale":"2024-09-10T16:36:35.916982+0000","last_undegraded":"2024-09-10T16:36:35.916982+0000","last_fullsized":"2024-09-10T16:36:35.916982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:31:19.341302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0012467800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":628,"reported_epoch":324,"state":"active+clean","last_fresh":"2024-09-10T16:36:35.913445+0000","last_change":"2024-09-10T16:30:15.336057+0000","last_active":"2024-09-10T16:36:35.913445+0000","last_peered":"2024-09-10T16:36:35.913445+0000","last_clean":"2024-09-10T16:36:35.913445+0000","last_became_active":"2024-09-10T16:30:13.315537+0000","last_became_peered":"2024-09-10T16:30:13.315537+0000","last_unstale":"2024-09-10T16:36:35.913445+0000","last_undegraded":"2024-09-10T16:36:35.913445+0000","last_fullsized":"2024-09-10T16:36:35.913445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:27:18.484028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001369903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"18'1","reported_seq":630,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-09-10T16:36:40.187906+0000","last_change":"2024-09-10T16:30:15.334665+0000","last_active":"2024-09-10T16:36:40.187906+0000","last_peered":"2024-09-10T16:36:40.187906+0000","last_clean":"2024-09-10T16:36:40.187906+0000","last_became_active":"2024-09-10T16:30:13.317955+0000","last_became_peered":"2024-09-10T16:30:13.317955+0000","last_unstale":"2024-09-10T16:36:40.187906+0000","last_undegraded":"2024-09-10T16:36:40.187906+0000","last_fullsized":"2024-09-10T16:36:40.187906+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:12.297253+0000","last_clean_scrub_stamp":"2024-09-10T16:30:12.297253+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T19:23:01.463525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0016930140000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"15'72","reported_seq":720,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-09-10T16:36:40.187845+0000","last_change":"2024-09-10T16:30:10.241185+0000","last_active":"2024-09-10T16:36:40.187845+0000","last_peered":"2024-09-10T16:36:40.187845+0000","last_clean":"2024-09-10T16:36:40.187845+0000","last_became_active":"2024-09-10T16:30:10.239296+0000","last_became_peered":"2024-09-10T16:30:10.239296+0000","last_unstale":"2024-09-10T16:36:40.187845+0000","last_undegraded":"2024-09-10T16:36:40.187845+0000","last_fullsized":"2024-09-10T16:36:40.187845+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:30:09.204141+0000","last_clean_scrub_stamp":"2024-09-10T16:30:09.204141+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:17:25.346646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574931,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33276,"kb_used_data":2084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338564,"statfs":{"total":96636764160,"available":96602689536,"internally_reserved":0,"allocated":2134016,"data_stored":1410089,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574929,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2084864,"data_stored":881180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574929,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2080768,"data_stored":881161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2032,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2080768,"data_stored":881161,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574929,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33232,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338608,"statfs":{"total":96636764160,"available":96602734592,"internally_reserved":0,"allocated":2084864,"data_stored":881180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640339,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29120,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342720,"statfs":{"total":96636764160,"available":96606945280,"internally_reserved":0,"allocated":2142208,"data_stored":1413795,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T16:36:44.238 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-10T16:30:12.297253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=30, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=36, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T16:36:44.238 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-10T16:30:12.297253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=30, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=36, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T16:36:44.238 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-10T16:30:12.297253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=30, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=36, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T16:36:44.238 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-10T16:30:12.297253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=30, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=36, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T16:36:44.238 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-10T16:30:12.297253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=30, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=36, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T16:36:44.238 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-10T16:30:12.297253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=30, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=36, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T16:36:44.238 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-10T16:30:12.297253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=30, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=36, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T16:36:44.238 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-10T16:30:12.297253+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=30, tm_sec=12, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=36, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T16:36:44.239 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-10T16:30:09.204141+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=30, tm_sec=9, tm_wday=1, tm_yday=254, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=10, tm_hour=16, tm_min=36, tm_sec=40, tm_wday=1, tm_yday=254, tm_isdst=0) 2024-09-10T16:36:44.239 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-10T16:37:04.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-10T16:37:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.363+0000 7f66a84ec640 10 monclient: get_monmap_and_config 2024-09-10T16:37:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.363+0000 7f66a84ec640 10 monclient: build_initial_monmap 2024-09-10T16:37:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.363+0000 7f66a84ec640 10 monclient: monmap: 2024-09-10T16:37:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:37:04.367 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:37:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:37:04.369234+0000 2024-09-10T16:37:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:37:04.369234+0000 2024-09-10T16:37:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:37:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:37:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:37:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:37:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:37:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:37:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:37:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:37:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:37:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:37:04.368 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:37:04.369 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.363+0000 7f66a84ec640 1 Processor -- start 2024-09-10T16:37:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 1 -- start start 2024-09-10T16:37:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient: init 2024-09-10T16:37:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient: _reopen_session rank -1 2024-09-10T16:37:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient: _add_conns ranks=[0,2,6,8,5,3,1,4,7] 2024-09-10T16:37:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient(hunting): picked mon.noname-a con 0x7f66a00a59f0 addr v1:172.21.15.81:6789/0 2024-09-10T16:37:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient(hunting): picked mon.noname-b con 0x7f66a00a4520 addr v1:172.21.15.81:6790/0 2024-09-10T16:37:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient(hunting): picked mon.noname-d con 0x7f66a00a4950 addr v1:172.21.15.81:6792/0 2024-09-10T16:37:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a0068dc0 con 0x7f66a00a59f0 2024-09-10T16:37:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 1 -- --> v1:172.21.15.81:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a00a0e10 con 0x7f66a00a4520 2024-09-10T16:37:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a009fd40 con 0x7f66a00a4950 2024-09-10T16:37:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient(hunting): _renew_subs 2024-09-10T16:37:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient(hunting): authenticate will time out at 1391.768702s 2024-09-10T16:37:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a6288640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f66a00a59f0 0x7f66a00a3e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37742/0 (socket says 172.21.15.81:37742) 2024-09-10T16:37:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a6288640 1 -- 172.21.15.81:0/3057251066 learned_addr learned my addr 172.21.15.81:0/3057251066 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:37:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 1 -- 172.21.15.81:0/3057251066 <== mon.2 v1:172.21.15.81:6790/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1178737140 0 0) 0x7f66a00a0e10 con 0x7f66a00a4520 2024-09-10T16:37:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient(hunting): _negotiate 2024-09-10T16:37:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:37:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:37:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient(hunting): my global_id is 145100 2024-09-10T16:37:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 1 -- 172.21.15.81:0/3057251066 --> v1:172.21.15.81:6790/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f668c003530 con 0x7f66a00a4520 2024-09-10T16:37:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 1 -- 172.21.15.81:0/3057251066 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1001729398 0 0) 0x7f66a009fd40 con 0x7f66a00a4950 2024-09-10T16:37:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient(hunting): _negotiate 2024-09-10T16:37:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:37:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:37:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient(hunting): my global_id is 144852 2024-09-10T16:37:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 1 -- 172.21.15.81:0/3057251066 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66a00a0e10 con 0x7f66a00a4950 2024-09-10T16:37:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 1 -- 172.21.15.81:0/3057251066 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 163285429 0 0) 0x7f66a0068dc0 con 0x7f66a00a59f0 2024-09-10T16:37:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient(hunting): _negotiate 2024-09-10T16:37:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:37:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:37:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient(hunting): my global_id is 6660 2024-09-10T16:37:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 1 -- 172.21.15.81:0/3057251066 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66a009fd40 con 0x7f66a00a59f0 2024-09-10T16:37:04.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 1 -- 172.21.15.81:0/3057251066 <== mon.2 v1:172.21.15.81:6790/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1729211225 0 0) 0x7f668c003530 con 0x7f66a00a4520 2024-09-10T16:37:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 1 -- 172.21.15.81:0/3057251066 >> v1:172.21.15.81:6792/0 conn(0x7f66a00a4950 legacy=0x7f66a0141ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:37:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 1 -- 172.21.15.81:0/3057251066 >> v1:172.21.15.81:6789/0 conn(0x7f66a00a59f0 legacy=0x7f66a00a3e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:37:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient: _finish_hunting 0 2024-09-10T16:37:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 1 monclient: found mon.noname-b 2024-09-10T16:37:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:37:04.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient: _send_mon_message to mon.noname-b at v1:172.21.15.81:6790/0 2024-09-10T16:37:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 1 -- 172.21.15.81:0/3057251066 --> v1:172.21.15.81:6790/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a00a0ae0 con 0x7f66a00a4520 2024-09-10T16:37:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient: _finish_auth 0 2024-09-10T16:37:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient: _check_auth_tickets 2024-09-10T16:37:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:37:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 1 -- 172.21.15.81:0/3057251066 <== mon.2 v1:172.21.15.81:6790/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f669c001840 con 0x7f66a00a4520 2024-09-10T16:37:04.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:37:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient: got monmap 1 from mon.noname-b (according to old e1) 2024-09-10T16:37:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient: dump: 2024-09-10T16:37:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:37:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:37:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.381 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:37:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:37:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:37:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:37:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:37:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:37:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:37:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:37:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:37:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:37:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:37:04.383 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:04.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 5 monclient: authenticate success, global_id 145100 2024-09-10T16:37:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:37:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 1 -- 172.21.15.81:0/3057251066 <== mon.2 v1:172.21.15.81:6790/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f669c0019e0 con 0x7f66a00a4520 2024-09-10T16:37:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient: handle_config config(0 keys) 2024-09-10T16:37:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 1 -- 172.21.15.81:0/3057251066 <== mon.2 v1:172.21.15.81:6790/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f669c003960 con 0x7f66a00a4520 2024-09-10T16:37:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient: get_monmap_and_config success 2024-09-10T16:37:04.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 4 set_mon_vals no callback set 2024-09-10T16:37:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:37:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient: got monmap 1 from mon.b (according to old e1) 2024-09-10T16:37:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a5286640 10 monclient: dump: 2024-09-10T16:37:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:37:04.385 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:37:04.386 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.386 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.386 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:37:04.386 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:37:04.386 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:37:04.386 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:37:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:37:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:37:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:37:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:37:04.387 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:37:04.388 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:37:04.388 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:37:04.388 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:04.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient: shutdown 2024-09-10T16:37:04.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:37:04.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 1 -- 172.21.15.81:0/3057251066 >> v1:172.21.15.81:6790/0 conn(0x7f66a00a4520 legacy=0x7f66a013e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:37:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 1 -- 172.21.15.81:0/3057251066 shutdown_connections 2024-09-10T16:37:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 1 -- 172.21.15.81:0/3057251066 >> 172.21.15.81:0/3057251066 conn(0x7f66a00a4f00 msgr2=0x7f66a00a52e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:37:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 1 -- 172.21.15.81:0/3057251066 shutdown_connections 2024-09-10T16:37:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 1 -- 172.21.15.81:0/3057251066 wait complete. 2024-09-10T16:37:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient: build_initial_monmap 2024-09-10T16:37:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient: monmap: 2024-09-10T16:37:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:37:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:37:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:37:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:37:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:37:04.390 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:37:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:37:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:37:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:37:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:37:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:37:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:37:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:37:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:37:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:37:04.391 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 1 Processor -- start 2024-09-10T16:37:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 1 -- start start 2024-09-10T16:37:04.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient: init 2024-09-10T16:37:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient: _reopen_session rank -1 2024-09-10T16:37:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient: _add_conns ranks=[0,5,8,7,1,3,6,2,4] 2024-09-10T16:37:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient(hunting): picked mon.noname-a con 0x7f66a00a4520 addr v1:172.21.15.81:6789/0 2024-09-10T16:37:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient(hunting): picked mon.noname-h con 0x7f66a00a4950 addr v1:172.21.15.189:6791/0 2024-09-10T16:37:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient(hunting): picked mon.noname-e con 0x7f66a00a59f0 addr v1:172.21.15.81:6793/0 2024-09-10T16:37:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 1 -- --> v1:172.21.15.81:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a0095df0 con 0x7f66a00a4520 2024-09-10T16:37:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a00a1a80 con 0x7f66a00a4950 2024-09-10T16:37:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66a0098150 con 0x7f66a00a59f0 2024-09-10T16:37:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient(hunting): _renew_subs 2024-09-10T16:37:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a84ec640 10 monclient(hunting): authenticate will time out at 1391.771812s 2024-09-10T16:37:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a6288640 1 --1- >> v1:172.21.15.81:6789/0 conn(0x7f66a00a4520 0x7f66a009a690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6789/0 says I am v1:172.21.15.81:37750/0 (socket says 172.21.15.81:37750) 2024-09-10T16:37:04.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.367+0000 7f66a6288640 1 -- 172.21.15.81:0/3674765903 learned_addr learned my addr 172.21.15.81:0/3674765903 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:37:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 <== mon.0 v1:172.21.15.81:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2105372487 0 0) 0x7f66a0095df0 con 0x7f66a00a4520 2024-09-10T16:37:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:37:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:37:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:37:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): my global_id is 6669 2024-09-10T16:37:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 --> v1:172.21.15.81:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6684003530 con 0x7f66a00a4520 2024-09-10T16:37:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2592554660 0 0) 0x7f66a0098150 con 0x7f66a00a59f0 2024-09-10T16:37:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): _negotiate 2024-09-10T16:37:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:37:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:37:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): my global_id is 6776 2024-09-10T16:37:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66a0095df0 con 0x7f66a00a59f0 2024-09-10T16:37:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 2898701768 0 0) 0x7f66a0095df0 con 0x7f66a00a59f0 2024-09-10T16:37:04.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 --> v1:172.21.15.81:6793/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66a0098150 con 0x7f66a00a59f0 2024-09-10T16:37:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 <== mon.0 v1:172.21.15.81:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 718602827 0 0) 0x7f6684003530 con 0x7f66a00a4520 2024-09-10T16:37:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 --> v1:172.21.15.81:6789/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f66a0095df0 con 0x7f66a00a4520 2024-09-10T16:37:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f66980019a0 con 0x7f66a00a59f0 2024-09-10T16:37:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:37:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:37:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): dump: 2024-09-10T16:37:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:37:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:37:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:37:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:37:04.394 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:37:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:37:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:37:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:37:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:37:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:37:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:37:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:37:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:37:04.395 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:37:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 <== mon.0 v1:172.21.15.81:6789/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6690001620 con 0x7f66a00a4520 2024-09-10T16:37:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:37:04.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): got monmap 1 from mon.a (according to old e1) 2024-09-10T16:37:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient(hunting): dump: 2024-09-10T16:37:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:37:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:37:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:37:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:37:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:37:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:37:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:37:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:37:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:37:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:37:04.396 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:37:04.397 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:37:04.397 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:37:04.397 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:04.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 <== mon.8 v1:172.21.15.81:6793/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 2239278995 0 0) 0x7f66a0098150 con 0x7f66a00a59f0 2024-09-10T16:37:04.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 >> v1:172.21.15.189:6791/0 conn(0x7f66a00a4950 legacy=0x7f66a01d27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:37:04.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 >> v1:172.21.15.81:6789/0 conn(0x7f66a00a4520 legacy=0x7f66a009a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:37:04.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient: _finish_hunting 0 2024-09-10T16:37:04.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 monclient: found mon.e 2024-09-10T16:37:04.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:37:04.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:37:04.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a0096950 con 0x7f66a00a59f0 2024-09-10T16:37:04.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient: _finish_auth 0 2024-09-10T16:37:04.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient: _check_auth_tickets 2024-09-10T16:37:04.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:37:04.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f66a84ec640 5 monclient: authenticate success, global_id 6776 2024-09-10T16:37:04.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f66a84ec640 10 monclient: _renew_subs 2024-09-10T16:37:04.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f66a84ec640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:37:04.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f66a84ec640 1 -- 172.21.15.81:0/3674765903 --> v1:172.21.15.81:6793/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f66a009ada0 con 0x7f66a00a59f0 2024-09-10T16:37:04.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f66a84ec640 10 monclient: _renew_subs 2024-09-10T16:37:04.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f66a84ec640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:37:04.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f66a84ec640 1 -- 172.21.15.81:0/3674765903 --> v1:172.21.15.81:6793/0 -- mon_subscribe({osdmap=0}) -- 0x7f66a01cd720 con 0x7f66a00a59f0 2024-09-10T16:37:04.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 <== mon.8 v1:172.21.15.81:6793/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f6698003c30 con 0x7f66a00a59f0 2024-09-10T16:37:04.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient: handle_config config(0 keys) 2024-09-10T16:37:04.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f66a4a85640 4 set_mon_vals no callback set 2024-09-10T16:37:04.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 <== mon.8 v1:172.21.15.81:6793/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f6698004120 con 0x7f66a00a59f0 2024-09-10T16:37:04.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:37:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:37:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 10 monclient: dump: 2024-09-10T16:37:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:37:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:37:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:37:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:37:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:37:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:37:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:37:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:37:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:37:04.399 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:37:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:37:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:37:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:37:04.400 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f66a84ec640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:37:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f66a84ec640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:37:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f66a84ec640 10 monclient: _send_mon_message to mon.e at v1:172.21.15.81:6793/0 2024-09-10T16:37:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f66a84ec640 1 -- 172.21.15.81:0/3674765903 --> v1:172.21.15.81:6793/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6688005090 con 0x7f66a00a59f0 2024-09-10T16:37:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 <== mon.8 v1:172.21.15.81:6793/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f6698010030 con 0x7f66a00a59f0 2024-09-10T16:37:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 <== mon.8 v1:172.21.15.81:6793/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7f6698049de0 con 0x7f66a00a59f0 2024-09-10T16:37:04.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.371+0000 7f66a6288640 10 monclient: get_auth_request con 0x7f668403d5c0 auth_method 0 2024-09-10T16:37:04.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.375+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 <== mon.8 v1:172.21.15.81:6793/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f6698015e50 con 0x7f66a00a59f0 2024-09-10T16:37:04.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.375+0000 7f6696ffd640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:37:04.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.375+0000 7f6696ffd640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:37:04.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.543+0000 7f66a84ec640 1 -- 172.21.15.81:0/3674765903 --> v1:172.21.15.189:6812/1108603242 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6688000ba0 con 0x7f668403d5c0 2024-09-10T16:37:04.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.547+0000 7f6696ffd640 1 -- 172.21.15.81:0/3674765903 <== mgr.4118 v1:172.21.15.189:6812/1108603242 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+34007 (unknown 2965378022 0 1017431686) 0x7f6688000ba0 con 0x7f668403d5c0 2024-09-10T16:37:04.549 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-10T16:37:04.549 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-10T16:37:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.547+0000 7f66a84ec640 1 -- 172.21.15.81:0/3674765903 >> v1:172.21.15.189:6812/1108603242 conn(0x7f668403d5c0 legacy=0x7f668403fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:37:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.547+0000 7f66a84ec640 10 monclient: shutdown 2024-09-10T16:37:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.547+0000 7f66a84ec640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:37:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.547+0000 7f66a84ec640 1 -- 172.21.15.81:0/3674765903 >> v1:172.21.15.81:6793/0 conn(0x7f66a00a59f0 legacy=0x7f66a01d5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:37:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.547+0000 7f66a84ec640 1 -- 172.21.15.81:0/3674765903 shutdown_connections 2024-09-10T16:37:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.547+0000 7f66a84ec640 1 -- 172.21.15.81:0/3674765903 >> 172.21.15.81:0/3674765903 conn(0x7f66a00a4f00 msgr2=0x7f66a009c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:37:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.547+0000 7f66a84ec640 1 -- 172.21.15.81:0/3674765903 shutdown_connections 2024-09-10T16:37:04.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.547+0000 7f66a84ec640 1 -- 172.21.15.81:0/3674765903 wait complete. 2024-09-10T16:37:04.566 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":523,"stamp":"2024-09-10T16:37:04.405281+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":195296,"kb_used_data":12352,"kb_used_omap":9,"kb_used_meta":182838,"kb_avail":566035744,"statfs":{"total":579820584960,"available":579620601856,"internally_reserved":0,"allocated":12648448,"data_stored":6367096,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":9568,"internal_metadata":187226784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003215"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":637,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-09-10T16:36:44.648132+0000","last_change":"2024-09-10T16:36:44.647993+0000","last_active":"2024-09-10T16:36:44.648132+0000","last_peered":"2024-09-10T16:36:44.648132+0000","last_clean":"2024-09-10T16:36:44.648132+0000","last_became_active":"2024-09-10T16:30:13.320369+0000","last_became_peered":"2024-09-10T16:30:13.320369+0000","last_unstale":"2024-09-10T16:36:44.648132+0000","last_undegraded":"2024-09-10T16:36:44.648132+0000","last_fullsized":"2024-09-10T16:36:44.648132+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:36:44.647831+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:36:44.647831+0000","last_clean_scrub_stamp":"2024-09-10T16:36:44.647831+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:57:20.938521+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0011103879999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":639,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-09-10T16:36:44.003184+0000","last_change":"2024-09-10T16:36:44.003184+0000","last_active":"2024-09-10T16:36:44.003184+0000","last_peered":"2024-09-10T16:36:44.003184+0000","last_clean":"2024-09-10T16:36:44.003184+0000","last_became_active":"2024-09-10T16:30:13.320284+0000","last_became_peered":"2024-09-10T16:30:13.320284+0000","last_unstale":"2024-09-10T16:36:44.003184+0000","last_undegraded":"2024-09-10T16:36:44.003184+0000","last_fullsized":"2024-09-10T16:36:44.003184+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:36:44.002990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:36:44.002990+0000","last_clean_scrub_stamp":"2024-09-10T16:36:44.002990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:47:00.225674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001065529,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":637,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-09-10T16:36:45.619956+0000","last_change":"2024-09-10T16:36:45.619956+0000","last_active":"2024-09-10T16:36:45.619956+0000","last_peered":"2024-09-10T16:36:45.619956+0000","last_clean":"2024-09-10T16:36:45.619956+0000","last_became_active":"2024-09-10T16:30:13.317933+0000","last_became_peered":"2024-09-10T16:30:13.317933+0000","last_unstale":"2024-09-10T16:36:45.619956+0000","last_undegraded":"2024-09-10T16:36:45.619956+0000","last_fullsized":"2024-09-10T16:36:45.619956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:36:45.619782+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:36:45.619782+0000","last_clean_scrub_stamp":"2024-09-10T16:36:45.619782+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T01:03:41.490587+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0018898459999999999,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":632,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-09-10T16:36:44.833640+0000","last_change":"2024-09-10T16:36:44.833640+0000","last_active":"2024-09-10T16:36:44.833640+0000","last_peered":"2024-09-10T16:36:44.833640+0000","last_clean":"2024-09-10T16:36:44.833640+0000","last_became_active":"2024-09-10T16:30:13.314196+0000","last_became_peered":"2024-09-10T16:30:13.314196+0000","last_unstale":"2024-09-10T16:36:44.833640+0000","last_undegraded":"2024-09-10T16:36:44.833640+0000","last_fullsized":"2024-09-10T16:36:44.833640+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:36:44.833478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:36:44.833478+0000","last_clean_scrub_stamp":"2024-09-10T16:36:44.833478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:16:32.625891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00092995700000000003,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"325'3","reported_seq":635,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-09-10T16:36:41.670888+0000","last_change":"2024-09-10T16:36:41.670888+0000","last_active":"2024-09-10T16:36:41.670888+0000","last_peered":"2024-09-10T16:36:41.670888+0000","last_clean":"2024-09-10T16:36:41.670888+0000","last_became_active":"2024-09-10T16:30:13.322410+0000","last_became_peered":"2024-09-10T16:30:13.322410+0000","last_unstale":"2024-09-10T16:36:41.670888+0000","last_undegraded":"2024-09-10T16:36:41.670888+0000","last_fullsized":"2024-09-10T16:36:41.670888+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"325'3","last_scrub_stamp":"2024-09-10T16:36:41.670811+0000","last_deep_scrub":"325'3","last_deep_scrub_stamp":"2024-09-10T16:36:41.670811+0000","last_clean_scrub_stamp":"2024-09-10T16:36:41.670811+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T04:30:30.922369+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0.0024400910000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":634,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-09-10T16:36:43.103423+0000","last_change":"2024-09-10T16:36:43.103423+0000","last_active":"2024-09-10T16:36:43.103423+0000","last_peered":"2024-09-10T16:36:43.103423+0000","last_clean":"2024-09-10T16:36:43.103423+0000","last_became_active":"2024-09-10T16:30:13.314279+0000","last_became_peered":"2024-09-10T16:30:13.314279+0000","last_unstale":"2024-09-10T16:36:43.103423+0000","last_undegraded":"2024-09-10T16:36:43.103423+0000","last_fullsized":"2024-09-10T16:36:43.103423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:36:43.103222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:36:43.103222+0000","last_clean_scrub_stamp":"2024-09-10T16:36:43.103222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:23:34.244948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0012467800000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":638,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-09-10T16:36:42.642265+0000","last_change":"2024-09-10T16:36:42.642265+0000","last_active":"2024-09-10T16:36:42.642265+0000","last_peered":"2024-09-10T16:36:42.642265+0000","last_clean":"2024-09-10T16:36:42.642265+0000","last_became_active":"2024-09-10T16:30:13.315537+0000","last_became_peered":"2024-09-10T16:30:13.315537+0000","last_unstale":"2024-09-10T16:36:42.642265+0000","last_undegraded":"2024-09-10T16:36:42.642265+0000","last_fullsized":"2024-09-10T16:36:42.642265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-10T16:36:42.642157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-10T16:36:42.642157+0000","last_clean_scrub_stamp":"2024-09-10T16:36:42.642157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T22:08:05.675177+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001369903,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.3","version":"325'2","reported_seq":639,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-09-10T16:36:43.607700+0000","last_change":"2024-09-10T16:36:43.607700+0000","last_active":"2024-09-10T16:36:43.607700+0000","last_peered":"2024-09-10T16:36:43.607700+0000","last_clean":"2024-09-10T16:36:43.607700+0000","last_became_active":"2024-09-10T16:30:13.317955+0000","last_became_peered":"2024-09-10T16:30:13.317955+0000","last_unstale":"2024-09-10T16:36:43.607700+0000","last_undegraded":"2024-09-10T16:36:43.607700+0000","last_fullsized":"2024-09-10T16:36:43.607700+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"325'2","last_scrub_stamp":"2024-09-10T16:36:43.607552+0000","last_deep_scrub":"325'2","last_deep_scrub_stamp":"2024-09-10T16:36:43.607552+0000","last_clean_scrub_stamp":"2024-09-10T16:36:43.607552+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-11T21:38:20.549494+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0016930140000000001,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"325'74","reported_seq":730,"reported_epoch":325,"state":"active+clean","last_fresh":"2024-09-10T16:36:42.614761+0000","last_change":"2024-09-10T16:36:42.614761+0000","last_active":"2024-09-10T16:36:42.614761+0000","last_peered":"2024-09-10T16:36:42.614761+0000","last_clean":"2024-09-10T16:36:42.614761+0000","last_became_active":"2024-09-10T16:30:10.239296+0000","last_became_peered":"2024-09-10T16:30:10.239296+0000","last_unstale":"2024-09-10T16:36:42.614761+0000","last_undegraded":"2024-09-10T16:36:42.614761+0000","last_fullsized":"2024-09-10T16:36:42.614761+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"325'74","last_scrub_stamp":"2024-09-10T16:36:42.614675+0000","last_deep_scrub":"325'74","last_deep_scrub_stamp":"2024-09-10T16:36:42.614675+0000","last_clean_scrub_stamp":"2024-09-10T16:36:42.614675+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-12T02:32:36.330438+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":6},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":1057856,"data_compressed":12312,"data_compressed_allocated":65536,"data_compressed_original":1024000,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":5,"up_from":13,"seq":55834574936,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33276,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338564,"statfs":{"total":96636764160,"available":96602689536,"internally_reserved":0,"allocated":2142208,"data_stored":1413795,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2093056,"data_stored":884886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2088960,"data_stored":884867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574933,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33224,"kb_used_data":2040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2088960,"data_stored":884867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33228,"kb_used_data":2044,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2093056,"data_stored":884886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640343,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":29116,"kb_used_data":2092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94342724,"statfs":{"total":96636764160,"available":96606949376,"internally_reserved":0,"allocated":2142208,"data_stored":1413795,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":528928,"data_compressed":6156,"data_compressed_allocated":32768,"data_compressed_original":512000,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-10T16:37:04.567 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-10T16:37:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.683+0000 7f7dbb53f640 10 monclient: get_monmap_and_config 2024-09-10T16:37:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.683+0000 7f7dbb53f640 10 monclient: build_initial_monmap 2024-09-10T16:37:04.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.683+0000 7f7dbb53f640 10 monclient: monmap: 2024-09-10T16:37:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:37:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:37:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:37:04.688391+0000 2024-09-10T16:37:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:37:04.688391+0000 2024-09-10T16:37:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:37:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:37:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:37:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:37:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:37:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:37:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:37:04.687 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:37:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:37:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:37:04.688 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:37:04.688 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:04.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.683+0000 7f7dbb53f640 1 Processor -- start 2024-09-10T16:37:04.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.683+0000 7f7dbb53f640 1 -- start start 2024-09-10T16:37:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.683+0000 7f7dbb53f640 10 monclient: init 2024-09-10T16:37:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient: _reopen_session rank -1 2024-09-10T16:37:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient: _add_conns ranks=[3,8,5,6,2,7,0,4,1] 2024-09-10T16:37:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient(hunting): picked mon.noname-g con 0x7f7db4074230 addr v1:172.21.15.189:6790/0 2024-09-10T16:37:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient(hunting): picked mon.noname-e con 0x7f7db4137650 addr v1:172.21.15.81:6793/0 2024-09-10T16:37:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient(hunting): picked mon.noname-h con 0x7f7db413d4d0 addr v1:172.21.15.189:6791/0 2024-09-10T16:37:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 1 -- --> v1:172.21.15.189:6790/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db40723d0 con 0x7f7db4074230 2024-09-10T16:37:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db4071d10 con 0x7f7db413d4d0 2024-09-10T16:37:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 1 -- --> v1:172.21.15.81:6793/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db4073470 con 0x7f7db4137650 2024-09-10T16:37:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient(hunting): _renew_subs 2024-09-10T16:37:04.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient(hunting): authenticate will time out at 1392.088607s 2024-09-10T16:37:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7db8ada640 1 --1- >> v1:172.21.15.81:6793/0 conn(0x7f7db4137650 0x7f7db413bdb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.81:6793/0 says I am v1:172.21.15.81:41806/0 (socket says 172.21.15.81:41806) 2024-09-10T16:37:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7db8ada640 1 -- 172.21.15.81:0/3403686923 learned_addr learned my addr 172.21.15.81:0/3403686923 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:37:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 1 -- 172.21.15.81:0/3403686923 <== mon.8 v1:172.21.15.81:6793/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3782864362 0 0) 0x7f7db4073470 con 0x7f7db4137650 2024-09-10T16:37:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient(hunting): _negotiate 2024-09-10T16:37:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:37:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:37:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient(hunting): my global_id is 6785 2024-09-10T16:37:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 1 -- 172.21.15.81:0/3403686923 --> v1:172.21.15.81:6793/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7da0003530 con 0x7f7db4137650 2024-09-10T16:37:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 1 -- 172.21.15.81:0/3403686923 <== mon.8 v1:172.21.15.81:6793/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3260814328 0 0) 0x7f7da0003530 con 0x7f7db4137650 2024-09-10T16:37:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 1 -- 172.21.15.81:0/3403686923 >> v1:172.21.15.189:6791/0 conn(0x7f7db413d4d0 legacy=0x7f7db413f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:37:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 1 -- 172.21.15.81:0/3403686923 >> v1:172.21.15.189:6790/0 conn(0x7f7db4074230 legacy=0x7f7db4136f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:37:04.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient: _finish_hunting 0 2024-09-10T16:37:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 1 monclient: found mon.noname-e 2024-09-10T16:37:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:37:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient: _send_mon_message to mon.noname-e at v1:172.21.15.81:6793/0 2024-09-10T16:37:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 1 -- 172.21.15.81:0/3403686923 --> v1:172.21.15.81:6793/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db4073750 con 0x7f7db4137650 2024-09-10T16:37:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient: _finish_auth 0 2024-09-10T16:37:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient: _check_auth_tickets 2024-09-10T16:37:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:37:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 5 monclient: authenticate success, global_id 6785 2024-09-10T16:37:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 1 -- 172.21.15.81:0/3403686923 <== mon.8 v1:172.21.15.81:6793/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7da4001840 con 0x7f7db4137650 2024-09-10T16:37:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:37:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:37:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient: got monmap 1 from mon.noname-e (according to old e1) 2024-09-10T16:37:04.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient: dump: 2024-09-10T16:37:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:37:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:37:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:37:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:37:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:37:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:37:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:37:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:37:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:37:04.698 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:37:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:37:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:37:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:37:04.699 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 20 monclient: get_monmap_and_config waiting for monmap|config 2024-09-10T16:37:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 1 -- 172.21.15.81:0/3403686923 <== mon.8 v1:172.21.15.81:6793/0 4 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7da4001a60 con 0x7f7db4137650 2024-09-10T16:37:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient: handle_config config(0 keys) 2024-09-10T16:37:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient: get_monmap_and_config success 2024-09-10T16:37:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 1 -- 172.21.15.81:0/3403686923 <== mon.8 v1:172.21.15.81:6793/0 5 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7da4004bf0 con 0x7f7db4137650 2024-09-10T16:37:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 4 set_mon_vals no callback set 2024-09-10T16:37:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:37:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient: got monmap 1 from mon.e (according to old e1) 2024-09-10T16:37:04.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dabfff640 10 monclient: dump: 2024-09-10T16:37:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:37:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:37:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:37:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:37:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:37:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:37:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:37:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:37:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:37:04.700 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:37:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:37:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:37:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:37:04.701 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient: shutdown 2024-09-10T16:37:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:37:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 1 -- 172.21.15.81:0/3403686923 >> v1:172.21.15.81:6793/0 conn(0x7f7db4137650 legacy=0x7f7db413bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:37:04.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 1 -- 172.21.15.81:0/3403686923 shutdown_connections 2024-09-10T16:37:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 1 -- 172.21.15.81:0/3403686923 >> 172.21.15.81:0/3403686923 conn(0x7f7db40a9da0 msgr2=0x7f7db40aa1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:37:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 1 -- 172.21.15.81:0/3403686923 shutdown_connections 2024-09-10T16:37:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 1 -- 172.21.15.81:0/3403686923 wait complete. 2024-09-10T16:37:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient: build_initial_monmap 2024-09-10T16:37:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient: monmap: 2024-09-10T16:37:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 0 2024-09-10T16:37:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-10T16:37:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 0.000000 2024-09-10T16:37:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:created 0.000000 2024-09-10T16:37:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 0 (unknown) 2024-09-10T16:37:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 1 2024-09-10T16:37:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.noname-a 2024-09-10T16:37:04.702 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.noname-f 2024-09-10T16:37:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.noname-b 2024-09-10T16:37:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.noname-g 2024-09-10T16:37:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.noname-c 2024-09-10T16:37:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.noname-h 2024-09-10T16:37:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.noname-d 2024-09-10T16:37:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.noname-i 2024-09-10T16:37:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.noname-e 2024-09-10T16:37:04.703 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 1 Processor -- start 2024-09-10T16:37:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 1 -- start start 2024-09-10T16:37:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient: init 2024-09-10T16:37:04.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient: _reopen_session rank -1 2024-09-10T16:37:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient: _add_conns ranks=[6,5,1,4,8,7,2,3,0] 2024-09-10T16:37:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient(hunting): picked mon.noname-d con 0x7f7db4074230 addr v1:172.21.15.81:6792/0 2024-09-10T16:37:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient(hunting): picked mon.noname-h con 0x7f7db4137650 addr v1:172.21.15.189:6791/0 2024-09-10T16:37:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient(hunting): picked mon.noname-f con 0x7f7db413d4d0 addr v1:172.21.15.189:6789/0 2024-09-10T16:37:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 1 -- --> v1:172.21.15.189:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db413c200 con 0x7f7db413d4d0 2024-09-10T16:37:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 1 -- --> v1:172.21.15.189:6791/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db40a6f80 con 0x7f7db4137650 2024-09-10T16:37:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 1 -- --> v1:172.21.15.81:6792/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7db4135b30 con 0x7f7db4074230 2024-09-10T16:37:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient(hunting): _renew_subs 2024-09-10T16:37:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7dbb53f640 10 monclient(hunting): authenticate will time out at 1392.091299s 2024-09-10T16:37:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7db92db640 1 --1- >> v1:172.21.15.81:6792/0 conn(0x7f7db4074230 0x7f7db41384b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=1).handle_server_banner_and_identify peer v1:172.21.15.81:6792/0 says I am v1:172.21.15.81:33802/0 (socket says 172.21.15.81:33802) 2024-09-10T16:37:04.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7db92db640 1 -- 172.21.15.81:0/1798775864 learned_addr learned my addr 172.21.15.81:0/1798775864 (peer_addr_for_me v1:172.21.15.81:0/0) 2024-09-10T16:37:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 <== mon.6 v1:172.21.15.81:6792/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3643077297 0 0) 0x7f7db4135b30 con 0x7f7db4074230 2024-09-10T16:37:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7da9ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:37:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7da9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:37:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7da9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:37:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7da9ffb640 10 monclient(hunting): my global_id is 144861 2024-09-10T16:37:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 --> v1:172.21.15.81:6792/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d98003530 con 0x7f7db4074230 2024-09-10T16:37:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 <== mon.6 v1:172.21.15.81:6792/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 764+0+0 (unknown 986853928 0 0) 0x7f7d98003530 con 0x7f7db4074230 2024-09-10T16:37:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 --> v1:172.21.15.81:6792/0 -- auth(proto 2 165 bytes epoch 0) -- 0x7f7db4135b30 con 0x7f7db4074230 2024-09-10T16:37:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 <== mon.6 v1:172.21.15.81:6792/0 3 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7db0001b40 con 0x7f7db4074230 2024-09-10T16:37:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7da9ffb640 10 monclient(hunting): handle_monmap mon_map magic: 0 2024-09-10T16:37:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7da9ffb640 10 monclient(hunting): got monmap 1 from mon.noname-d (according to old e1) 2024-09-10T16:37:04.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7da9ffb640 10 monclient(hunting): dump: 2024-09-10T16:37:04.706 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:37:04.706 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:37:04.706 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.706 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.706 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:37:04.706 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:37:04.706 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:37:04.706 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:37:04.707 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:37:04.707 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:37:04.707 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:37:04.707 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:37:04.707 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:37:04.707 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:37:04.707 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:37:04.707 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:04.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7da9ffb640 10 monclient(hunting): _finish_auth 0 2024-09-10T16:37:04.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.687+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 <== mon.5 v1:172.21.15.189:6791/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2645479004 0 0) 0x7f7db40a6f80 con 0x7f7db4137650 2024-09-10T16:37:04.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 10 monclient(hunting): _negotiate 2024-09-10T16:37:04.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 10 monclient(hunting): _init_auth method 2 2024-09-10T16:37:04.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 10 monclient(hunting): _init_auth creating new auth 2024-09-10T16:37:04.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 10 monclient(hunting): my global_id is 164291 2024-09-10T16:37:04.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 --> v1:172.21.15.189:6791/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d98003530 con 0x7f7db4137650 2024-09-10T16:37:04.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 <== mon.6 v1:172.21.15.81:6792/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 580+0+0 (unknown 299648781 0 0) 0x7f7db4135b30 con 0x7f7db4074230 2024-09-10T16:37:04.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 >> v1:172.21.15.189:6791/0 conn(0x7f7db4137650 legacy=0x7f7db4138bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:37:04.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 >> v1:172.21.15.189:6789/0 conn(0x7f7db413d4d0 legacy=0x7f7db41392d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:37:04.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 10 monclient: _finish_hunting 0 2024-09-10T16:37:04.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 1 monclient: found mon.d 2024-09-10T16:37:04.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 20 monclient: _un_backoff reopen_interval_multipler now 1 2024-09-10T16:37:04.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:37:04.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 --> v1:172.21.15.81:6792/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7db413bf20 con 0x7f7db4074230 2024-09-10T16:37:04.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 10 monclient: _finish_auth 0 2024-09-10T16:37:04.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 10 monclient: _check_auth_tickets 2024-09-10T16:37:04.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 20 monclient: _check_auth_rotating not needed by client.admin 2024-09-10T16:37:04.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7dbb53f640 5 monclient: authenticate success, global_id 144861 2024-09-10T16:37:04.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7dbb53f640 10 monclient: _renew_subs 2024-09-10T16:37:04.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7dbb53f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:37:04.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7dbb53f640 1 -- 172.21.15.81:0/1798775864 --> v1:172.21.15.81:6792/0 -- mon_subscribe({mgrmap=0+}) -- 0x7f7db413adb0 con 0x7f7db4074230 2024-09-10T16:37:04.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7dbb53f640 10 monclient: _renew_subs 2024-09-10T16:37:04.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7dbb53f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:37:04.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7dbb53f640 1 -- 172.21.15.81:0/1798775864 --> v1:172.21.15.81:6792/0 -- mon_subscribe({osdmap=0}) -- 0x7f7db41d4e40 con 0x7f7db4074230 2024-09-10T16:37:04.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 <== mon.6 v1:172.21.15.81:6792/0 5 ==== config(0 keys) ==== 4+0+0 (unknown 0 0 0) 0x7f7db00038d0 con 0x7f7db4074230 2024-09-10T16:37:04.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 10 monclient: handle_config config(0 keys) 2024-09-10T16:37:04.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 <== mon.6 v1:172.21.15.81:6792/0 6 ==== mon_map magic: 0 ==== 722+0+0 (unknown 2740682434 0 0) 0x7f7db0003e40 con 0x7f7db4074230 2024-09-10T16:37:04.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-10T16:37:04.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7dab7fe640 4 set_mon_vals no callback set 2024-09-10T16:37:04.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 10 monclient: got monmap 1 from mon.d (according to old e1) 2024-09-10T16:37:04.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 10 monclient: dump: 2024-09-10T16:37:04.710 INFO:teuthology.orchestra.run.smithi081.stderr:epoch 1 2024-09-10T16:37:04.710 INFO:teuthology.orchestra.run.smithi081.stderr:fsid 9dc0ccd6-5839-4e7c-a06b-dacc65254ee8 2024-09-10T16:37:04.710 INFO:teuthology.orchestra.run.smithi081.stderr:last_changed 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.710 INFO:teuthology.orchestra.run.smithi081.stderr:created 2024-09-10T16:29:22.909160+0000 2024-09-10T16:37:04.710 INFO:teuthology.orchestra.run.smithi081.stderr:min_mon_release 19 (squid) 2024-09-10T16:37:04.711 INFO:teuthology.orchestra.run.smithi081.stderr:election_strategy: 3 2024-09-10T16:37:04.711 INFO:teuthology.orchestra.run.smithi081.stderr:0: v1:172.21.15.81:6789/0 mon.a 2024-09-10T16:37:04.711 INFO:teuthology.orchestra.run.smithi081.stderr:1: v1:172.21.15.189:6789/0 mon.f 2024-09-10T16:37:04.711 INFO:teuthology.orchestra.run.smithi081.stderr:2: v1:172.21.15.81:6790/0 mon.b 2024-09-10T16:37:04.711 INFO:teuthology.orchestra.run.smithi081.stderr:3: v1:172.21.15.189:6790/0 mon.g 2024-09-10T16:37:04.711 INFO:teuthology.orchestra.run.smithi081.stderr:4: v1:172.21.15.81:6791/0 mon.c 2024-09-10T16:37:04.711 INFO:teuthology.orchestra.run.smithi081.stderr:5: v1:172.21.15.189:6791/0 mon.h 2024-09-10T16:37:04.712 INFO:teuthology.orchestra.run.smithi081.stderr:6: v1:172.21.15.81:6792/0 mon.d 2024-09-10T16:37:04.712 INFO:teuthology.orchestra.run.smithi081.stderr:7: v1:172.21.15.189:6792/0 mon.i 2024-09-10T16:37:04.712 INFO:teuthology.orchestra.run.smithi081.stderr:8: v1:172.21.15.81:6793/0 mon.e 2024-09-10T16:37:04.712 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:04.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7dbb53f640 10 start_mon_command cmd=[{"prefix": "get_command_descriptions"}] 2024-09-10T16:37:04.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7dbb53f640 10 monclient: _send_command 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:37:04.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7dbb53f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:37:04.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7dbb53f640 1 -- 172.21.15.81:0/1798775864 --> v1:172.21.15.81:6792/0 -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d94005090 con 0x7f7db4074230 2024-09-10T16:37:04.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 <== mon.6 v1:172.21.15.81:6792/0 7 ==== mgrmap(e 5) ==== 48487+0+0 (unknown 3206189489 0 0) 0x7f7db0003fe0 con 0x7f7db4074230 2024-09-10T16:37:04.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 <== mon.6 v1:172.21.15.81:6792/0 8 ==== osd_map(325..325 src has 121..325) ==== 3506+0+0 (unknown 882838012 0 0) 0x7f7db004ae40 con 0x7f7db4074230 2024-09-10T16:37:04.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.691+0000 7f7db8ada640 10 monclient: get_auth_request con 0x7f7d9803d0a0 auth_method 0 2024-09-10T16:37:04.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.695+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 <== mon.6 v1:172.21.15.81:6792/0 9 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187610 (unknown 1092875540 0 3795843361) 0x7f7db0016c40 con 0x7f7db4074230 2024-09-10T16:37:04.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.695+0000 7f7da9ffb640 10 monclient: handle_mon_command_ack 1 [{"prefix": "get_command_descriptions"}] 2024-09-10T16:37:04.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.695+0000 7f7da9ffb640 10 monclient: _finish_command 1 = system:0 2024-09-10T16:37:04.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.863+0000 7f7dbb53f640 10 start_mon_command cmd=[{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-09-10T16:37:04.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.863+0000 7f7dbb53f640 10 monclient: _send_command 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-09-10T16:37:04.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.863+0000 7f7dbb53f640 10 monclient: _send_mon_message to mon.d at v1:172.21.15.81:6792/0 2024-09-10T16:37:04.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.863+0000 7f7dbb53f640 1 -- 172.21.15.81:0/1798775864 --> v1:172.21.15.81:6792/0 -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f7d94005380 con 0x7f7db4074230 2024-09-10T16:37:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 <== mon.6 v1:172.21.15.81:6792/0 10 ==== config(1 keys) ==== 35+0+0 (unknown 2555425225 0 0) 0x7f7db0016120 con 0x7f7db4074230 2024-09-10T16:37:04.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7da9ffb640 10 monclient: handle_config config(1 keys) 2024-09-10T16:37:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7dab7fe640 4 set_mon_vals no callback set 2024-09-10T16:37:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7dab7fe640 10 set_mon_vals mon_health_to_clog = false 2024-09-10T16:37:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7da9ffb640 1 -- 172.21.15.81:0/1798775864 <== mon.6 v1:172.21.15.81:6792/0 11 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v7)=0 v7) ==== 123+0+0 (unknown 3414686427 0 0) 0x7f7db001b020 con 0x7f7db4074230 2024-09-10T16:37:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7da9ffb640 10 monclient: handle_mon_command_ack 2 [{"prefix": "config set", "who": "global", "name": "mon_health_to_clog", "value": "false"}] 2024-09-10T16:37:04.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7da9ffb640 10 monclient: _finish_command 2 = system:0 2024-09-10T16:37:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7dbb53f640 1 -- 172.21.15.81:0/1798775864 >> v1:172.21.15.189:6812/1108603242 conn(0x7f7d9803d0a0 legacy=0x7f7d9803f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:37:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7dbb53f640 10 monclient: shutdown 2024-09-10T16:37:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7dbb53f640 20 monclient: shutdown discarding 0 pending message(s) 2024-09-10T16:37:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7dbb53f640 1 -- 172.21.15.81:0/1798775864 >> v1:172.21.15.81:6792/0 conn(0x7f7db4074230 legacy=0x7f7db41384b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-10T16:37:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7dbb53f640 1 -- 172.21.15.81:0/1798775864 shutdown_connections 2024-09-10T16:37:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7dbb53f640 1 -- 172.21.15.81:0/1798775864 >> 172.21.15.81:0/1798775864 conn(0x7f7db40a9da0 msgr2=0x7f7db40a6770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-10T16:37:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7dbb53f640 1 -- 172.21.15.81:0/1798775864 shutdown_connections 2024-09-10T16:37:04.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-10T16:37:04.875+0000 7f7dbb53f640 1 -- 172.21.15.81:0/1798775864 wait complete. 2024-09-10T16:37:04.895 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-10T16:37:04.896 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-10T16:37:04.896 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-10T16:37:04.896 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:04.962 INFO:tasks.ceph.osd.0:Stopped 2024-09-10T16:37:04.963 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-10T16:37:04.963 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:05.037 INFO:tasks.ceph.osd.1:Stopped 2024-09-10T16:37:05.038 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-10T16:37:05.038 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:05.122 INFO:tasks.ceph.osd.2:Stopped 2024-09-10T16:37:05.123 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-10T16:37:05.123 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:05.190 INFO:tasks.ceph.osd.3:Stopped 2024-09-10T16:37:05.191 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-10T16:37:05.191 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:10.095 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-09-10T16:37:11.293 INFO:tasks.ceph.osd.4:Stopped 2024-09-10T16:37:11.293 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-10T16:37:11.293 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:11.353 INFO:tasks.ceph.osd.5:Stopped 2024-09-10T16:37:11.353 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-10T16:37:11.353 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-10T16:37:11.353 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:11.383 INFO:tasks.ceph.mgr.x:Stopped 2024-09-10T16:37:11.383 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-10T16:37:11.383 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-10T16:37:11.383 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:11.411 INFO:tasks.ceph.mon.a:Stopped 2024-09-10T16:37:11.411 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-10T16:37:11.411 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:11.469 INFO:tasks.ceph.mon.b:Stopped 2024-09-10T16:37:11.469 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-10T16:37:11.470 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:11.527 INFO:tasks.ceph.mon.c:Stopped 2024-09-10T16:37:11.527 DEBUG:tasks.ceph.mon.d:waiting for process to exit 2024-09-10T16:37:11.527 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:11.582 INFO:tasks.ceph.mon.d:Stopped 2024-09-10T16:37:11.583 DEBUG:tasks.ceph.mon.e:waiting for process to exit 2024-09-10T16:37:11.583 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:11.640 INFO:tasks.ceph.mon.e:Stopped 2024-09-10T16:37:11.640 DEBUG:tasks.ceph.mon.f:waiting for process to exit 2024-09-10T16:37:11.640 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:11.663 INFO:tasks.ceph.mon.f:Stopped 2024-09-10T16:37:11.663 DEBUG:tasks.ceph.mon.g:waiting for process to exit 2024-09-10T16:37:11.663 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:11.720 INFO:tasks.ceph.mon.g:Stopped 2024-09-10T16:37:11.721 DEBUG:tasks.ceph.mon.h:waiting for process to exit 2024-09-10T16:37:11.721 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:11.777 INFO:tasks.ceph.mon.h:Stopped 2024-09-10T16:37:11.778 DEBUG:tasks.ceph.mon.i:waiting for process to exit 2024-09-10T16:37:11.778 INFO:teuthology.orchestra.run:waiting for 300 2024-09-10T16:37:11.842 INFO:tasks.ceph.mon.i:Stopped 2024-09-10T16:37:11.842 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-10T16:37:11.842 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v ScrubResult | egrep -v 'scrub mismatch' | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'slow request' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | head -n 1 2024-09-10T16:37:11.862 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T16:37:11.862 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-10T16:37:12.203 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T16:37:12.204 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-10T16:37:12.454 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T16:37:12.454 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-10T16:37:12.630 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T16:37:12.630 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-10T16:37:12.824 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T16:37:12.825 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-10T16:37:13.020 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T16:37:13.020 DEBUG:teuthology.orchestra.run.smithi189:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-10T16:37:13.238 INFO:tasks.ceph:Archiving mon data... 2024-09-10T16:37:13.240 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/data/mon.a.tgz 2024-09-10T16:37:13.240 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-10T16:37:13.246 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.zo2Zn80cKu 2024-09-10T16:37:13.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.zo2Zn80cKu 2024-09-10T16:37:13.344 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.zo2Zn80cKu 2024-09-10T16:37:13.410 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.zo2Zn80cKu is 219KB 2024-09-10T16:37:13.469 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.zo2Zn80cKu 2024-09-10T16:37:13.475 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/data/mon.b.tgz 2024-09-10T16:37:13.475 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-10T16:37:13.520 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.F3JxamdwGh 2024-09-10T16:37:13.521 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.F3JxamdwGh 2024-09-10T16:37:13.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.F3JxamdwGh 2024-09-10T16:37:13.679 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.F3JxamdwGh is 211KB 2024-09-10T16:37:13.738 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.F3JxamdwGh 2024-09-10T16:37:13.745 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/data/mon.c.tgz 2024-09-10T16:37:13.745 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-10T16:37:13.792 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.RVfxAmZf24 2024-09-10T16:37:13.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.RVfxAmZf24 2024-09-10T16:37:13.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.RVfxAmZf24 2024-09-10T16:37:13.957 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.RVfxAmZf24 is 211KB 2024-09-10T16:37:14.066 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.RVfxAmZf24 2024-09-10T16:37:14.071 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-d to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/data/mon.d.tgz 2024-09-10T16:37:14.071 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-10T16:37:14.120 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.sis41ELxMy 2024-09-10T16:37:14.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-d -- . > /tmp/tmp.sis41ELxMy 2024-09-10T16:37:14.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.sis41ELxMy 2024-09-10T16:37:14.279 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.sis41ELxMy is 211KB 2024-09-10T16:37:14.337 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.sis41ELxMy 2024-09-10T16:37:14.343 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-e to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/data/mon.e.tgz 2024-09-10T16:37:14.343 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-10T16:37:14.392 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.RwdQ1dqoEy 2024-09-10T16:37:14.392 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-e -- . > /tmp/tmp.RwdQ1dqoEy 2024-09-10T16:37:14.491 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.RwdQ1dqoEy 2024-09-10T16:37:14.561 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.RwdQ1dqoEy is 219KB 2024-09-10T16:37:14.662 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.RwdQ1dqoEy 2024-09-10T16:37:14.669 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/mon/ceph-f to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/data/mon.f.tgz 2024-09-10T16:37:14.669 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-09-10T16:37:14.675 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.17JVLzRI4k 2024-09-10T16:37:14.675 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-f -- . > /tmp/tmp.17JVLzRI4k 2024-09-10T16:37:14.771 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.17JVLzRI4k 2024-09-10T16:37:14.837 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.17JVLzRI4k is 209KB 2024-09-10T16:37:14.895 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.17JVLzRI4k 2024-09-10T16:37:14.900 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/mon/ceph-g to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/data/mon.g.tgz 2024-09-10T16:37:14.901 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-09-10T16:37:14.949 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.J86RD9LKqj 2024-09-10T16:37:14.949 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-g -- . > /tmp/tmp.J86RD9LKqj 2024-09-10T16:37:15.048 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.J86RD9LKqj 2024-09-10T16:37:15.096 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-09-10T16:37:15.114 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.J86RD9LKqj is 209KB 2024-09-10T16:37:15.171 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.J86RD9LKqj 2024-09-10T16:37:15.176 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/mon/ceph-h to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/data/mon.h.tgz 2024-09-10T16:37:15.177 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-09-10T16:37:15.225 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.ifgQaxLCGW 2024-09-10T16:37:15.225 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-h -- . > /tmp/tmp.ifgQaxLCGW 2024-09-10T16:37:15.319 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.ifgQaxLCGW 2024-09-10T16:37:15.381 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.ifgQaxLCGW is 209KB 2024-09-10T16:37:15.439 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.ifgQaxLCGW 2024-09-10T16:37:15.445 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/mon/ceph-i to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/data/mon.i.tgz 2024-09-10T16:37:15.445 DEBUG:teuthology.orchestra.run.smithi189:> mktemp 2024-09-10T16:37:15.494 INFO:teuthology.orchestra.run.smithi189.stdout:/tmp/tmp.bdO5hcBebc 2024-09-10T16:37:15.494 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-i -- . > /tmp/tmp.bdO5hcBebc 2024-09-10T16:37:15.585 DEBUG:teuthology.orchestra.run.smithi189:> sudo chmod 0666 /tmp/tmp.bdO5hcBebc 2024-09-10T16:37:15.650 DEBUG:teuthology.orchestra.remote:smithi189:/tmp/tmp.bdO5hcBebc is 209KB 2024-09-10T16:37:15.707 DEBUG:teuthology.orchestra.run.smithi189:> rm -fr /tmp/tmp.bdO5hcBebc 2024-09-10T16:37:15.713 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-10T16:37:15.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T16:37:15.716 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-10T16:37:15.776 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T16:37:15.818 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-10T16:37:15.818 INFO:tasks.ceph:Archiving crash dumps... 2024-09-10T16:37:15.820 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/remote/smithi081/crash 2024-09-10T16:37:15.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T16:37:15.834 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/lib/ceph/crash to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/remote/smithi189/crash 2024-09-10T16:37:15.834 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-10T16:37:15.873 INFO:tasks.ceph:Compressing logs... 2024-09-10T16:37:15.874 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T16:37:15.881 DEBUG:teuthology.orchestra.run.smithi189:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-10T16:37:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29979.log 2024-09-10T16:37:15.906 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.21476.log 2024-09-10T16:37:15.907 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29639.log 2024-09-10T16:37:15.907 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.tmp-client.admin.21476.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29979.log.gz 2024-09-10T16:37:15.907 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.21476.log.gz 2024-09-10T16:37:15.907 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30567.log 2024-09-10T16:37:15.907 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30619.log 2024-09-10T16:37:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30567.log: /var/log/ceph/ceph-client.admin.29639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28358.log 2024-09-10T16:37:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30619.log: gzip 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30567.log.gz -5 2024-09-10T16:37:15.909 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31344.log 2024-09-10T16:37:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28358.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30619.log.gz 2024-09-10T16:37:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30191.log 2024-09-10T16:37:15.910 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29639.log.gz 2024-09-10T16:37:15.910 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28358.log.gz 2024-09-10T16:37:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29665.log 2024-09-10T16:37:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30191.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31344.log.gz 2024-09-10T16:37:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-10T16:37:15.910 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30191.log.gz 2024-09-10T16:37:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29873.log 2024-09-10T16:37:15.913 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30111.log 2024-09-10T16:37:15.913 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29665.log.gz 2024-09-10T16:37:15.913 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30645.log 2024-09-10T16:37:15.913 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29873.log.gz 2024-09-10T16:37:15.913 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30137.log 2024-09-10T16:37:15.913 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.30645.log: -- /var/log/ceph/ceph-client.admin.31968.log 2024-09-10T16:37:15.914 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30111.log.gz 2024-09-10T16:37:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31630.log 2024-09-10T16:37:15.914 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30137.log.gz 2024-09-10T16:37:15.914 INFO:teuthology.orchestra.run.smithi081.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.30645.log.gz 2024-09-10T16:37:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30673.log 2024-09-10T16:37:15.914 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.31968.log.gz 2024-09-10T16:37:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31119.log 2024-09-10T16:37:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31760.log 2024-09-10T16:37:15.914 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31630.log.gz 2024-09-10T16:37:15.914 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29291.log 2024-09-10T16:37:15.914 INFO:teuthology.orchestra.run.smithi081.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30673.log.gz 2024-09-10T16:37:15.918 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31119.log.gz 2024-09-10T16:37:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29927.log 2024-09-10T16:37:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28821.log 2024-09-10T16:37:15.918 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31760.log.gz 2024-09-10T16:37:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29927.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29291.log.gz 2024-09-10T16:37:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31448.log 2024-09-10T16:37:15.918 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29057.log 2024-09-10T16:37:15.918 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29927.log.gz 2024-09-10T16:37:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30831.log 2024-09-10T16:37:15.919 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28821.log.gz 2024-09-10T16:37:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29057.log: gzip -5 89.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.31448.log.gz -- 2024-09-10T16:37:15.919 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.29691.log 2024-09-10T16:37:15.919 INFO:teuthology.orchestra.run.smithi081.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29057.log.gz 2024-09-10T16:37:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29265.log 2024-09-10T16:37:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29691.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-10T16:37:15.919 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.30831.log.gz 2024-09-10T16:37:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29265.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29691.log.gz 2024-09-10T16:37:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31015.log 2024-09-10T16:37:15.919 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7%/var/log/ceph/ceph-osd.2.log: -- replaced with /var/log/ceph/ceph-client.admin.29265.log.gz 2024-09-10T16:37:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31552.log 2024-09-10T16:37:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31067.log 2024-09-10T16:37:15.919 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28549.log 2024-09-10T16:37:15.920 INFO:teuthology.orchestra.run.smithi081.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31015.log.gz 2024-09-10T16:37:15.923 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31552.log.gz 2024-09-10T16:37:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28899.log 2024-09-10T16:37:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28549.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31067.log.gz 2024-09-10T16:37:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-10T16:37:15.923 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28549.log.gz 2024-09-10T16:37:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31526.log 2024-09-10T16:37:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28899.log: /var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29901.log 2024-09-10T16:37:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31526.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.e.log 2024-09-10T16:37:15.923 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.28899.log.gz 2024-09-10T16:37:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29901.log: gzip 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31526.log.gz -5 2024-09-10T16:37:15.923 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.30883.log 2024-09-10T16:37:15.923 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.e.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.29901.log.gz 2024-09-10T16:37:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31812.log 2024-09-10T16:37:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29109.log 2024-09-10T16:37:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30541.log 2024-09-10T16:37:15.924 INFO:teuthology.orchestra.run.smithi081.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30883.log.gz 2024-09-10T16:37:15.924 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31812.log.gz 2024-09-10T16:37:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29317.log 2024-09-10T16:37:15.924 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29161.log 2024-09-10T16:37:15.929 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30541.log: 88.8%/var/log/ceph/ceph-client.admin.29317.log: -- replaced with /var/log/ceph/ceph-client.admin.29109.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30911.log 2024-09-10T16:37:15.929 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:15.929 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30541.log.gz 2024-09-10T16:37:15.929 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29161.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29317.log.gz 2024-09-10T16:37:15.929 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28367.log 2024-09-10T16:37:15.929 INFO:teuthology.orchestra.run.smithi081.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29161.log.gz 2024-09-10T16:37:15.929 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28977.log 2024-09-10T16:37:15.929 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30083.log 2024-09-10T16:37:15.929 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28367.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30911.log.gz 2024-09-10T16:37:15.929 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31578.log 2024-09-10T16:37:15.930 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28367.log.gz 2024-09-10T16:37:15.930 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30083.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.28977.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31994.log 2024-09-10T16:37:15.930 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:15.930 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31890.log 2024-09-10T16:37:15.930 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31578.log: -- replaced with /var/log/ceph/ceph-client.admin.30083.log.gz 2024-09-10T16:37:15.930 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30699.log 2024-09-10T16:37:15.930 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31994.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31578.log.gz 2024-09-10T16:37:15.930 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32122.log 2024-09-10T16:37:15.930 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31994.log.gz 2024-09-10T16:37:15.930 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28373.log 2024-09-10T16:37:15.930 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.31890.log.gz 2024-09-10T16:37:15.930 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30699.log: /var/log/ceph/ceph-client.admin.32122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28873.log 2024-09-10T16:37:15.930 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30699.log.gz 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32122.log.gz 2024-09-10T16:37:15.930 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:15.931 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28847.log 2024-09-10T16:37:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29449.log 2024-09-10T16:37:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28873.log: 86.9%/var/log/ceph/ceph-client.admin.28847.log: -- replaced with /var/log/ceph/ceph-client.admin.28373.log.gz 2024-09-10T16:37:15.936 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29239.log 2024-09-10T16:37:15.937 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28873.log.gz 2024-09-10T16:37:15.937 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28847.log.gz 2024-09-10T16:37:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31197.log 2024-09-10T16:37:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31171.log 2024-09-10T16:37:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29239.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29449.log.gz 2024-09-10T16:37:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29769.log 2024-09-10T16:37:15.937 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29239.log.gz/var/log/ceph/ceph-client.admin.31171.log: 2024-09-10T16:37:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30031.log 2024-09-10T16:37:15.937 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31197.log.gz 2024-09-10T16:37:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30515.log 2024-09-10T16:37:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29769.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31171.log.gz 2024-09-10T16:37:15.937 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32098.log 2024-09-10T16:37:15.937 INFO:teuthology.orchestra.run.smithi081.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.29769.log.gz 2024-09-10T16:37:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31864.log 2024-09-10T16:37:15.938 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30031.log.gz/var/log/ceph/ceph-client.admin.30515.log: 2024-09-10T16:37:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.32098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30805.log 2024-09-10T16:37:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31864.log: 87.8%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32072.log 2024-09-10T16:37:15.938 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32098.log.gz 2024-09-10T16:37:15.938 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30515.log.gz 2024-09-10T16:37:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30805.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31864.log.gz 2024-09-10T16:37:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28179.log 2024-09-10T16:37:15.938 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30805.log.gz 2024-09-10T16:37:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.32072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31604.log 2024-09-10T16:37:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29371.log 2024-09-10T16:37:15.938 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32072.log.gz 2024-09-10T16:37:15.938 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30937.log 2024-09-10T16:37:15.938 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28179.log.gz 2024-09-10T16:37:15.939 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4%/var/log/ceph/ceph-client.admin.29371.log: -- replaced with /var/log/ceph/ceph-client.admin.31604.log.gz 2024-09-10T16:37:15.939 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30989.log 2024-09-10T16:37:15.939 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29371.log.gz 2024-09-10T16:37:15.946 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25485.log 2024-09-10T16:37:15.946 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30937.log: /var/log/ceph/ceph-client.admin.30989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30269.log 2024-09-10T16:37:15.946 INFO:teuthology.orchestra.run.smithi081.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30937.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-10T16:37:15.946 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:15.946 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30989.log.gz 2024-09-10T16:37:15.947 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25485.log: /var/log/ceph/ceph-client.admin.30269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30217.log 2024-09-10T16:37:15.947 INFO:teuthology.orchestra.run.smithi081.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.25485.log.gz 2024-09-10T16:37:15.947 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28369.log 2024-09-10T16:37:15.947 INFO:teuthology.orchestra.run.smithi081.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.30269.log.gz 2024-09-10T16:37:15.947 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29397.log 2024-09-10T16:37:15.947 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30217.log: /var/log/ceph/ceph-client.admin.28369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29003.log 2024-09-10T16:37:15.947 INFO:teuthology.orchestra.run.smithi081.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30217.log.gz 2024-09-10T16:37:15.947 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.28369.log.gz 2024-09-10T16:37:15.947 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29397.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29397.log.gz 2024-09-10T16:37:15.947 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29135.log 2024-09-10T16:37:15.947 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28327.log 2024-09-10T16:37:15.947 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29135.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.d.log 2024-09-10T16:37:15.947 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29003.log.gz 2024-09-10T16:37:15.948 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28327.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.29135.log.gz 2024-09-10T16:37:15.948 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28327.log.gz 2024-09-10T16:37:15.948 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30777.log 2024-09-10T16:37:15.948 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31786.log 2024-09-10T16:37:15.948 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29213.log 2024-09-10T16:37:15.948 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7%/var/log/ceph/ceph-client.admin.31786.log: -- replaced with /var/log/ceph/ceph-client.admin.30777.log.gz 2024-09-10T16:37:15.948 INFO:teuthology.orchestra.run.smithi081.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.31786.log.gz 2024-09-10T16:37:15.948 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29613.log 2024-09-10T16:37:15.948 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28697.log 2024-09-10T16:37:15.948 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29613.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29213.log.gz 2024-09-10T16:37:15.948 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.29613.log.gz 2024-09-10T16:37:15.954 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29423.log 2024-09-10T16:37:15.954 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29717.log 2024-09-10T16:37:15.954 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3%/var/log/ceph/ceph-client.admin.29423.log: -- replaced with /var/log/ceph/ceph-client.admin.28697.log.gz 2024-09-10T16:37:15.955 INFO:teuthology.orchestra.run.smithi081.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29423.log.gz 2024-09-10T16:37:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30057.log 2024-09-10T16:37:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31656.log 2024-09-10T16:37:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30057.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29717.log.gz 2024-09-10T16:37:15.955 INFO:teuthology.orchestra.run.smithi081.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30057.log.gz 2024-09-10T16:37:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30163.log 2024-09-10T16:37:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31093.log 2024-09-10T16:37:15.955 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3%/var/log/ceph/ceph-client.admin.30163.log: -- replaced with /var/log/ceph/ceph-client.admin.31656.log.gz 2024-09-10T16:37:15.955 INFO:teuthology.orchestra.run.smithi081.stderr: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.30163.log.gz 2024-09-10T16:37:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T16:37:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28366.log 2024-09-10T16:37:15.955 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31093.log.gz 2024-09-10T16:37:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29475.log 2024-09-10T16:37:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28366.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28366.log.gz 2024-09-10T16:37:15.958 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30857.log 2024-09-10T16:37:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29475.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29475.log.gz 2024-09-10T16:37:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30963.log 2024-09-10T16:37:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30857.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.30857.log.gz 2024-09-10T16:37:15.971 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31396.log 2024-09-10T16:37:15.972 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30963.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.30963.log.gz 2024-09-10T16:37:15.972 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31942.log 2024-09-10T16:37:15.972 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31396.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31396.log.gz 2024-09-10T16:37:15.972 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28249.log 2024-09-10T16:37:15.972 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31942.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31942.log.gz 2024-09-10T16:37:15.972 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31145.log 2024-09-10T16:37:15.972 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28249.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28249.log.gz 2024-09-10T16:37:15.972 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28538.log 2024-09-10T16:37:15.972 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31145.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.31145.log.gz 2024-09-10T16:37:15.972 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28275.log 2024-09-10T16:37:15.972 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28538.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28538.log.gz 2024-09-10T16:37:15.972 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31682.log 2024-09-10T16:37:15.973 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28275.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28275.log.gz 2024-09-10T16:37:15.973 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-10T16:37:15.973 INFO:teuthology.orchestra.run.smithi081.stderr: 93.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T16:37:15.982 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31682.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31682.log.gz 2024-09-10T16:37:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31041.log 2024-09-10T16:37:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29953.log 2024-09-10T16:37:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31041.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.31041.log.gz 2024-09-10T16:37:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29187.log 2024-09-10T16:37:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29953.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29953.log.gz 2024-09-10T16:37:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29501.log 2024-09-10T16:37:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29187.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29187.log.gz 2024-09-10T16:37:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28204.log 2024-09-10T16:37:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29501.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29501.log.gz 2024-09-10T16:37:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29821.log 2024-09-10T16:37:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28204.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28204.log.gz 2024-09-10T16:37:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31370.log 2024-09-10T16:37:15.983 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29821.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.29821.log.gz 2024-09-10T16:37:15.984 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29847.log 2024-09-10T16:37:15.984 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31370.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31370.log.gz 2024-09-10T16:37:15.984 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31708.log 2024-09-10T16:37:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29847.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29847.log.gz 2024-09-10T16:37:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28703.log 2024-09-10T16:37:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31708.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31708.log.gz 2024-09-10T16:37:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T16:37:15.987 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28703.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28703.log.gz 2024-09-10T16:37:15.988 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30243.log 2024-09-10T16:37:16.003 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.audit.log: 96.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T16:37:16.003 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32020.log 2024-09-10T16:37:16.003 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30243.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30243.log.gz 2024-09-10T16:37:16.003 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28665.log 2024-09-10T16:37:16.003 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.32020.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32020.log.gz 2024-09-10T16:37:16.003 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31474.log 2024-09-10T16:37:16.003 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28665.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28665.log.gz 2024-09-10T16:37:16.003 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30297.log 2024-09-10T16:37:16.003 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31474.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.31474.log.gz 2024-09-10T16:37:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30593.log 2024-09-10T16:37:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30297.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30297.log.gz 2024-09-10T16:37:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28689.log 2024-09-10T16:37:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30593.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.30593.log.gz 2024-09-10T16:37:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28727.log 2024-09-10T16:37:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28689.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28689.log.gz 2024-09-10T16:37:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31314.log 2024-09-10T16:37:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28727.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28727.log.gz 2024-09-10T16:37:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29083.log 2024-09-10T16:37:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31314.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31314.log.gz 2024-09-10T16:37:16.004 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31500.log 2024-09-10T16:37:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29083.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29083.log.gz 2024-09-10T16:37:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28547.log 2024-09-10T16:37:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31500.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31500.log.gz 2024-09-10T16:37:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31422.log 2024-09-10T16:37:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28547.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28547.log.gz 2024-09-10T16:37:16.013 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28372.log 2024-09-10T16:37:16.014 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31422.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.31422.log.gz 2024-09-10T16:37:16.014 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31223.log 2024-09-10T16:37:16.014 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28372.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28372.log.gz 2024-09-10T16:37:16.014 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27937.log 2024-09-10T16:37:16.014 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31223.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31223.log.gz 2024-09-10T16:37:16.014 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-10T16:37:16.014 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.27937.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.27937.log.gz 2024-09-10T16:37:16.014 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31734.log 2024-09-10T16:37:16.019 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29478.log 2024-09-10T16:37:16.020 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28746.log 2024-09-10T16:37:16.020 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28834.log 2024-09-10T16:37:16.020 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29391.log 2024-09-10T16:37:16.020 INFO:teuthology.orchestra.run.smithi189.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29478.log.gz 2024-09-10T16:37:16.020 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29530.log 2024-09-10T16:37:16.020 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29650.log 2024-09-10T16:37:16.020 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28834.log.gz 2024-09-10T16:37:16.020 INFO:teuthology.orchestra.run.smithi189.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28746.log.gz 2024-09-10T16:37:16.020 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29304.log 2024-09-10T16:37:16.020 INFO:teuthology.orchestra.run.smithi189.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29391.log.gz 2024-09-10T16:37:16.020 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31745.log 2024-09-10T16:37:16.020 INFO:teuthology.orchestra.run.smithi189.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29530.log.gz 2024-09-10T16:37:16.021 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31305.log 2024-09-10T16:37:16.021 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29302.log 2024-09-10T16:37:16.021 INFO:teuthology.orchestra.run.smithi189.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29650.log.gz 2024-09-10T16:37:16.021 INFO:teuthology.orchestra.run.smithi189.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29304.log.gz 2024-09-10T16:37:16.021 INFO:teuthology.orchestra.run.smithi189.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31745.log.gz 2024-09-10T16:37:16.021 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31054.log 2024-09-10T16:37:16.021 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30566.log 2024-09-10T16:37:16.021 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29302.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31305.log.gz 2024-09-10T16:37:16.021 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30391.log 2024-09-10T16:37:16.021 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31054.log: /var/log/ceph/ceph-client.admin.30566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29476.log 2024-09-10T16:37:16.021 INFO:teuthology.orchestra.run.smithi189.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31054.log.gz 2024-09-10T16:37:16.021 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29302.log.gz 2024-09-10T16:37:16.022 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31920.log 2024-09-10T16:37:16.022 INFO:teuthology.orchestra.run.smithi189.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.30566.log.gz 2024-09-10T16:37:16.022 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31746.log 2024-09-10T16:37:16.022 INFO:teuthology.orchestra.run.smithi189.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.30391.log.gz 2024-09-10T16:37:16.022 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30966.log 2024-09-10T16:37:16.022 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31920.log: /var/log/ceph/ceph-client.admin.31746.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29476.log.gz 2024-09-10T16:37:16.022 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32145.log 2024-09-10T16:37:16.022 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28956.log 2024-09-10T16:37:16.022 INFO:teuthology.orchestra.run.smithi189.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.31920.log.gz 2024-09-10T16:37:16.022 INFO:teuthology.orchestra.run.smithi189.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.31746.log.gz 2024-09-10T16:37:16.022 INFO:teuthology.orchestra.run.smithi189.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30966.log.gz 2024-09-10T16:37:16.022 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29834.log 2024-09-10T16:37:16.022 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28956.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.f.log 2024-09-10T16:37:16.022 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31271.log 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29834.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32145.log.gz 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.28956.log.gz 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mon.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29746.log 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.29834.log.gz 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28921.log 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31271.log: /var/log/ceph/ceph-client.admin.29746.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28519.log 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31271.log.gz 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28660.log 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28780.log 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28921.log.gz 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28660.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29746.log.gz 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31657.log 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28519.log.gz 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28780.log: 87.6%gzip -- replaced with /var/log/ceph/ceph-client.admin.28660.log.gz -5 2024-09-10T16:37:16.023 INFO:teuthology.orchestra.run.smithi189.stderr: --verbose -- /var/log/ceph/ceph-client.admin.31395.log 2024-09-10T16:37:16.024 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31918.log 2024-09-10T16:37:16.024 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31657.log: /var/log/ceph/ceph-client.admin.31395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32410.log 2024-09-10T16:37:16.024 INFO:teuthology.orchestra.run.smithi189.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28780.log.gz 2024-09-10T16:37:16.024 INFO:teuthology.orchestra.run.smithi189.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.31395.log.gz 2024-09-10T16:37:16.024 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31537.log 2024-09-10T16:37:16.024 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31657.log.gz 2024-09-10T16:37:16.024 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30303.log 2024-09-10T16:37:16.024 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32410.log: /var/log/ceph/ceph-client.admin.31537.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30094.log 2024-09-10T16:37:16.025 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31918.log.gz 2024-09-10T16:37:16.025 INFO:teuthology.orchestra.run.smithi189.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31537.log.gz 2024-09-10T16:37:16.025 INFO:teuthology.orchestra.run.smithi189.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32410.log.gz 2024-09-10T16:37:16.025 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31000.log 2024-09-10T16:37:16.025 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31710.log 2024-09-10T16:37:16.025 INFO:teuthology.orchestra.run.smithi189.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30303.log.gz 2024-09-10T16:37:16.025 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29956.log 2024-09-10T16:37:16.025 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31000.log: /var/log/ceph/ceph-client.admin.31710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30652.log 2024-09-10T16:37:16.025 INFO:teuthology.orchestra.run.smithi189.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31000.log.gz 2024-09-10T16:37:16.025 INFO:teuthology.orchestra.run.smithi189.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30094.log.gz 2024-09-10T16:37:16.025 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29355.log 2024-09-10T16:37:16.025 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29956.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31710.log.gz 2024-09-10T16:37:16.026 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30704.log 2024-09-10T16:37:16.026 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30130.log 2024-09-10T16:37:16.026 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29355.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.29956.log.gz 2024-09-10T16:37:16.026 INFO:teuthology.orchestra.run.smithi189.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30652.log.gz 2024-09-10T16:37:16.026 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29129.log 2024-09-10T16:37:16.026 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31088.log 2024-09-10T16:37:16.026 INFO:teuthology.orchestra.run.smithi189.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30704.log.gz 2024-09-10T16:37:16.026 INFO:teuthology.orchestra.run.smithi189.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29355.log.gz 2024-09-10T16:37:16.026 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32409.log 2024-09-10T16:37:16.026 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29129.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.30130.log.gz 2024-09-10T16:37:16.026 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31359.log 2024-09-10T16:37:16.026 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31088.log: /var/log/ceph/ceph-client.admin.32409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32233.log 2024-09-10T16:37:16.026 INFO:teuthology.orchestra.run.smithi189.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29129.log.gz 2024-09-10T16:37:16.026 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31359.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.32005.log 2024-09-10T16:37:16.027 INFO:teuthology.orchestra.run.smithi189.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31088.log.gz 2024-09-10T16:37:16.027 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29269.log 2024-09-10T16:37:16.027 INFO:teuthology.orchestra.run.smithi189.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32409.log.gz 2024-09-10T16:37:16.027 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32005.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.32233.log.gz 2024-09-10T16:37:16.027 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31001.log 2024-09-10T16:37:16.027 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29182.log 2024-09-10T16:37:16.027 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29269.log: /var/log/ceph/ceph-client.admin.31001.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31359.log.gz 2024-09-10T16:37:16.027 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28695.log 2024-09-10T16:37:16.027 INFO:teuthology.orchestra.run.smithi189.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29269.log.gz 2024-09-10T16:37:16.027 INFO:teuthology.orchestra.run.smithi189.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32005.log.gz 2024-09-10T16:37:16.027 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29833.log 2024-09-10T16:37:16.027 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29182.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31001.log.gz 2024-09-10T16:37:16.028 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29095.log 2024-09-10T16:37:16.028 INFO:teuthology.orchestra.run.smithi189.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29182.log.gz 2024-09-10T16:37:16.028 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31216.log 2024-09-10T16:37:16.028 INFO:teuthology.orchestra.run.smithi189.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28695.log.gz 2024-09-10T16:37:16.028 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31394.log 2024-09-10T16:37:16.028 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31797.log 2024-09-10T16:37:16.028 INFO:teuthology.orchestra.run.smithi189.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29095.log.gz 2024-09-10T16:37:16.028 INFO:teuthology.orchestra.run.smithi189.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29833.log.gz 2024-09-10T16:37:16.028 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32094.log 2024-09-10T16:37:16.028 INFO:teuthology.orchestra.run.smithi189.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31394.log.gz 2024-09-10T16:37:16.028 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29217.log 2024-09-10T16:37:16.028 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31216.log.gz 2024-09-10T16:37:16.029 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28434.log 2024-09-10T16:37:16.029 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32094.log: /var/log/ceph/ceph-client.admin.29217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30530.log 2024-09-10T16:37:16.029 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31797.log.gz 2024-09-10T16:37:16.029 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28434.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32094.log.gz 2024-09-10T16:37:16.029 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30355.log 2024-09-10T16:37:16.029 INFO:teuthology.orchestra.run.smithi189.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29217.log.gz 2024-09-10T16:37:16.029 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30095.log 2024-09-10T16:37:16.029 INFO:teuthology.orchestra.run.smithi189.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.28434.log.gz 2024-09-10T16:37:16.029 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29303.log 2024-09-10T16:37:16.029 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32354.log 2024-09-10T16:37:16.029 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30095.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30530.log.gz 2024-09-10T16:37:16.029 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29303.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30355.log.gz 2024-09-10T16:37:16.029 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32267.log 2024-09-10T16:37:16.030 INFO:teuthology.orchestra.run.smithi189.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30095.log.gz 2024-09-10T16:37:16.030 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32354.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25463.log 2024-09-10T16:37:16.030 INFO:teuthology.orchestra.run.smithi189.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29303.log.gz 2024-09-10T16:37:16.030 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32267.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32354.log.gz 2024-09-10T16:37:16.030 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31217.log 2024-09-10T16:37:16.030 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.25463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29356.log 2024-09-10T16:37:16.030 INFO:teuthology.orchestra.run.smithi189.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.32267.log.gz 2024-09-10T16:37:16.030 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31217.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.25463.log.gz 2024-09-10T16:37:16.030 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31884.log 2024-09-10T16:37:16.030 INFO:teuthology.orchestra.run.smithi189.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31217.log.gz 2024-09-10T16:37:16.030 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28399.log 2024-09-10T16:37:16.030 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30477.log 2024-09-10T16:37:16.030 INFO:teuthology.orchestra.run.smithi189.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29356.log.gz 2024-09-10T16:37:16.031 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28520.log 2024-09-10T16:37:16.031 INFO:teuthology.orchestra.run.smithi189.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28399.log.gz 2024-09-10T16:37:16.031 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31972.log 2024-09-10T16:37:16.031 INFO:teuthology.orchestra.run.smithi189.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31884.log.gz 2024-09-10T16:37:16.031 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31798.log 2024-09-10T16:37:16.031 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28520.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30477.log.gz 2024-09-10T16:37:16.031 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32146.log 2024-09-10T16:37:16.031 INFO:teuthology.orchestra.run.smithi189.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28520.log.gz 2024-09-10T16:37:16.031 INFO:teuthology.orchestra.run.smithi189.stderr:gzip/var/log/ceph/ceph-client.admin.31798.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.30826.log 2024-09-10T16:37:16.031 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32146.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31972.log.gz 2024-09-10T16:37:16.031 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29477.log 2024-09-10T16:37:16.031 INFO:teuthology.orchestra.run.smithi189.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31798.log.gz 2024-09-10T16:37:16.031 INFO:teuthology.orchestra.run.smithi189.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32146.log.gz 2024-09-10T16:37:16.032 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29128.log 2024-09-10T16:37:16.032 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31304.log 2024-09-10T16:37:16.032 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29128.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30826.log.gz 2024-09-10T16:37:16.032 INFO:teuthology.orchestra.run.smithi189.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29477.log.gz 2024-09-10T16:37:16.032 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28432.log 2024-09-10T16:37:16.032 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31304.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30912.log 2024-09-10T16:37:16.032 INFO:teuthology.orchestra.run.smithi189.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29128.log.gz 2024-09-10T16:37:16.032 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31971.log 2024-09-10T16:37:16.032 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29007.log 2024-09-10T16:37:16.032 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28432.log.gz 2024-09-10T16:37:16.032 INFO:teuthology.orchestra.run.smithi189.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31304.log.gz 2024-09-10T16:37:16.032 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31393.log 2024-09-10T16:37:16.032 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31971.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30912.log.gz 2024-09-10T16:37:16.033 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32179.log 2024-09-10T16:37:16.033 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32532.log 2024-09-10T16:37:16.033 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29007.log.gz 2024-09-10T16:37:16.033 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30565.log 2024-09-10T16:37:16.033 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32179.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31971.log.gz 2024-09-10T16:37:16.033 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29955.log 2024-09-10T16:37:16.033 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32532.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31393.log.gz 2024-09-10T16:37:16.033 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28694.log 2024-09-10T16:37:16.033 INFO:teuthology.orchestra.run.smithi189.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32532.log.gz 2024-09-10T16:37:16.033 INFO:teuthology.orchestra.run.smithi189.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.30565.log.gz 2024-09-10T16:37:16.033 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30740.log 2024-09-10T16:37:16.033 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29955.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32179.log.gz 2024-09-10T16:37:16.033 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28693.log 2024-09-10T16:37:16.034 INFO:teuthology.orchestra.run.smithi189.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29955.log.gz 2024-09-10T16:37:16.034 INFO:teuthology.orchestra.run.smithi189.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.28694.log.gz 2024-09-10T16:37:16.034 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28573.log 2024-09-10T16:37:16.034 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28521.log 2024-09-10T16:37:16.034 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28693.log: /var/log/ceph/ceph-client.admin.28573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28954.log 2024-09-10T16:37:16.034 INFO:teuthology.orchestra.run.smithi189.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30740.log.gz 2024-09-10T16:37:16.034 INFO:teuthology.orchestra.run.smithi189.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.28573.log.gz 2024-09-10T16:37:16.034 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32444.log 2024-09-10T16:37:16.034 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28693.log.gz 2024-09-10T16:37:16.034 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32496.log 2024-09-10T16:37:16.034 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31744.log 2024-09-10T16:37:16.034 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32444.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28954.log.gz 2024-09-10T16:37:16.034 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32496.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28521.log.gz 2024-09-10T16:37:16.035 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31483.log 2024-09-10T16:37:16.035 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31833.log 2024-09-10T16:37:16.035 INFO:teuthology.orchestra.run.smithi189.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32444.log.gz 2024-09-10T16:37:16.035 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31744.log: /var/log/ceph/ceph-client.admin.31483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25363.log 2024-09-10T16:37:16.035 INFO:teuthology.orchestra.run.smithi189.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32496.log.gz 2024-09-10T16:37:16.035 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31833.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-10T16:37:16.035 INFO:teuthology.orchestra.run.smithi189.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31744.log.gz 2024-09-10T16:37:16.035 INFO:teuthology.orchestra.run.smithi189.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31483.log.gz 2024-09-10T16:37:16.035 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29216.log 2024-09-10T16:37:16.035 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.25363.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32058.log 2024-09-10T16:37:16.035 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29216.log: 88.4% 89.7% -- replaced with /var/log/ceph/ceph-client.admin.25363.log.gz -- replaced with /var/log/ceph/ceph-client.admin.31833.log.gz 2024-09-10T16:37:16.035 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:37:16.036 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32584.log 2024-09-10T16:37:16.036 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32445.log 2024-09-10T16:37:16.036 INFO:teuthology.orchestra.run.smithi189.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.29216.log.gz 2024-09-10T16:37:16.036 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28433.log 2024-09-10T16:37:16.036 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32058.log.gz 2024-09-10T16:37:16.036 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32445.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-10T16:37:16.036 INFO:teuthology.orchestra.run.smithi189.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32584.log.gz 2024-09-10T16:37:16.036 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29616.log 2024-09-10T16:37:16.036 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28433.log: /var/log/ceph/ceph-osd.5.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.32445.log.gz 2024-09-10T16:37:16.036 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29651.log 2024-09-10T16:37:16.036 INFO:teuthology.orchestra.run.smithi189.stderr:gzip 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28433.log.gz 2024-09-10T16:37:16.036 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29616.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.29181.log 2024-09-10T16:37:16.036 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30128.log 2024-09-10T16:37:16.037 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29181.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29651.log.gz 2024-09-10T16:37:16.037 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30041.log 2024-09-10T16:37:16.037 INFO:teuthology.orchestra.run.smithi189.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29616.log.gz 2024-09-10T16:37:16.037 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28747.log 2024-09-10T16:37:16.037 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30041.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31570.log 2024-09-10T16:37:16.037 INFO:teuthology.orchestra.run.smithi189.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29181.log.gz 2024-09-10T16:37:16.037 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28747.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30128.log.gz 2024-09-10T16:37:16.037 INFO:teuthology.orchestra.run.smithi189.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30041.log.gz 2024-09-10T16:37:16.037 INFO:teuthology.orchestra.run.smithi189.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28747.log.gz 2024-09-10T16:37:16.037 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32443.log 2024-09-10T16:37:16.037 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30914.log 2024-09-10T16:37:16.037 INFO:teuthology.orchestra.run.smithi189.stderr:gzip/var/log/ceph/ceph-client.admin.32443.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.28608.log 2024-09-10T16:37:16.037 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31140.log 2024-09-10T16:37:16.038 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28608.log: gzip -5 --verbose -- 87.8% /var/log/ceph/ceph-client.admin.30478.log 2024-09-10T16:37:16.038 INFO:teuthology.orchestra.run.smithi189.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31570.log.gz 2024-09-10T16:37:16.038 INFO:teuthology.orchestra.run.smithi189.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32443.log.gz 2024-09-10T16:37:16.038 INFO:teuthology.orchestra.run.smithi189.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30914.log.gz 2024-09-10T16:37:16.038 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31140.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28608.log.gz 2024-09-10T16:37:16.038 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31140.log.gz 2024-09-10T16:37:16.038 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31536.log 2024-09-10T16:37:16.038 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31485.log 2024-09-10T16:37:16.038 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30269.log 2024-09-10T16:37:16.038 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31536.log: /var/log/ceph/ceph-client.admin.31485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32530.log 2024-09-10T16:37:16.038 INFO:teuthology.orchestra.run.smithi189.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.30478.log.gz/var/log/ceph/ceph-client.admin.30269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30617.log 2024-09-10T16:37:16.038 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:37:16.039 INFO:teuthology.orchestra.run.smithi189.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.30269.log.gz 2024-09-10T16:37:16.039 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32530.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31536.log.gz 2024-09-10T16:37:16.039 INFO:teuthology.orchestra.run.smithi189.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.31485.log.gz 2024-09-10T16:37:16.039 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30217.log 2024-09-10T16:37:16.039 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29869.log 2024-09-10T16:37:16.039 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.32530.log.gz 2024-09-10T16:37:16.039 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29954.log 2024-09-10T16:37:16.039 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30217.log: /var/log/ceph/ceph-client.admin.29869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31572.log 2024-09-10T16:37:16.039 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28311.log 2024-09-10T16:37:16.039 INFO:teuthology.orchestra.run.smithi189.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30617.log.gz 2024-09-10T16:37:16.039 INFO:teuthology.orchestra.run.smithi189.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30217.log.gz/var/log/ceph/ceph-client.admin.31572.log: 2024-09-10T16:37:16.039 INFO:teuthology.orchestra.run.smithi189.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29869.log.gz 2024-09-10T16:37:16.039 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30825.log 2024-09-10T16:37:16.040 INFO:teuthology.orchestra.run.smithi189.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.29954.log.gz 2024-09-10T16:37:16.040 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28311.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.31572.log.gz 2024-09-10T16:37:16.040 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28781.log 2024-09-10T16:37:16.040 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30390.log 2024-09-10T16:37:16.040 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.i.log 2024-09-10T16:37:16.040 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28781.log: /var/log/ceph/ceph-client.admin.30390.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32266.log 2024-09-10T16:37:16.040 INFO:teuthology.orchestra.run.smithi189.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.28311.log.gz 2024-09-10T16:37:16.040 INFO:teuthology.orchestra.run.smithi189.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30825.log.gz 2024-09-10T16:37:16.040 INFO:teuthology.orchestra.run.smithi189.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28781.log.gz 2024-09-10T16:37:16.040 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mon.i.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30390.log.gz 2024-09-10T16:37:16.040 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30443.log 2024-09-10T16:37:16.040 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32266.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30564.log 2024-09-10T16:37:16.040 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30181.log 2024-09-10T16:37:16.041 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29443.log 2024-09-10T16:37:16.041 INFO:teuthology.orchestra.run.smithi189.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.30443.log.gz 2024-09-10T16:37:16.041 INFO:teuthology.orchestra.run.smithi189.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32266.log.gz 2024-09-10T16:37:16.041 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30181.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30564.log.gz 2024-09-10T16:37:16.041 INFO:teuthology.orchestra.run.smithi189.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30181.log.gz 2024-09-10T16:37:16.041 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29094.log 2024-09-10T16:37:16.041 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29443.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.g.log 2024-09-10T16:37:16.041 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32787.log 2024-09-10T16:37:16.041 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29094.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29443.log.gz 2024-09-10T16:37:16.041 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mon.g.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29043.log 2024-09-10T16:37:16.041 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32787.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29094.log.gz 2024-09-10T16:37:16.041 INFO:teuthology.orchestra.run.smithi189.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32787.log.gz 2024-09-10T16:37:16.041 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31571.log 2024-09-10T16:37:16.041 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30216.log 2024-09-10T16:37:16.042 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30827.log 2024-09-10T16:37:16.042 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30216.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29043.log.gz 2024-09-10T16:37:16.042 INFO:teuthology.orchestra.run.smithi189.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31571.log.gz 2024-09-10T16:37:16.042 INFO:teuthology.orchestra.run.smithi189.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30216.log.gz 2024-09-10T16:37:16.042 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31446.log 2024-09-10T16:37:16.042 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31360.log 2024-09-10T16:37:16.042 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31446.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-10T16:37:16.042 INFO:teuthology.orchestra.run.smithi189.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30827.log.gz 2024-09-10T16:37:16.042 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31360.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31446.log.gz 2024-09-10T16:37:16.042 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31087.log 2024-09-10T16:37:16.042 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mgr.x.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.31360.log.gz 2024-09-10T16:37:16.042 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28607.log 2024-09-10T16:37:16.042 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30651.log 2024-09-10T16:37:16.043 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31087.log: /var/log/ceph/ceph-client.admin.28607.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.28607.log.gz 2024-09-10T16:37:16.043 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.31087.log.gz 2024-09-10T16:37:16.043 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29781.log 2024-09-10T16:37:16.043 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30043.log 2024-09-10T16:37:16.043 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30651.log: /var/log/ceph/ceph-client.admin.29781.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.30651.log.gz 2024-09-10T16:37:16.043 INFO:teuthology.orchestra.run.smithi189.stderr: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.29781.log.gz 2024-09-10T16:37:16.043 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-10T16:37:16.043 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30705.log 2024-09-10T16:37:16.045 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28925.log 2024-09-10T16:37:16.045 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31734.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.31734.log.gz 2024-09-10T16:37:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29527.log 2024-09-10T16:37:16.051 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28925.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28925.log.gz 2024-09-10T16:37:16.054 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30043.log: /var/log/ceph/ceph.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30043.log.gz 2024-09-10T16:37:16.054 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30007.log 2024-09-10T16:37:16.054 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30705.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30705.log.gz 2024-09-10T16:37:16.054 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29268.log 2024-09-10T16:37:16.054 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30007.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30007.log.gz 2024-09-10T16:37:16.054 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31919.log 2024-09-10T16:37:16.054 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29268.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29268.log.gz 2024-09-10T16:37:16.055 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30008.log 2024-09-10T16:37:16.055 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31919.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31919.log.gz 2024-09-10T16:37:16.055 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29921.log 2024-09-10T16:37:16.055 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30008.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30008.log.gz 2024-09-10T16:37:16.055 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30304.log 2024-09-10T16:37:16.055 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29921.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29921.log.gz 2024-09-10T16:37:16.055 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29780.log 2024-09-10T16:37:16.055 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30304.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30304.log.gz 2024-09-10T16:37:16.055 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28867.log 2024-09-10T16:37:16.055 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29780.log: 94.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-10T16:37:16.055 INFO:teuthology.orchestra.run.smithi189.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29780.log.gz 2024-09-10T16:37:16.055 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31306.log 2024-09-10T16:37:16.055 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30739.log 2024-09-10T16:37:16.055 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28867.log: /var/log/ceph/ceph-client.admin.31306.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31306.log.gz 2024-09-10T16:37:16.056 INFO:teuthology.orchestra.run.smithi189.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.28867.log.gz 2024-09-10T16:37:16.056 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32232.log 2024-09-10T16:37:16.056 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30738.log 2024-09-10T16:37:16.056 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30739.log: /var/log/ceph/ceph-client.admin.32232.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.30739.log.gz 2024-09-10T16:37:16.056 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30476.log 2024-09-10T16:37:16.056 INFO:teuthology.orchestra.run.smithi189.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.32232.log.gz 2024-09-10T16:37:16.056 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30738.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30738.log.gz 2024-09-10T16:37:16.056 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31659.log 2024-09-10T16:37:16.056 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.h.log 2024-09-10T16:37:16.056 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30476.log: /var/log/ceph/ceph-client.admin.31659.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31659.log.gz 2024-09-10T16:37:16.056 INFO:teuthology.orchestra.run.smithi189.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30476.log.gz 2024-09-10T16:37:16.056 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29782.log 2024-09-10T16:37:16.057 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30879.log 2024-09-10T16:37:16.057 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-mon.h.log: /var/log/ceph/ceph-client.admin.29782.log: 90.2% -- replaced with /var/log/ceph/ceph-client.admin.29782.log.gz 2024-09-10T16:37:16.057 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28606.log 2024-09-10T16:37:16.057 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30879.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30879.log.gz 2024-09-10T16:37:16.057 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30791.log 2024-09-10T16:37:16.057 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28606.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28606.log.gz 2024-09-10T16:37:16.057 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25415.log 2024-09-10T16:37:16.057 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30791.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.30791.log.gz 2024-09-10T16:37:16.057 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29041.log 2024-09-10T16:37:16.057 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.25415.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.25415.log.gz 2024-09-10T16:37:16.057 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28869.log 2024-09-10T16:37:16.057 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29041.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29041.log.gz 2024-09-10T16:37:16.057 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32583.log 2024-09-10T16:37:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31916.log 2024-09-10T16:37:16.059 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29527.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29527.log.gz 2024-09-10T16:37:16.060 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28869.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28869.log.gz 2024-09-10T16:37:16.060 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29529.log 2024-09-10T16:37:16.060 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32583.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32583.log.gz 2024-09-10T16:37:16.060 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32319.log 2024-09-10T16:37:16.061 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29529.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29529.log.gz 2024-09-10T16:37:16.061 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28955.log 2024-09-10T16:37:16.061 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32319.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32319.log.gz 2024-09-10T16:37:16.061 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32181.log 2024-09-10T16:37:16.062 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28955.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.28955.log.gz 2024-09-10T16:37:16.062 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30653.log 2024-09-10T16:37:16.063 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32181.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32181.log.gz 2024-09-10T16:37:16.064 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28485.log 2024-09-10T16:37:16.065 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30653.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30653.log.gz 2024-09-10T16:37:16.065 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32355.log 2024-09-10T16:37:16.067 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28485.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28485.log.gz 2024-09-10T16:37:16.067 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28486.log 2024-09-10T16:37:16.069 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32355.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32355.log.gz 2024-09-10T16:37:16.069 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31141.log 2024-09-10T16:37:16.070 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28486.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.28486.log.gz 2024-09-10T16:37:16.070 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29565.log 2024-09-10T16:37:16.071 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31141.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31141.log.gz 2024-09-10T16:37:16.072 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29795.log 2024-09-10T16:37:16.072 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30356.log 2024-09-10T16:37:16.073 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31916.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.31916.log.gz 2024-09-10T16:37:16.074 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29565.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29565.log.gz 2024-09-10T16:37:16.074 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-10T16:37:16.075 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30356.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30356.log.gz 2024-09-10T16:37:16.075 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32497.log 2024-09-10T16:37:16.079 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph.audit.log: 96.3% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-10T16:37:16.079 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32320.log 2024-09-10T16:37:16.080 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32497.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32497.log.gz 2024-09-10T16:37:16.081 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29564.log 2024-09-10T16:37:16.082 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32320.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32320.log.gz 2024-09-10T16:37:16.082 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32007.log 2024-09-10T16:37:16.083 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29564.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.29564.log.gz 2024-09-10T16:37:16.083 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29042.log 2024-09-10T16:37:16.085 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32007.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32007.log.gz 2024-09-10T16:37:16.085 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28833.log 2024-09-10T16:37:16.086 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29042.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.29042.log.gz 2024-09-10T16:37:16.086 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30999.log 2024-09-10T16:37:16.088 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30725.log 2024-09-10T16:37:16.088 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28833.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28833.log.gz 2024-09-10T16:37:16.089 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31624.log 2024-09-10T16:37:16.089 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29795.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29795.log.gz 2024-09-10T16:37:16.090 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30999.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30999.log.gz 2024-09-10T16:37:16.090 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28868.log 2024-09-10T16:37:16.091 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31624.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31624.log.gz 2024-09-10T16:37:16.092 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30965.log 2024-09-10T16:37:16.093 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28868.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28868.log.gz 2024-09-10T16:37:16.093 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32531.log 2024-09-10T16:37:16.095 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30965.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30965.log.gz 2024-09-10T16:37:16.095 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32059.log 2024-09-10T16:37:16.096 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32531.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.32531.log.gz 2024-09-10T16:37:16.096 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32006.log 2024-09-10T16:37:16.098 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32059.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.32059.log.gz 2024-09-10T16:37:16.098 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31658.log 2024-09-10T16:37:16.099 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32006.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32006.log.gz 2024-09-10T16:37:16.100 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32046.log 2024-09-10T16:37:16.100 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29867.log 2024-09-10T16:37:16.101 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30725.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.30725.log.gz 2024-09-10T16:37:16.101 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31658.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31658.log.gz 2024-09-10T16:37:16.101 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31484.log 2024-09-10T16:37:16.102 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29867.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.29867.log.gz 2024-09-10T16:37:16.103 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29390.log 2024-09-10T16:37:16.104 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31484.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.31484.log.gz 2024-09-10T16:37:16.104 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32092.log 2024-09-10T16:37:16.105 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29390.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.29390.log.gz 2024-09-10T16:37:16.106 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28659.log 2024-09-10T16:37:16.107 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32092.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32092.log.gz 2024-09-10T16:37:16.107 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28572.log 2024-09-10T16:37:16.109 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28659.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.28659.log.gz 2024-09-10T16:37:16.109 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31270.log 2024-09-10T16:37:16.111 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28572.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.28572.log.gz 2024-09-10T16:37:16.111 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30618.log 2024-09-10T16:37:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28696.log 2024-09-10T16:37:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.32046.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32046.log.gz 2024-09-10T16:37:16.113 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31270.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31270.log.gz 2024-09-10T16:37:16.114 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30531.log 2024-09-10T16:37:16.114 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30618.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.30618.log.gz 2024-09-10T16:37:16.114 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25387.log 2024-09-10T16:37:16.115 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30531.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.30531.log.gz 2024-09-10T16:37:16.116 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30268.log 2024-09-10T16:37:16.117 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.25387.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.25387.log.gz 2024-09-10T16:37:16.117 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29920.log 2024-09-10T16:37:16.119 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30268.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30268.log.gz 2024-09-10T16:37:16.119 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28347.log 2024-09-10T16:37:16.121 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29920.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.29920.log.gz 2024-09-10T16:37:16.121 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31218.log 2024-09-10T16:37:16.122 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28347.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.28347.log.gz 2024-09-10T16:37:16.123 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28782.log 2024-09-10T16:37:16.123 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30005.log 2024-09-10T16:37:16.124 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31218.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31218.log.gz 2024-09-10T16:37:16.124 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31623.log 2024-09-10T16:37:16.125 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28696.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28696.log.gz 2024-09-10T16:37:16.126 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28782.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.28782.log.gz 2024-09-10T16:37:16.126 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31832.log 2024-09-10T16:37:16.128 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31623.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31623.log.gz 2024-09-10T16:37:16.128 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30878.log 2024-09-10T16:37:16.129 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31832.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.31832.log.gz 2024-09-10T16:37:16.129 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29389.log 2024-09-10T16:37:16.131 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30878.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30878.log.gz 2024-09-10T16:37:16.131 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29868.log 2024-09-10T16:37:16.133 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29389.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.29389.log.gz 2024-09-10T16:37:16.133 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32785.log 2024-09-10T16:37:16.134 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29868.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29868.log.gz 2024-09-10T16:37:16.135 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32093.log 2024-09-10T16:37:16.136 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28301.log 2024-09-10T16:37:16.136 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32785.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.32785.log.gz 2024-09-10T16:37:16.137 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29008.log 2024-09-10T16:37:16.137 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30005.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.30005.log.gz 2024-09-10T16:37:16.138 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32093.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32093.log.gz 2024-09-10T16:37:16.138 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32180.log 2024-09-10T16:37:16.139 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29008.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29008.log.gz 2024-09-10T16:37:16.139 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25339.log 2024-09-10T16:37:16.140 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32180.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.32180.log.gz 2024-09-10T16:37:16.141 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30792.log 2024-09-10T16:37:16.142 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.25339.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.25339.log.gz 2024-09-10T16:37:16.142 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31711.log 2024-09-10T16:37:16.143 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30792.log: 90.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-10T16:37:16.143 INFO:teuthology.orchestra.run.smithi189.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.30792.log.gz 2024-09-10T16:37:16.143 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29215.log 2024-09-10T16:37:16.144 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29442.log 2024-09-10T16:37:16.145 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29215.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31711.log.gz 2024-09-10T16:37:16.145 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31885.log 2024-09-10T16:37:16.145 INFO:teuthology.orchestra.run.smithi189.stderr: 88.0%/var/log/ceph/ceph-client.admin.29442.log: -- replaced with /var/log/ceph/ceph-client.admin.29215.log.gz 2024-09-10T16:37:16.147 INFO:teuthology.orchestra.run.smithi189.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.29442.log.gz 2024-09-10T16:37:16.147 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31089.log 2024-09-10T16:37:16.148 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31831.log 2024-09-10T16:37:16.149 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30751.log 2024-09-10T16:37:16.149 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28301.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28301.log.gz 2024-09-10T16:37:16.150 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31089.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.31885.log.gz 2024-09-10T16:37:16.151 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28920.log 2024-09-10T16:37:16.151 INFO:teuthology.orchestra.run.smithi189.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.31089.log.gz 2024-09-10T16:37:16.151 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30042.log 2024-09-10T16:37:16.151 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28920.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.31831.log.gz 2024-09-10T16:37:16.151 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-10T16:37:16.151 INFO:teuthology.orchestra.run.smithi189.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28920.log.gz 2024-09-10T16:37:16.152 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30042.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.30042.log.gz 2024-09-10T16:37:16.152 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28345.log 2024-09-10T16:37:16.152 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30302.log 2024-09-10T16:37:16.153 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28345.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.28345.log.gz 2024-09-10T16:37:16.154 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30389.log 2024-09-10T16:37:16.155 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30302.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.30302.log.gz 2024-09-10T16:37:16.155 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28346.log 2024-09-10T16:37:16.157 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30389.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.30389.log.gz 2024-09-10T16:37:16.158 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29652.log 2024-09-10T16:37:16.158 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28346.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28346.log.gz 2024-09-10T16:37:16.158 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25439.log 2024-09-10T16:37:16.159 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29652.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.29652.log.gz 2024-09-10T16:37:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31838.log 2024-09-10T16:37:16.161 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.30751.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.30751.log.gz 2024-09-10T16:37:16.162 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30913.log 2024-09-10T16:37:16.162 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.25439.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.25439.log.gz 2024-09-10T16:37:16.162 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32268.log 2024-09-10T16:37:16.162 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30913.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.30913.log.gz 2024-09-10T16:37:16.163 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29747.log 2024-09-10T16:37:16.163 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32268.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32268.log.gz 2024-09-10T16:37:16.164 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30215.log 2024-09-10T16:37:16.165 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29747.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.29747.log.gz 2024-09-10T16:37:16.165 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29130.log 2024-09-10T16:37:16.166 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30215.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.30215.log.gz 2024-09-10T16:37:16.167 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31447.log 2024-09-10T16:37:16.168 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29130.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.29130.log.gz 2024-09-10T16:37:16.169 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30182.log 2024-09-10T16:37:16.169 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31447.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.31447.log.gz 2024-09-10T16:37:16.170 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32353.log 2024-09-10T16:37:16.170 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30182.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.30182.log.gz 2024-09-10T16:37:16.171 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31053.log 2024-09-10T16:37:16.172 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32353.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.32353.log.gz 2024-09-10T16:37:16.173 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29563.log 2024-09-10T16:37:16.174 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.31053.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.31053.log.gz 2024-09-10T16:37:16.174 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28398.log 2024-09-10T16:37:16.175 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29563.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.29563.log.gz 2024-09-10T16:37:16.176 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30442.log 2024-09-10T16:37:16.177 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28398.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.28398.log.gz 2024-09-10T16:37:16.178 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28312.log 2024-09-10T16:37:16.179 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30442.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.30442.log.gz 2024-09-10T16:37:16.179 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30129.log 2024-09-10T16:37:16.180 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28540.log 2024-09-10T16:37:16.180 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.28312.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.28312.log.gz 2024-09-10T16:37:16.182 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.31838.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.31838.log.gz 2024-09-10T16:37:16.182 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32786.log 2024-09-10T16:37:16.182 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.30129.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.30129.log.gz 2024-09-10T16:37:16.182 INFO:teuthology.orchestra.run.smithi189.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29617.log 2024-09-10T16:37:16.183 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.32786.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.32786.log.gz 2024-09-10T16:37:16.184 INFO:teuthology.orchestra.run.smithi189.stderr:/var/log/ceph/ceph-client.admin.29617.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.29617.log.gz 2024-09-10T16:37:16.201 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25172.log 2024-09-10T16:37:16.201 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28540.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.28540.log.gz 2024-09-10T16:37:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28548.log 2024-09-10T16:37:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25172.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.25172.log.gz 2024-09-10T16:37:16.216 INFO:teuthology.orchestra.run.smithi189.stderr: 90.1% -- replaced with /var/log/ceph/ceph-mon.g.log.gz 2024-09-10T16:37:16.224 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29345.log 2024-09-10T16:37:16.226 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28548.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.28548.log.gz 2024-09-10T16:37:16.244 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28507.log 2024-09-10T16:37:16.245 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29345.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.29345.log.gz 2024-09-10T16:37:16.252 INFO:teuthology.orchestra.run.smithi189.stderr: 90.2% -- replaced with /var/log/ceph/ceph-mon.i.log.gz 2024-09-10T16:37:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25408.log 2024-09-10T16:37:16.257 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28507.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.28507.log.gz 2024-09-10T16:37:16.258 INFO:teuthology.orchestra.run.smithi189.stderr: 90.0% -- replaced with /var/log/ceph/ceph-mon.f.log.gz 2024-09-10T16:37:16.268 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28951.log 2024-09-10T16:37:16.269 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.25408.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.25408.log.gz 2024-09-10T16:37:16.284 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.28229.log 2024-09-10T16:37:16.285 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28951.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.28951.log.gz 2024-09-10T16:37:16.291 INFO:teuthology.orchestra.run.smithi081.stderr: 90.0% -- replaced with /var/log/ceph/ceph-mon.d.log.gz 2024-09-10T16:37:16.292 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29743.log 2024-09-10T16:37:16.293 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.28229.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.28229.log.gz 2024-09-10T16:37:16.293 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29029.log 2024-09-10T16:37:16.294 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29743.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.29743.log.gz 2024-09-10T16:37:16.295 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.29029.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.29029.log.gz 2024-09-10T16:37:16.325 INFO:teuthology.orchestra.run.smithi081.stderr: 90.0% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-10T16:37:16.358 INFO:teuthology.orchestra.run.smithi189.stderr: 90.0% -- replaced with /var/log/ceph/ceph-mon.h.log.gz 2024-09-10T16:37:16.453 INFO:teuthology.orchestra.run.smithi081.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-10T16:37:16.512 INFO:teuthology.orchestra.run.smithi081.stderr: 90.2% -- replaced with /var/log/ceph/ceph-mon.e.log.gz 2024-09-10T16:37:16.689 INFO:teuthology.orchestra.run.smithi081.stderr: 90.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-10T16:37:18.354 INFO:teuthology.orchestra.run.smithi081.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-10T16:37:18.600 INFO:teuthology.orchestra.run.smithi081.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-10T16:37:18.613 INFO:teuthology.orchestra.run.smithi081.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-10T16:37:18.614 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-10T16:37:18.614 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m2.732s 2024-09-10T16:37:18.614 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m10.151s 2024-09-10T16:37:18.614 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m0.368s 2024-09-10T16:37:18.628 INFO:teuthology.orchestra.run.smithi189.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-10T16:37:18.665 INFO:teuthology.orchestra.run.smithi189.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-10T16:37:18.808 INFO:teuthology.orchestra.run.smithi189.stderr: 92.3% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-10T16:37:18.809 INFO:teuthology.orchestra.run.smithi189.stderr: 2024-09-10T16:37:18.810 INFO:teuthology.orchestra.run.smithi189.stderr:real 0m2.882s 2024-09-10T16:37:18.810 INFO:teuthology.orchestra.run.smithi189.stderr:user 0m9.226s 2024-09-10T16:37:18.810 INFO:teuthology.orchestra.run.smithi189.stderr:sys 0m0.396s 2024-09-10T16:37:18.811 INFO:tasks.ceph:Archiving logs... 2024-09-10T16:37:18.811 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/remote/smithi081/log 2024-09-10T16:37:18.812 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T16:37:20.289 DEBUG:teuthology.misc:Transferring archived files from smithi189:/var/log/ceph to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/remote/smithi189/log 2024-09-10T16:37:20.290 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-10T16:37:21.760 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-10T16:37:21.774 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-10T16:37:21.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T16:37:21.777 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-10T16:37:21.839 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-10T16:37:21.849 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-10T16:37:21.849 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T16:37:21.852 DEBUG:teuthology.orchestra.run.smithi189:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-10T16:37:21.861 INFO:teuthology.orchestra.run.smithi081.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T16:37:21.861 INFO:teuthology.orchestra.run.smithi081.stdout:============================================================================== 2024-09-10T16:37:21.861 INFO:teuthology.orchestra.run.smithi081.stdout:+hv01.front.sepi 67.205.162.81 3 u 60 64 377 0.102 -1.468 0.927 2024-09-10T16:37:21.861 INFO:teuthology.orchestra.run.smithi081.stdout:*hv02.front.sepi 63.231.80.2 3 u 61 64 377 0.086 -2.711 1.592 2024-09-10T16:37:21.862 INFO:teuthology.orchestra.run.smithi081.stdout:+hv03.front.sepi 74.6.168.72 3 u 59 64 377 0.091 -1.303 0.977 2024-09-10T16:37:21.862 INFO:teuthology.orchestra.run.smithi081.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-10T16:37:21.863 INFO:teuthology.orchestra.run.smithi189.stdout: remote refid st t when poll reach delay offset jitter 2024-09-10T16:37:21.863 INFO:teuthology.orchestra.run.smithi189.stdout:============================================================================== 2024-09-10T16:37:21.864 INFO:teuthology.orchestra.run.smithi189.stdout:+hv01.front.sepi 67.205.162.81 3 u 2 64 377 0.071 -1.229 1.251 2024-09-10T16:37:21.864 INFO:teuthology.orchestra.run.smithi189.stdout:*hv02.front.sepi 63.231.80.2 3 u - 64 377 0.080 -0.451 1.516 2024-09-10T16:37:21.864 INFO:teuthology.orchestra.run.smithi189.stdout:+hv03.front.sepi 74.6.168.72 3 u 1 64 377 0.096 +0.243 1.506 2024-09-10T16:37:21.864 INFO:teuthology.orchestra.run.smithi189.stdout: hv04.front.sepi .INIT. 16 u - 128 0 0.000 +0.000 0.000 2024-09-10T16:37:21.865 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-10T16:37:21.874 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-10T16:37:21.875 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-10T16:37:21.884 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-10T16:37:21.897 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-10T16:37:21.911 INFO:teuthology.task.internal:Duration was 1044.868024 seconds 2024-09-10T16:37:21.911 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-10T16:37:21.926 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-10T16:37:21.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T16:37:21.929 DEBUG:teuthology.orchestra.run.smithi189:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-10T16:37:21.967 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-10T16:37:21.968 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-10T16:37:21.968 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T16:37:22.017 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi189.front.sepia.ceph.com 2024-09-10T16:37:22.017 DEBUG:teuthology.orchestra.run.smithi189:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-10T16:37:22.027 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-10T16:37:22.028 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T16:37:22.061 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-10T16:37:22.100 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-10T16:37:22.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T16:37:22.137 DEBUG:teuthology.orchestra.run.smithi189:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-10T16:37:22.198 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-10T16:37:22.239 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-10T16:37:22.239 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T16:37:22.250 DEBUG:teuthology.orchestra.run.smithi189:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-10T16:37:22.263 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-10T16:37:22.274 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T16:37:22.293 DEBUG:teuthology.orchestra.run.smithi189:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-10T16:37:22.301 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-10T16:37:22.315 INFO:teuthology.orchestra.run.smithi189.stdout:kernel.core_pattern = core 2024-09-10T16:37:22.416 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T16:37:22.460 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T16:37:22.461 DEBUG:teuthology.orchestra.run.smithi189:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-10T16:37:22.466 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-10T16:37:22.466 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-10T16:37:22.479 INFO:teuthology.task.internal:Transferring archived files... 2024-09-10T16:37:22.480 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/remote/smithi081 2024-09-10T16:37:22.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T16:37:22.525 DEBUG:teuthology.misc:Transferring archived files from smithi189:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/skanta-2024-09-10_15:30:27-rados-wip-bharath7-testing-2024-09-10-1409-distro-default-smithi/7899310/remote/smithi189 2024-09-10T16:37:22.525 DEBUG:teuthology.orchestra.run.smithi189:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-10T16:37:22.546 INFO:teuthology.task.internal:Removing archive directory... 2024-09-10T16:37:22.546 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T16:37:22.570 DEBUG:teuthology.orchestra.run.smithi189:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-10T16:37:22.593 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-10T16:37:22.609 INFO:teuthology.task.internal:Not uploading archives. 2024-09-10T16:37:22.609 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-10T16:37:22.626 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-10T16:37:22.627 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T16:37:22.629 DEBUG:teuthology.orchestra.run.smithi189:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-10T16:37:22.633 INFO:teuthology.orchestra.run.smithi081.stdout: 658640 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 16:37 /home/ubuntu/cephtest 2024-09-10T16:37:22.641 INFO:teuthology.orchestra.run.smithi189.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 10 16:37 /home/ubuntu/cephtest 2024-09-10T16:37:22.643 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-10T16:37:22.655 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-10T16:37:22.689 INFO:teuthology.run:Summary data: description: rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/{bluestore-options/write$/{write_v2} bluestore/bluestore-comp-zlib} rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/pool-create-delete} duration: 1044.868024110794 flavor: default owner: scheduled_skanta@teuthology success: true 2024-09-10T16:37:22.689 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-10T16:37:22.786 INFO:teuthology.run:pass